00:00:00.000 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v23.11" build number 923 00:00:00.000 originally caused by: 00:00:00.000 Started by upstream project "nightly-trigger" build number 3590 00:00:00.000 originally caused by: 00:00:00.000 Started by timer 00:00:00.045 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.045 The recommended git tool is: git 00:00:00.045 using credential 00000000-0000-0000-0000-000000000002 00:00:00.047 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.066 Fetching changes from the remote Git repository 00:00:00.069 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.099 Using shallow fetch with depth 1 00:00:00.099 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.099 > git --version # timeout=10 00:00:00.131 > git --version # 'git version 2.39.2' 00:00:00.131 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.157 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.157 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:04.664 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:04.673 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:04.684 Checking out Revision 44e7d6069a399ee2647233b387d68a938882e7b7 (FETCH_HEAD) 00:00:04.684 > git config core.sparsecheckout # timeout=10 00:00:04.694 > git read-tree -mu HEAD # timeout=10 00:00:04.711 > git checkout -f 44e7d6069a399ee2647233b387d68a938882e7b7 # timeout=5 00:00:04.728 Commit message: "scripts/bmc: Rework Get NIC Info cmd parser" 00:00:04.728 > git rev-list --no-walk 44e7d6069a399ee2647233b387d68a938882e7b7 # timeout=10 00:00:04.823 [Pipeline] Start of Pipeline 00:00:04.836 [Pipeline] library 00:00:04.837 Loading library shm_lib@master 00:00:04.837 Library shm_lib@master is cached. Copying from home. 00:00:04.851 [Pipeline] node 00:00:04.858 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:04.860 [Pipeline] { 00:00:04.871 [Pipeline] catchError 00:00:04.872 [Pipeline] { 00:00:04.886 [Pipeline] wrap 00:00:04.894 [Pipeline] { 00:00:04.902 [Pipeline] stage 00:00:04.904 [Pipeline] { (Prologue) 00:00:05.104 [Pipeline] sh 00:00:05.393 + logger -p user.info -t JENKINS-CI 00:00:05.411 [Pipeline] echo 00:00:05.413 Node: GP11 00:00:05.421 [Pipeline] sh 00:00:05.727 [Pipeline] setCustomBuildProperty 00:00:05.740 [Pipeline] echo 00:00:05.741 Cleanup processes 00:00:05.746 [Pipeline] sh 00:00:06.036 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.036 2207088 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.050 [Pipeline] sh 00:00:06.337 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.337 ++ grep -v 'sudo pgrep' 00:00:06.337 ++ awk '{print $1}' 00:00:06.337 + sudo kill -9 00:00:06.337 + true 00:00:06.351 [Pipeline] cleanWs 00:00:06.359 [WS-CLEANUP] Deleting project workspace... 00:00:06.359 [WS-CLEANUP] Deferred wipeout is used... 00:00:06.366 [WS-CLEANUP] done 00:00:06.370 [Pipeline] setCustomBuildProperty 00:00:06.383 [Pipeline] sh 00:00:06.665 + sudo git config --global --replace-all safe.directory '*' 00:00:06.743 [Pipeline] httpRequest 00:00:08.288 [Pipeline] echo 00:00:08.290 Sorcerer 10.211.164.101 is alive 00:00:08.298 [Pipeline] retry 00:00:08.300 [Pipeline] { 00:00:08.313 [Pipeline] httpRequest 00:00:08.317 HttpMethod: GET 00:00:08.317 URL: http://10.211.164.101/packages/jbp_44e7d6069a399ee2647233b387d68a938882e7b7.tar.gz 00:00:08.318 Sending request to url: http://10.211.164.101/packages/jbp_44e7d6069a399ee2647233b387d68a938882e7b7.tar.gz 00:00:08.335 Response Code: HTTP/1.1 200 OK 00:00:08.335 Success: Status code 200 is in the accepted range: 200,404 00:00:08.336 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_44e7d6069a399ee2647233b387d68a938882e7b7.tar.gz 00:00:14.806 [Pipeline] } 00:00:14.825 [Pipeline] // retry 00:00:14.833 [Pipeline] sh 00:00:15.123 + tar --no-same-owner -xf jbp_44e7d6069a399ee2647233b387d68a938882e7b7.tar.gz 00:00:15.141 [Pipeline] httpRequest 00:00:15.562 [Pipeline] echo 00:00:15.564 Sorcerer 10.211.164.101 is alive 00:00:15.573 [Pipeline] retry 00:00:15.575 [Pipeline] { 00:00:15.589 [Pipeline] httpRequest 00:00:15.594 HttpMethod: GET 00:00:15.594 URL: http://10.211.164.101/packages/spdk_726a04d705a30cca40ac8dc8d45f839602005b7a.tar.gz 00:00:15.595 Sending request to url: http://10.211.164.101/packages/spdk_726a04d705a30cca40ac8dc8d45f839602005b7a.tar.gz 00:00:15.616 Response Code: HTTP/1.1 200 OK 00:00:15.617 Success: Status code 200 is in the accepted range: 200,404 00:00:15.617 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_726a04d705a30cca40ac8dc8d45f839602005b7a.tar.gz 00:00:57.924 [Pipeline] } 00:00:57.943 [Pipeline] // retry 00:00:57.951 [Pipeline] sh 00:00:58.238 + tar --no-same-owner -xf spdk_726a04d705a30cca40ac8dc8d45f839602005b7a.tar.gz 00:01:00.784 [Pipeline] sh 00:01:01.070 + git -C spdk log --oneline -n5 00:01:01.070 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:01.070 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:01.070 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:01.070 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:01.070 9469ea403 nvme/fio_plugin: add trim support 00:01:01.091 [Pipeline] withCredentials 00:01:01.104 > git --version # timeout=10 00:01:01.118 > git --version # 'git version 2.39.2' 00:01:01.138 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:01:01.140 [Pipeline] { 00:01:01.150 [Pipeline] retry 00:01:01.152 [Pipeline] { 00:01:01.168 [Pipeline] sh 00:01:01.458 + git ls-remote http://dpdk.org/git/dpdk-stable v23.11 00:01:01.731 [Pipeline] } 00:01:01.750 [Pipeline] // retry 00:01:01.755 [Pipeline] } 00:01:01.771 [Pipeline] // withCredentials 00:01:01.782 [Pipeline] httpRequest 00:01:02.189 [Pipeline] echo 00:01:02.191 Sorcerer 10.211.164.101 is alive 00:01:02.202 [Pipeline] retry 00:01:02.205 [Pipeline] { 00:01:02.220 [Pipeline] httpRequest 00:01:02.225 HttpMethod: GET 00:01:02.225 URL: http://10.211.164.101/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:02.226 Sending request to url: http://10.211.164.101/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:02.229 Response Code: HTTP/1.1 200 OK 00:01:02.229 Success: Status code 200 is in the accepted range: 200,404 00:01:02.230 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:09.881 [Pipeline] } 00:01:09.931 [Pipeline] // retry 00:01:09.942 [Pipeline] sh 00:01:10.233 + tar --no-same-owner -xf dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:11.622 [Pipeline] sh 00:01:11.909 + git -C dpdk log --oneline -n5 00:01:11.909 eeb0605f11 version: 23.11.0 00:01:11.909 238778122a doc: update release notes for 23.11 00:01:11.909 46aa6b3cfc doc: fix description of RSS features 00:01:11.909 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:11.909 7e421ae345 devtools: support skipping forbid rule check 00:01:11.920 [Pipeline] } 00:01:11.934 [Pipeline] // stage 00:01:11.942 [Pipeline] stage 00:01:11.944 [Pipeline] { (Prepare) 00:01:11.962 [Pipeline] writeFile 00:01:11.976 [Pipeline] sh 00:01:12.261 + logger -p user.info -t JENKINS-CI 00:01:12.275 [Pipeline] sh 00:01:12.562 + logger -p user.info -t JENKINS-CI 00:01:12.576 [Pipeline] sh 00:01:12.873 + cat autorun-spdk.conf 00:01:12.873 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:12.873 SPDK_TEST_NVMF=1 00:01:12.873 SPDK_TEST_NVME_CLI=1 00:01:12.873 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:12.873 SPDK_TEST_NVMF_NICS=e810 00:01:12.873 SPDK_TEST_VFIOUSER=1 00:01:12.873 SPDK_RUN_UBSAN=1 00:01:12.873 NET_TYPE=phy 00:01:12.873 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:12.873 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:12.882 RUN_NIGHTLY=1 00:01:12.886 [Pipeline] readFile 00:01:12.901 [Pipeline] withEnv 00:01:12.902 [Pipeline] { 00:01:12.911 [Pipeline] sh 00:01:13.197 + set -ex 00:01:13.197 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:13.197 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:13.197 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:13.197 ++ SPDK_TEST_NVMF=1 00:01:13.197 ++ SPDK_TEST_NVME_CLI=1 00:01:13.197 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:13.197 ++ SPDK_TEST_NVMF_NICS=e810 00:01:13.197 ++ SPDK_TEST_VFIOUSER=1 00:01:13.197 ++ SPDK_RUN_UBSAN=1 00:01:13.197 ++ NET_TYPE=phy 00:01:13.197 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:13.197 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:13.197 ++ RUN_NIGHTLY=1 00:01:13.197 + case $SPDK_TEST_NVMF_NICS in 00:01:13.197 + DRIVERS=ice 00:01:13.197 + [[ tcp == \r\d\m\a ]] 00:01:13.197 + [[ -n ice ]] 00:01:13.197 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:13.197 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:13.197 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:13.197 rmmod: ERROR: Module irdma is not currently loaded 00:01:13.197 rmmod: ERROR: Module i40iw is not currently loaded 00:01:13.197 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:13.197 + true 00:01:13.197 + for D in $DRIVERS 00:01:13.197 + sudo modprobe ice 00:01:13.197 + exit 0 00:01:13.206 [Pipeline] } 00:01:13.220 [Pipeline] // withEnv 00:01:13.223 [Pipeline] } 00:01:13.236 [Pipeline] // stage 00:01:13.244 [Pipeline] catchError 00:01:13.246 [Pipeline] { 00:01:13.258 [Pipeline] timeout 00:01:13.258 Timeout set to expire in 1 hr 0 min 00:01:13.259 [Pipeline] { 00:01:13.272 [Pipeline] stage 00:01:13.273 [Pipeline] { (Tests) 00:01:13.286 [Pipeline] sh 00:01:13.570 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:13.570 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:13.570 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:13.570 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:13.570 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:13.570 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:13.570 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:13.570 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:13.570 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:13.570 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:13.570 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:13.570 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:13.570 + source /etc/os-release 00:01:13.570 ++ NAME='Fedora Linux' 00:01:13.570 ++ VERSION='39 (Cloud Edition)' 00:01:13.570 ++ ID=fedora 00:01:13.570 ++ VERSION_ID=39 00:01:13.570 ++ VERSION_CODENAME= 00:01:13.570 ++ PLATFORM_ID=platform:f39 00:01:13.570 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:13.570 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:13.570 ++ LOGO=fedora-logo-icon 00:01:13.570 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:13.570 ++ HOME_URL=https://fedoraproject.org/ 00:01:13.570 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:13.570 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:13.570 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:13.570 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:13.570 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:13.570 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:13.570 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:13.570 ++ SUPPORT_END=2024-11-12 00:01:13.570 ++ VARIANT='Cloud Edition' 00:01:13.570 ++ VARIANT_ID=cloud 00:01:13.570 + uname -a 00:01:13.570 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:13.570 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:14.508 Hugepages 00:01:14.508 node hugesize free / total 00:01:14.508 node0 1048576kB 0 / 0 00:01:14.508 node0 2048kB 0 / 0 00:01:14.508 node1 1048576kB 0 / 0 00:01:14.508 node1 2048kB 0 / 0 00:01:14.508 00:01:14.508 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:14.508 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:14.508 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:14.508 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:14.508 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:14.508 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:14.508 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:14.508 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:14.508 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:14.508 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:14.767 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:14.767 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:14.767 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:14.767 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:14.767 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:14.767 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:14.767 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:14.767 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:14.767 + rm -f /tmp/spdk-ld-path 00:01:14.767 + source autorun-spdk.conf 00:01:14.767 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:14.767 ++ SPDK_TEST_NVMF=1 00:01:14.767 ++ SPDK_TEST_NVME_CLI=1 00:01:14.767 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:14.767 ++ SPDK_TEST_NVMF_NICS=e810 00:01:14.767 ++ SPDK_TEST_VFIOUSER=1 00:01:14.767 ++ SPDK_RUN_UBSAN=1 00:01:14.767 ++ NET_TYPE=phy 00:01:14.767 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:14.767 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:14.767 ++ RUN_NIGHTLY=1 00:01:14.767 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:14.767 + [[ -n '' ]] 00:01:14.767 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:14.767 + for M in /var/spdk/build-*-manifest.txt 00:01:14.767 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:14.767 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:14.767 + for M in /var/spdk/build-*-manifest.txt 00:01:14.767 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:14.767 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:14.767 + for M in /var/spdk/build-*-manifest.txt 00:01:14.767 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:14.767 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:14.767 ++ uname 00:01:14.767 + [[ Linux == \L\i\n\u\x ]] 00:01:14.767 + sudo dmesg -T 00:01:14.767 + sudo dmesg --clear 00:01:14.767 + dmesg_pid=2207895 00:01:14.767 + [[ Fedora Linux == FreeBSD ]] 00:01:14.767 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:14.767 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:14.767 + sudo dmesg -Tw 00:01:14.767 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:14.767 + [[ -x /usr/src/fio-static/fio ]] 00:01:14.767 + export FIO_BIN=/usr/src/fio-static/fio 00:01:14.767 + FIO_BIN=/usr/src/fio-static/fio 00:01:14.767 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:14.767 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:14.767 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:14.767 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:14.767 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:14.767 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:14.767 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:14.767 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:14.767 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:14.767 Test configuration: 00:01:14.767 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:14.767 SPDK_TEST_NVMF=1 00:01:14.767 SPDK_TEST_NVME_CLI=1 00:01:14.767 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:14.767 SPDK_TEST_NVMF_NICS=e810 00:01:14.767 SPDK_TEST_VFIOUSER=1 00:01:14.767 SPDK_RUN_UBSAN=1 00:01:14.767 NET_TYPE=phy 00:01:14.767 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:14.767 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:14.767 RUN_NIGHTLY=1 15:45:04 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:14.767 15:45:04 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:14.767 15:45:04 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:14.767 15:45:04 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:14.767 15:45:04 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:14.767 15:45:04 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:14.767 15:45:04 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:14.767 15:45:04 -- paths/export.sh@5 -- $ export PATH 00:01:14.767 15:45:04 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:14.767 15:45:04 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:14.767 15:45:04 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:14.767 15:45:04 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1730299504.XXXXXX 00:01:14.767 15:45:04 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1730299504.VUmaVx 00:01:14.767 15:45:04 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:14.767 15:45:04 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:01:14.767 15:45:04 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:14.767 15:45:04 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:14.767 15:45:04 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:14.767 15:45:04 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:14.767 15:45:04 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:14.767 15:45:04 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:01:14.767 15:45:04 -- common/autotest_common.sh@10 -- $ set +x 00:01:14.767 15:45:04 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:14.767 15:45:04 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:14.767 15:45:04 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:14.767 15:45:04 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:14.767 15:45:04 -- spdk/autobuild.sh@16 -- $ date -u 00:01:14.767 Wed Oct 30 02:45:04 PM UTC 2024 00:01:14.767 15:45:04 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:14.767 LTS-66-g726a04d70 00:01:14.767 15:45:04 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:14.767 15:45:04 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:14.767 15:45:04 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:14.768 15:45:04 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:01:14.768 15:45:04 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:14.768 15:45:04 -- common/autotest_common.sh@10 -- $ set +x 00:01:14.768 ************************************ 00:01:14.768 START TEST ubsan 00:01:14.768 ************************************ 00:01:14.768 15:45:04 -- common/autotest_common.sh@1104 -- $ echo 'using ubsan' 00:01:14.768 using ubsan 00:01:14.768 00:01:14.768 real 0m0.000s 00:01:14.768 user 0m0.000s 00:01:14.768 sys 0m0.000s 00:01:14.768 15:45:04 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:01:14.768 15:45:04 -- common/autotest_common.sh@10 -- $ set +x 00:01:14.768 ************************************ 00:01:14.768 END TEST ubsan 00:01:14.768 ************************************ 00:01:14.768 15:45:04 -- spdk/autobuild.sh@27 -- $ '[' -n v23.11 ']' 00:01:14.768 15:45:04 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:15.027 15:45:04 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:15.027 15:45:04 -- common/autotest_common.sh@1077 -- $ '[' 2 -le 1 ']' 00:01:15.027 15:45:04 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:15.027 15:45:04 -- common/autotest_common.sh@10 -- $ set +x 00:01:15.027 ************************************ 00:01:15.027 START TEST build_native_dpdk 00:01:15.027 ************************************ 00:01:15.027 15:45:04 -- common/autotest_common.sh@1104 -- $ _build_native_dpdk 00:01:15.027 15:45:04 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:15.027 15:45:04 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:15.027 15:45:04 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:15.027 15:45:04 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:15.027 15:45:04 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:15.027 15:45:04 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:15.027 15:45:04 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:15.027 15:45:04 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:15.027 15:45:04 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:15.027 15:45:04 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:15.027 15:45:04 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:15.027 15:45:04 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:15.027 15:45:04 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:15.027 15:45:04 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:15.027 15:45:04 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:15.027 15:45:04 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:15.027 15:45:04 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:15.027 15:45:04 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:15.027 15:45:04 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:15.027 15:45:04 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:15.027 eeb0605f11 version: 23.11.0 00:01:15.027 238778122a doc: update release notes for 23.11 00:01:15.027 46aa6b3cfc doc: fix description of RSS features 00:01:15.027 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:15.027 7e421ae345 devtools: support skipping forbid rule check 00:01:15.027 15:45:04 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:15.027 15:45:04 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:15.027 15:45:04 -- common/autobuild_common.sh@87 -- $ dpdk_ver=23.11.0 00:01:15.027 15:45:04 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:15.027 15:45:04 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:15.027 15:45:04 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:15.027 15:45:04 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:15.027 15:45:04 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:15.027 15:45:04 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:15.027 15:45:04 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:15.027 15:45:04 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:15.027 15:45:04 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:15.027 15:45:04 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:15.027 15:45:04 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:15.027 15:45:04 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:15.027 15:45:04 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:15.027 15:45:04 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:15.027 15:45:04 -- common/autobuild_common.sh@169 -- $ lt 23.11.0 21.11.0 00:01:15.027 15:45:04 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 21.11.0 00:01:15.027 15:45:04 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:15.027 15:45:04 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:15.027 15:45:04 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:15.027 15:45:04 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:15.027 15:45:04 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:15.027 15:45:04 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:15.027 15:45:04 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:15.027 15:45:04 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:15.027 15:45:04 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:15.027 15:45:04 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:15.027 15:45:04 -- scripts/common.sh@343 -- $ case "$op" in 00:01:15.027 15:45:04 -- scripts/common.sh@344 -- $ : 1 00:01:15.027 15:45:04 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:15.027 15:45:04 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:15.027 15:45:04 -- scripts/common.sh@364 -- $ decimal 23 00:01:15.027 15:45:04 -- scripts/common.sh@352 -- $ local d=23 00:01:15.027 15:45:04 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:15.027 15:45:04 -- scripts/common.sh@354 -- $ echo 23 00:01:15.027 15:45:04 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:15.027 15:45:04 -- scripts/common.sh@365 -- $ decimal 21 00:01:15.027 15:45:04 -- scripts/common.sh@352 -- $ local d=21 00:01:15.027 15:45:04 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:15.027 15:45:04 -- scripts/common.sh@354 -- $ echo 21 00:01:15.027 15:45:04 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:15.027 15:45:04 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:15.027 15:45:04 -- scripts/common.sh@366 -- $ return 1 00:01:15.027 15:45:04 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:15.027 patching file config/rte_config.h 00:01:15.027 Hunk #1 succeeded at 60 (offset 1 line). 00:01:15.027 15:45:04 -- common/autobuild_common.sh@176 -- $ lt 23.11.0 24.07.0 00:01:15.027 15:45:04 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 24.07.0 00:01:15.027 15:45:04 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:15.027 15:45:04 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:15.027 15:45:04 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:15.027 15:45:04 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:15.027 15:45:04 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:15.027 15:45:04 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:15.027 15:45:04 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:15.027 15:45:04 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:15.027 15:45:04 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:15.027 15:45:04 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:15.027 15:45:04 -- scripts/common.sh@343 -- $ case "$op" in 00:01:15.027 15:45:04 -- scripts/common.sh@344 -- $ : 1 00:01:15.027 15:45:04 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:15.027 15:45:04 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:15.027 15:45:04 -- scripts/common.sh@364 -- $ decimal 23 00:01:15.027 15:45:04 -- scripts/common.sh@352 -- $ local d=23 00:01:15.027 15:45:04 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:15.027 15:45:04 -- scripts/common.sh@354 -- $ echo 23 00:01:15.027 15:45:04 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:15.027 15:45:04 -- scripts/common.sh@365 -- $ decimal 24 00:01:15.027 15:45:04 -- scripts/common.sh@352 -- $ local d=24 00:01:15.027 15:45:04 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:15.027 15:45:04 -- scripts/common.sh@354 -- $ echo 24 00:01:15.027 15:45:04 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:15.027 15:45:04 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:15.027 15:45:04 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:15.027 15:45:04 -- scripts/common.sh@367 -- $ return 0 00:01:15.027 15:45:04 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:15.027 patching file lib/pcapng/rte_pcapng.c 00:01:15.027 15:45:04 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:15.027 15:45:04 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:15.027 15:45:04 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:15.027 15:45:04 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:15.027 15:45:04 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:19.226 The Meson build system 00:01:19.227 Version: 1.5.0 00:01:19.227 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:19.227 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:19.227 Build type: native build 00:01:19.227 Program cat found: YES (/usr/bin/cat) 00:01:19.227 Project name: DPDK 00:01:19.227 Project version: 23.11.0 00:01:19.227 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:19.227 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:19.227 Host machine cpu family: x86_64 00:01:19.227 Host machine cpu: x86_64 00:01:19.227 Message: ## Building in Developer Mode ## 00:01:19.227 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:19.227 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:19.227 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:19.227 Program python3 found: YES (/usr/bin/python3) 00:01:19.227 Program cat found: YES (/usr/bin/cat) 00:01:19.227 config/meson.build:113: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:19.227 Compiler for C supports arguments -march=native: YES 00:01:19.227 Checking for size of "void *" : 8 00:01:19.227 Checking for size of "void *" : 8 (cached) 00:01:19.227 Library m found: YES 00:01:19.227 Library numa found: YES 00:01:19.227 Has header "numaif.h" : YES 00:01:19.227 Library fdt found: NO 00:01:19.227 Library execinfo found: NO 00:01:19.227 Has header "execinfo.h" : YES 00:01:19.227 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:19.227 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:19.227 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:19.227 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:19.227 Run-time dependency openssl found: YES 3.1.1 00:01:19.227 Run-time dependency libpcap found: YES 1.10.4 00:01:19.227 Has header "pcap.h" with dependency libpcap: YES 00:01:19.227 Compiler for C supports arguments -Wcast-qual: YES 00:01:19.227 Compiler for C supports arguments -Wdeprecated: YES 00:01:19.227 Compiler for C supports arguments -Wformat: YES 00:01:19.227 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:19.227 Compiler for C supports arguments -Wformat-security: NO 00:01:19.227 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:19.227 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:19.227 Compiler for C supports arguments -Wnested-externs: YES 00:01:19.227 Compiler for C supports arguments -Wold-style-definition: YES 00:01:19.227 Compiler for C supports arguments -Wpointer-arith: YES 00:01:19.227 Compiler for C supports arguments -Wsign-compare: YES 00:01:19.227 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:19.227 Compiler for C supports arguments -Wundef: YES 00:01:19.227 Compiler for C supports arguments -Wwrite-strings: YES 00:01:19.227 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:19.227 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:19.227 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:19.227 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:19.227 Program objdump found: YES (/usr/bin/objdump) 00:01:19.227 Compiler for C supports arguments -mavx512f: YES 00:01:19.227 Checking if "AVX512 checking" compiles: YES 00:01:19.227 Fetching value of define "__SSE4_2__" : 1 00:01:19.227 Fetching value of define "__AES__" : 1 00:01:19.227 Fetching value of define "__AVX__" : 1 00:01:19.227 Fetching value of define "__AVX2__" : (undefined) 00:01:19.227 Fetching value of define "__AVX512BW__" : (undefined) 00:01:19.227 Fetching value of define "__AVX512CD__" : (undefined) 00:01:19.227 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:19.227 Fetching value of define "__AVX512F__" : (undefined) 00:01:19.227 Fetching value of define "__AVX512VL__" : (undefined) 00:01:19.227 Fetching value of define "__PCLMUL__" : 1 00:01:19.227 Fetching value of define "__RDRND__" : 1 00:01:19.227 Fetching value of define "__RDSEED__" : (undefined) 00:01:19.227 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:19.227 Fetching value of define "__znver1__" : (undefined) 00:01:19.227 Fetching value of define "__znver2__" : (undefined) 00:01:19.227 Fetching value of define "__znver3__" : (undefined) 00:01:19.227 Fetching value of define "__znver4__" : (undefined) 00:01:19.227 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:19.227 Message: lib/log: Defining dependency "log" 00:01:19.227 Message: lib/kvargs: Defining dependency "kvargs" 00:01:19.227 Message: lib/telemetry: Defining dependency "telemetry" 00:01:19.227 Checking for function "getentropy" : NO 00:01:19.227 Message: lib/eal: Defining dependency "eal" 00:01:19.227 Message: lib/ring: Defining dependency "ring" 00:01:19.227 Message: lib/rcu: Defining dependency "rcu" 00:01:19.227 Message: lib/mempool: Defining dependency "mempool" 00:01:19.227 Message: lib/mbuf: Defining dependency "mbuf" 00:01:19.227 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:19.227 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:19.227 Compiler for C supports arguments -mpclmul: YES 00:01:19.227 Compiler for C supports arguments -maes: YES 00:01:19.227 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:19.227 Compiler for C supports arguments -mavx512bw: YES 00:01:19.227 Compiler for C supports arguments -mavx512dq: YES 00:01:19.227 Compiler for C supports arguments -mavx512vl: YES 00:01:19.227 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:19.227 Compiler for C supports arguments -mavx2: YES 00:01:19.227 Compiler for C supports arguments -mavx: YES 00:01:19.227 Message: lib/net: Defining dependency "net" 00:01:19.227 Message: lib/meter: Defining dependency "meter" 00:01:19.227 Message: lib/ethdev: Defining dependency "ethdev" 00:01:19.227 Message: lib/pci: Defining dependency "pci" 00:01:19.227 Message: lib/cmdline: Defining dependency "cmdline" 00:01:19.227 Message: lib/metrics: Defining dependency "metrics" 00:01:19.227 Message: lib/hash: Defining dependency "hash" 00:01:19.227 Message: lib/timer: Defining dependency "timer" 00:01:19.227 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:19.227 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:19.227 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:19.227 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:19.227 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:19.227 Message: lib/acl: Defining dependency "acl" 00:01:19.227 Message: lib/bbdev: Defining dependency "bbdev" 00:01:19.227 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:19.227 Run-time dependency libelf found: YES 0.191 00:01:19.227 Message: lib/bpf: Defining dependency "bpf" 00:01:19.227 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:19.227 Message: lib/compressdev: Defining dependency "compressdev" 00:01:19.227 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:19.227 Message: lib/distributor: Defining dependency "distributor" 00:01:19.227 Message: lib/dmadev: Defining dependency "dmadev" 00:01:19.227 Message: lib/efd: Defining dependency "efd" 00:01:19.227 Message: lib/eventdev: Defining dependency "eventdev" 00:01:19.227 Message: lib/dispatcher: Defining dependency "dispatcher" 00:01:19.227 Message: lib/gpudev: Defining dependency "gpudev" 00:01:19.227 Message: lib/gro: Defining dependency "gro" 00:01:19.227 Message: lib/gso: Defining dependency "gso" 00:01:19.227 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:19.227 Message: lib/jobstats: Defining dependency "jobstats" 00:01:19.227 Message: lib/latencystats: Defining dependency "latencystats" 00:01:19.227 Message: lib/lpm: Defining dependency "lpm" 00:01:19.227 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:19.227 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:19.227 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:19.227 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:19.227 Message: lib/member: Defining dependency "member" 00:01:19.227 Message: lib/pcapng: Defining dependency "pcapng" 00:01:19.227 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:19.227 Message: lib/power: Defining dependency "power" 00:01:19.227 Message: lib/rawdev: Defining dependency "rawdev" 00:01:19.227 Message: lib/regexdev: Defining dependency "regexdev" 00:01:19.227 Message: lib/mldev: Defining dependency "mldev" 00:01:19.227 Message: lib/rib: Defining dependency "rib" 00:01:19.227 Message: lib/reorder: Defining dependency "reorder" 00:01:19.227 Message: lib/sched: Defining dependency "sched" 00:01:19.227 Message: lib/security: Defining dependency "security" 00:01:19.227 Message: lib/stack: Defining dependency "stack" 00:01:19.227 Has header "linux/userfaultfd.h" : YES 00:01:19.227 Has header "linux/vduse.h" : YES 00:01:19.227 Message: lib/vhost: Defining dependency "vhost" 00:01:19.227 Message: lib/ipsec: Defining dependency "ipsec" 00:01:19.227 Message: lib/pdcp: Defining dependency "pdcp" 00:01:19.227 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:19.227 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:19.227 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:19.227 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:19.227 Message: lib/fib: Defining dependency "fib" 00:01:19.227 Message: lib/port: Defining dependency "port" 00:01:19.227 Message: lib/pdump: Defining dependency "pdump" 00:01:19.227 Message: lib/table: Defining dependency "table" 00:01:19.227 Message: lib/pipeline: Defining dependency "pipeline" 00:01:19.227 Message: lib/graph: Defining dependency "graph" 00:01:19.227 Message: lib/node: Defining dependency "node" 00:01:21.142 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:21.142 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:21.142 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:21.142 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:21.142 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:21.142 Compiler for C supports arguments -Wno-unused-value: YES 00:01:21.142 Compiler for C supports arguments -Wno-format: YES 00:01:21.142 Compiler for C supports arguments -Wno-format-security: YES 00:01:21.142 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:21.142 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:21.142 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:21.142 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:21.142 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:21.142 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:21.142 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:21.142 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:21.142 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:21.142 Has header "sys/epoll.h" : YES 00:01:21.142 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:21.142 Configuring doxy-api-html.conf using configuration 00:01:21.142 Configuring doxy-api-man.conf using configuration 00:01:21.142 Program mandb found: YES (/usr/bin/mandb) 00:01:21.142 Program sphinx-build found: NO 00:01:21.142 Configuring rte_build_config.h using configuration 00:01:21.142 Message: 00:01:21.142 ================= 00:01:21.142 Applications Enabled 00:01:21.142 ================= 00:01:21.142 00:01:21.142 apps: 00:01:21.142 dumpcap, graph, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, 00:01:21.142 test-crypto-perf, test-dma-perf, test-eventdev, test-fib, test-flow-perf, test-gpudev, test-mldev, test-pipeline, 00:01:21.142 test-pmd, test-regex, test-sad, test-security-perf, 00:01:21.142 00:01:21.142 Message: 00:01:21.142 ================= 00:01:21.142 Libraries Enabled 00:01:21.142 ================= 00:01:21.142 00:01:21.142 libs: 00:01:21.142 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:21.142 net, meter, ethdev, pci, cmdline, metrics, hash, timer, 00:01:21.142 acl, bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, 00:01:21.142 dmadev, efd, eventdev, dispatcher, gpudev, gro, gso, ip_frag, 00:01:21.142 jobstats, latencystats, lpm, member, pcapng, power, rawdev, regexdev, 00:01:21.142 mldev, rib, reorder, sched, security, stack, vhost, ipsec, 00:01:21.142 pdcp, fib, port, pdump, table, pipeline, graph, node, 00:01:21.143 00:01:21.143 00:01:21.143 Message: 00:01:21.143 =============== 00:01:21.143 Drivers Enabled 00:01:21.143 =============== 00:01:21.143 00:01:21.143 common: 00:01:21.143 00:01:21.143 bus: 00:01:21.143 pci, vdev, 00:01:21.143 mempool: 00:01:21.143 ring, 00:01:21.143 dma: 00:01:21.143 00:01:21.143 net: 00:01:21.143 i40e, 00:01:21.143 raw: 00:01:21.143 00:01:21.143 crypto: 00:01:21.143 00:01:21.143 compress: 00:01:21.143 00:01:21.143 regex: 00:01:21.143 00:01:21.143 ml: 00:01:21.143 00:01:21.143 vdpa: 00:01:21.143 00:01:21.143 event: 00:01:21.143 00:01:21.143 baseband: 00:01:21.143 00:01:21.143 gpu: 00:01:21.143 00:01:21.143 00:01:21.143 Message: 00:01:21.143 ================= 00:01:21.143 Content Skipped 00:01:21.143 ================= 00:01:21.143 00:01:21.143 apps: 00:01:21.143 00:01:21.143 libs: 00:01:21.143 00:01:21.143 drivers: 00:01:21.143 common/cpt: not in enabled drivers build config 00:01:21.143 common/dpaax: not in enabled drivers build config 00:01:21.143 common/iavf: not in enabled drivers build config 00:01:21.143 common/idpf: not in enabled drivers build config 00:01:21.143 common/mvep: not in enabled drivers build config 00:01:21.143 common/octeontx: not in enabled drivers build config 00:01:21.143 bus/auxiliary: not in enabled drivers build config 00:01:21.143 bus/cdx: not in enabled drivers build config 00:01:21.143 bus/dpaa: not in enabled drivers build config 00:01:21.143 bus/fslmc: not in enabled drivers build config 00:01:21.143 bus/ifpga: not in enabled drivers build config 00:01:21.143 bus/platform: not in enabled drivers build config 00:01:21.143 bus/vmbus: not in enabled drivers build config 00:01:21.143 common/cnxk: not in enabled drivers build config 00:01:21.143 common/mlx5: not in enabled drivers build config 00:01:21.143 common/nfp: not in enabled drivers build config 00:01:21.143 common/qat: not in enabled drivers build config 00:01:21.143 common/sfc_efx: not in enabled drivers build config 00:01:21.143 mempool/bucket: not in enabled drivers build config 00:01:21.143 mempool/cnxk: not in enabled drivers build config 00:01:21.143 mempool/dpaa: not in enabled drivers build config 00:01:21.143 mempool/dpaa2: not in enabled drivers build config 00:01:21.143 mempool/octeontx: not in enabled drivers build config 00:01:21.143 mempool/stack: not in enabled drivers build config 00:01:21.143 dma/cnxk: not in enabled drivers build config 00:01:21.143 dma/dpaa: not in enabled drivers build config 00:01:21.143 dma/dpaa2: not in enabled drivers build config 00:01:21.143 dma/hisilicon: not in enabled drivers build config 00:01:21.143 dma/idxd: not in enabled drivers build config 00:01:21.143 dma/ioat: not in enabled drivers build config 00:01:21.143 dma/skeleton: not in enabled drivers build config 00:01:21.143 net/af_packet: not in enabled drivers build config 00:01:21.143 net/af_xdp: not in enabled drivers build config 00:01:21.143 net/ark: not in enabled drivers build config 00:01:21.143 net/atlantic: not in enabled drivers build config 00:01:21.143 net/avp: not in enabled drivers build config 00:01:21.143 net/axgbe: not in enabled drivers build config 00:01:21.143 net/bnx2x: not in enabled drivers build config 00:01:21.143 net/bnxt: not in enabled drivers build config 00:01:21.143 net/bonding: not in enabled drivers build config 00:01:21.143 net/cnxk: not in enabled drivers build config 00:01:21.143 net/cpfl: not in enabled drivers build config 00:01:21.143 net/cxgbe: not in enabled drivers build config 00:01:21.143 net/dpaa: not in enabled drivers build config 00:01:21.143 net/dpaa2: not in enabled drivers build config 00:01:21.143 net/e1000: not in enabled drivers build config 00:01:21.143 net/ena: not in enabled drivers build config 00:01:21.143 net/enetc: not in enabled drivers build config 00:01:21.143 net/enetfec: not in enabled drivers build config 00:01:21.143 net/enic: not in enabled drivers build config 00:01:21.143 net/failsafe: not in enabled drivers build config 00:01:21.143 net/fm10k: not in enabled drivers build config 00:01:21.143 net/gve: not in enabled drivers build config 00:01:21.143 net/hinic: not in enabled drivers build config 00:01:21.143 net/hns3: not in enabled drivers build config 00:01:21.143 net/iavf: not in enabled drivers build config 00:01:21.143 net/ice: not in enabled drivers build config 00:01:21.143 net/idpf: not in enabled drivers build config 00:01:21.143 net/igc: not in enabled drivers build config 00:01:21.143 net/ionic: not in enabled drivers build config 00:01:21.143 net/ipn3ke: not in enabled drivers build config 00:01:21.143 net/ixgbe: not in enabled drivers build config 00:01:21.143 net/mana: not in enabled drivers build config 00:01:21.143 net/memif: not in enabled drivers build config 00:01:21.143 net/mlx4: not in enabled drivers build config 00:01:21.143 net/mlx5: not in enabled drivers build config 00:01:21.143 net/mvneta: not in enabled drivers build config 00:01:21.143 net/mvpp2: not in enabled drivers build config 00:01:21.143 net/netvsc: not in enabled drivers build config 00:01:21.143 net/nfb: not in enabled drivers build config 00:01:21.143 net/nfp: not in enabled drivers build config 00:01:21.143 net/ngbe: not in enabled drivers build config 00:01:21.143 net/null: not in enabled drivers build config 00:01:21.143 net/octeontx: not in enabled drivers build config 00:01:21.143 net/octeon_ep: not in enabled drivers build config 00:01:21.143 net/pcap: not in enabled drivers build config 00:01:21.143 net/pfe: not in enabled drivers build config 00:01:21.143 net/qede: not in enabled drivers build config 00:01:21.143 net/ring: not in enabled drivers build config 00:01:21.143 net/sfc: not in enabled drivers build config 00:01:21.143 net/softnic: not in enabled drivers build config 00:01:21.143 net/tap: not in enabled drivers build config 00:01:21.143 net/thunderx: not in enabled drivers build config 00:01:21.143 net/txgbe: not in enabled drivers build config 00:01:21.143 net/vdev_netvsc: not in enabled drivers build config 00:01:21.143 net/vhost: not in enabled drivers build config 00:01:21.143 net/virtio: not in enabled drivers build config 00:01:21.143 net/vmxnet3: not in enabled drivers build config 00:01:21.143 raw/cnxk_bphy: not in enabled drivers build config 00:01:21.143 raw/cnxk_gpio: not in enabled drivers build config 00:01:21.143 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:21.143 raw/ifpga: not in enabled drivers build config 00:01:21.143 raw/ntb: not in enabled drivers build config 00:01:21.143 raw/skeleton: not in enabled drivers build config 00:01:21.143 crypto/armv8: not in enabled drivers build config 00:01:21.143 crypto/bcmfs: not in enabled drivers build config 00:01:21.143 crypto/caam_jr: not in enabled drivers build config 00:01:21.143 crypto/ccp: not in enabled drivers build config 00:01:21.143 crypto/cnxk: not in enabled drivers build config 00:01:21.143 crypto/dpaa_sec: not in enabled drivers build config 00:01:21.143 crypto/dpaa2_sec: not in enabled drivers build config 00:01:21.143 crypto/ipsec_mb: not in enabled drivers build config 00:01:21.143 crypto/mlx5: not in enabled drivers build config 00:01:21.143 crypto/mvsam: not in enabled drivers build config 00:01:21.143 crypto/nitrox: not in enabled drivers build config 00:01:21.143 crypto/null: not in enabled drivers build config 00:01:21.143 crypto/octeontx: not in enabled drivers build config 00:01:21.143 crypto/openssl: not in enabled drivers build config 00:01:21.143 crypto/scheduler: not in enabled drivers build config 00:01:21.143 crypto/uadk: not in enabled drivers build config 00:01:21.143 crypto/virtio: not in enabled drivers build config 00:01:21.143 compress/isal: not in enabled drivers build config 00:01:21.143 compress/mlx5: not in enabled drivers build config 00:01:21.143 compress/octeontx: not in enabled drivers build config 00:01:21.143 compress/zlib: not in enabled drivers build config 00:01:21.143 regex/mlx5: not in enabled drivers build config 00:01:21.143 regex/cn9k: not in enabled drivers build config 00:01:21.143 ml/cnxk: not in enabled drivers build config 00:01:21.143 vdpa/ifc: not in enabled drivers build config 00:01:21.143 vdpa/mlx5: not in enabled drivers build config 00:01:21.143 vdpa/nfp: not in enabled drivers build config 00:01:21.143 vdpa/sfc: not in enabled drivers build config 00:01:21.143 event/cnxk: not in enabled drivers build config 00:01:21.143 event/dlb2: not in enabled drivers build config 00:01:21.143 event/dpaa: not in enabled drivers build config 00:01:21.143 event/dpaa2: not in enabled drivers build config 00:01:21.143 event/dsw: not in enabled drivers build config 00:01:21.143 event/opdl: not in enabled drivers build config 00:01:21.143 event/skeleton: not in enabled drivers build config 00:01:21.143 event/sw: not in enabled drivers build config 00:01:21.143 event/octeontx: not in enabled drivers build config 00:01:21.143 baseband/acc: not in enabled drivers build config 00:01:21.143 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:21.143 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:21.143 baseband/la12xx: not in enabled drivers build config 00:01:21.143 baseband/null: not in enabled drivers build config 00:01:21.143 baseband/turbo_sw: not in enabled drivers build config 00:01:21.143 gpu/cuda: not in enabled drivers build config 00:01:21.143 00:01:21.143 00:01:21.143 Build targets in project: 220 00:01:21.143 00:01:21.143 DPDK 23.11.0 00:01:21.143 00:01:21.143 User defined options 00:01:21.143 libdir : lib 00:01:21.143 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:21.143 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:21.143 c_link_args : 00:01:21.143 enable_docs : false 00:01:21.143 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:21.143 enable_kmods : false 00:01:21.143 machine : native 00:01:21.143 tests : false 00:01:21.143 00:01:21.143 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:21.143 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:21.143 15:45:10 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:21.143 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:21.143 [1/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:21.143 [2/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:21.143 [3/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:21.143 [4/710] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:21.143 [5/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:21.143 [6/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:21.144 [7/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:21.144 [8/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:21.144 [9/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:21.144 [10/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:21.144 [11/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:21.407 [12/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:21.407 [13/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:21.407 [14/710] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:21.407 [15/710] Linking static target lib/librte_kvargs.a 00:01:21.407 [16/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:21.407 [17/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:21.407 [18/710] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:21.407 [19/710] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:21.407 [20/710] Linking static target lib/librte_log.a 00:01:21.668 [21/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:21.668 [22/710] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.248 [23/710] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.248 [24/710] Linking target lib/librte_log.so.24.0 00:01:22.248 [25/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:22.248 [26/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:22.248 [27/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:22.248 [28/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:22.248 [29/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:22.248 [30/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:22.248 [31/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:22.248 [32/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:22.248 [33/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:22.248 [34/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:22.248 [35/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:22.248 [36/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:22.248 [37/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:22.248 [38/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:22.248 [39/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:22.248 [40/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:22.248 [41/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:22.509 [42/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:22.509 [43/710] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:22.509 [44/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:22.510 [45/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:22.510 [46/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:22.510 [47/710] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:22.510 [48/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:22.510 [49/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:22.510 [50/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:22.510 [51/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:22.510 [52/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:22.510 [53/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:22.510 [54/710] Linking target lib/librte_kvargs.so.24.0 00:01:22.510 [55/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:22.510 [56/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:22.510 [57/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:22.510 [58/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:22.510 [59/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:22.510 [60/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:22.510 [61/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:22.510 [62/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:22.772 [63/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:22.772 [64/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:22.772 [65/710] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:22.772 [66/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:23.031 [67/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:23.031 [68/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:23.031 [69/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:23.031 [70/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:23.031 [71/710] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:23.031 [72/710] Linking static target lib/librte_pci.a 00:01:23.031 [73/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:23.031 [74/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:23.294 [75/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:23.294 [76/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:23.294 [77/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:23.294 [78/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:23.294 [79/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:23.294 [80/710] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:23.294 [81/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:23.294 [82/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:23.294 [83/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:23.294 [84/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:23.557 [85/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:23.557 [86/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:23.557 [87/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:23.557 [88/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:23.557 [89/710] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:23.557 [90/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:23.557 [91/710] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:23.557 [92/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:23.557 [93/710] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:23.557 [94/710] Linking static target lib/librte_ring.a 00:01:23.557 [95/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:23.557 [96/710] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:23.557 [97/710] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:23.557 [98/710] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:23.557 [99/710] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:23.557 [100/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:23.557 [101/710] Linking static target lib/librte_meter.a 00:01:23.819 [102/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:23.820 [103/710] Linking static target lib/librte_telemetry.a 00:01:23.820 [104/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:23.820 [105/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:23.820 [106/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:23.820 [107/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:23.820 [108/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:23.820 [109/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:23.820 [110/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:23.820 [111/710] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:24.083 [112/710] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:24.083 [113/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:24.083 [114/710] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.083 [115/710] Linking static target lib/librte_eal.a 00:01:24.083 [116/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:24.083 [117/710] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.083 [118/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:24.083 [119/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:24.083 [120/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:24.083 [121/710] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:24.343 [122/710] Linking static target lib/librte_net.a 00:01:24.343 [123/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:24.343 [124/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:24.343 [125/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:24.343 [126/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:24.343 [127/710] Linking static target lib/librte_cmdline.a 00:01:24.343 [128/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:24.343 [129/710] Linking static target lib/librte_mempool.a 00:01:24.343 [130/710] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.343 [131/710] Linking target lib/librte_telemetry.so.24.0 00:01:24.604 [132/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:24.604 [133/710] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:24.604 [134/710] Linking static target lib/librte_cfgfile.a 00:01:24.604 [135/710] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:24.604 [136/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:24.604 [137/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:24.604 [138/710] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:24.604 [139/710] Linking static target lib/librte_metrics.a 00:01:24.604 [140/710] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:24.869 [141/710] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:24.870 [142/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:24.870 [143/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:24.870 [144/710] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:25.130 [145/710] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:25.130 [146/710] Linking static target lib/librte_bitratestats.a 00:01:25.130 [147/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:25.130 [148/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:25.130 [149/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:25.130 [150/710] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:25.130 [151/710] Linking static target lib/librte_rcu.a 00:01:25.130 [152/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:25.130 [153/710] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.130 [154/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:25.130 [155/710] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:25.130 [156/710] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.393 [157/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:25.393 [158/710] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.393 [159/710] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:25.393 [160/710] Linking static target lib/librte_timer.a 00:01:25.393 [161/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:25.393 [162/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:25.393 [163/710] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.393 [164/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:25.393 [165/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:25.393 [166/710] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.661 [167/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:25.661 [168/710] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:25.661 [169/710] Linking static target lib/librte_bbdev.a 00:01:25.661 [170/710] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.661 [171/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:25.661 [172/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:25.926 [173/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:25.926 [174/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:25.926 [175/710] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.926 [176/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:25.926 [177/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:25.926 [178/710] Linking static target lib/librte_compressdev.a 00:01:25.926 [179/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:25.926 [180/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:26.186 [181/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:26.186 [182/710] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:26.450 [183/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:26.450 [184/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:26.450 [185/710] Linking static target lib/librte_distributor.a 00:01:26.450 [186/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:26.450 [187/710] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.710 [188/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:26.710 [189/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:26.710 [190/710] Linking static target lib/librte_dmadev.a 00:01:26.710 [191/710] Linking static target lib/librte_bpf.a 00:01:26.710 [192/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:26.710 [193/710] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:26.710 [194/710] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.710 [195/710] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.710 [196/710] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:26.710 [197/710] Compiling C object lib/librte_dispatcher.a.p/dispatcher_rte_dispatcher.c.o 00:01:26.710 [198/710] Linking static target lib/librte_dispatcher.a 00:01:26.971 [199/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:26.971 [200/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp6.c.o 00:01:26.971 [201/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:26.971 [202/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:26.971 [203/710] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:26.971 [204/710] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:26.971 [205/710] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:26.971 [206/710] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:26.971 [207/710] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:26.971 [208/710] Linking static target lib/librte_gpudev.a 00:01:26.971 [209/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:26.971 [210/710] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:26.971 [211/710] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:27.234 [212/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:27.234 [213/710] Linking static target lib/librte_gro.a 00:01:27.234 [214/710] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:27.234 [215/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:27.234 [216/710] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.234 [217/710] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:27.234 [218/710] Linking static target lib/librte_jobstats.a 00:01:27.234 [219/710] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:27.492 [220/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:27.492 [221/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_dma_adapter.c.o 00:01:27.492 [222/710] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.492 [223/710] Generating lib/dispatcher.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.755 [224/710] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.755 [225/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:27.755 [226/710] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:27.755 [227/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:27.755 [228/710] Linking static target lib/librte_latencystats.a 00:01:27.755 [229/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:27.755 [230/710] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:28.017 [231/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:28.017 [232/710] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:28.017 [233/710] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:28.017 [234/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:28.017 [235/710] Linking static target lib/librte_ip_frag.a 00:01:28.017 [236/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:28.017 [237/710] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:28.281 [238/710] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.281 [239/710] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:28.281 [240/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:28.281 [241/710] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:28.281 [242/710] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.281 [243/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev_pmd.c.o 00:01:28.281 [244/710] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:28.540 [245/710] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:28.540 [246/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:28.540 [247/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils.c.o 00:01:28.540 [248/710] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:28.540 [249/710] Linking static target lib/librte_gso.a 00:01:28.799 [250/710] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:28.799 [251/710] Linking static target lib/librte_regexdev.a 00:01:28.799 [252/710] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:28.799 [253/710] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:28.799 [254/710] Linking static target lib/librte_rawdev.a 00:01:28.799 [255/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:28.799 [256/710] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:28.799 [257/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar_bfloat16.c.o 00:01:28.799 [258/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev.c.o 00:01:28.799 [259/710] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.061 [260/710] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:29.061 [261/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar.c.o 00:01:29.061 [262/710] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:29.061 [263/710] Linking static target lib/librte_mldev.a 00:01:29.061 [264/710] Linking static target lib/librte_efd.a 00:01:29.061 [265/710] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:29.061 [266/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:29.061 [267/710] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:29.061 [268/710] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:29.061 [269/710] Linking static target lib/acl/libavx2_tmp.a 00:01:29.061 [270/710] Linking static target lib/librte_pcapng.a 00:01:29.325 [271/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:29.325 [272/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:29.325 [273/710] Linking static target lib/librte_stack.a 00:01:29.325 [274/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:29.325 [275/710] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:29.325 [276/710] Linking static target lib/librte_lpm.a 00:01:29.325 [277/710] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:29.325 [278/710] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:29.325 [279/710] Linking static target lib/librte_hash.a 00:01:29.325 [280/710] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.325 [281/710] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:29.325 [282/710] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:29.586 [283/710] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.586 [284/710] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:29.586 [285/710] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.586 [286/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:29.586 [287/710] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.586 [288/710] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:29.845 [289/710] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:29.845 [290/710] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:29.845 [291/710] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:29.845 [292/710] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.845 [293/710] Linking static target lib/librte_power.a 00:01:29.845 [294/710] Linking static target lib/librte_reorder.a 00:01:29.845 [295/710] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.845 [296/710] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:29.845 [297/710] Linking static target lib/acl/libavx512_tmp.a 00:01:29.845 [298/710] Linking static target lib/librte_acl.a 00:01:30.109 [299/710] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:30.109 [300/710] Linking static target lib/librte_security.a 00:01:30.109 [301/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:30.109 [302/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:30.109 [303/710] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:30.109 [304/710] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:30.109 [305/710] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.109 [306/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:30.109 [307/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:30.109 [308/710] Linking static target lib/librte_rib.a 00:01:30.109 [309/710] Linking static target lib/librte_mbuf.a 00:01:30.374 [310/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:30.374 [311/710] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.374 [312/710] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.374 [313/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_crypto.c.o 00:01:30.374 [314/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_ctrl_pdu.c.o 00:01:30.374 [315/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_reorder.c.o 00:01:30.374 [316/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_cnt.c.o 00:01:30.374 [317/710] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:30.636 [318/710] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.636 [319/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:30.636 [320/710] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:30.636 [321/710] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:30.636 [322/710] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:30.636 [323/710] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:30.636 [324/710] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:30.636 [325/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:30.636 [326/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:30.897 [327/710] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.897 [328/710] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.897 [329/710] Generating lib/mldev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:30.897 [330/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:31.158 [331/710] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.158 [332/710] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:31.159 [333/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:31.420 [334/710] Linking static target lib/librte_eventdev.a 00:01:31.420 [335/710] Compiling C object lib/librte_pdcp.a.p/pdcp_rte_pdcp.c.o 00:01:31.420 [336/710] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:31.420 [337/710] Linking static target lib/librte_member.a 00:01:31.420 [338/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:31.686 [339/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:31.686 [340/710] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:31.686 [341/710] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:31.686 [342/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:31.949 [343/710] Linking static target lib/librte_cryptodev.a 00:01:31.949 [344/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:31.949 [345/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:31.949 [346/710] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:31.949 [347/710] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:31.949 [348/710] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.949 [349/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:31.949 [350/710] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:31.949 [351/710] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:31.949 [352/710] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:31.949 [353/710] Linking static target lib/librte_sched.a 00:01:31.949 [354/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:31.949 [355/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:31.949 [356/710] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:31.949 [357/710] Linking static target lib/librte_fib.a 00:01:32.209 [358/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:32.209 [359/710] Linking static target lib/librte_ethdev.a 00:01:32.209 [360/710] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:32.209 [361/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:32.209 [362/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:32.209 [363/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:32.209 [364/710] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:32.209 [365/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:32.476 [366/710] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:32.476 [367/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:32.476 [368/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:32.476 [369/710] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:32.735 [370/710] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.735 [371/710] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.735 [372/710] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:32.735 [373/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:32.997 [374/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:32.997 [375/710] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:32.997 [376/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:32.997 [377/710] Linking static target lib/librte_pdump.a 00:01:32.997 [378/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:33.263 [379/710] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:33.263 [380/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_worker.c.o 00:01:33.263 [381/710] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:33.263 [382/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:33.263 [383/710] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:33.263 [384/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:33.263 [385/710] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:33.263 [386/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:33.263 [387/710] Compiling C object lib/librte_graph.a.p/graph_graph_pcap.c.o 00:01:33.263 [388/710] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:33.263 [389/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:33.263 [390/710] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.528 [391/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:33.528 [392/710] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:33.528 [393/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:33.528 [394/710] Linking static target lib/librte_ipsec.a 00:01:33.528 [395/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:33.528 [396/710] Linking static target lib/librte_table.a 00:01:33.793 [397/710] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.793 [398/710] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:33.793 [399/710] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:33.793 [400/710] Compiling C object lib/librte_node.a.p/node_kernel_tx.c.o 00:01:34.054 [401/710] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.054 [402/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:34.322 [403/710] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.322 [404/710] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:34.322 [405/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:34.322 [406/710] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:34.587 [407/710] Linking target lib/librte_eal.so.24.0 00:01:34.587 [408/710] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:34.587 [409/710] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.587 [410/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:34.587 [411/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:34.587 [412/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:34.587 [413/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:34.587 [414/710] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:34.848 [415/710] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.848 [416/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:34.848 [417/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ipsec.c.o 00:01:34.848 [418/710] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:34.848 [419/710] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:34.848 [420/710] Linking target lib/librte_ring.so.24.0 00:01:34.848 [421/710] Linking target lib/librte_meter.so.24.0 00:01:34.848 [422/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:35.109 [423/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:35.109 [424/710] Linking target lib/librte_pci.so.24.0 00:01:35.109 [425/710] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:35.109 [426/710] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:35.109 [427/710] Linking target lib/librte_timer.so.24.0 00:01:35.109 [428/710] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:35.109 [429/710] Linking target lib/librte_rcu.so.24.0 00:01:35.109 [430/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:35.109 [431/710] Linking target lib/librte_acl.so.24.0 00:01:35.109 [432/710] Linking target lib/librte_mempool.so.24.0 00:01:35.109 [433/710] Linking target lib/librte_cfgfile.so.24.0 00:01:35.380 [434/710] Linking target lib/librte_dmadev.so.24.0 00:01:35.380 [435/710] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:35.380 [436/710] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:35.380 [437/710] Linking target lib/librte_jobstats.so.24.0 00:01:35.380 [438/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:35.380 [439/710] Generating symbol file lib/librte_acl.so.24.0.p/librte_acl.so.24.0.symbols 00:01:35.380 [440/710] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:35.380 [441/710] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:35.380 [442/710] Linking static target lib/librte_port.a 00:01:35.380 [443/710] Linking target lib/librte_rawdev.so.24.0 00:01:35.380 [444/710] Linking target lib/librte_stack.so.24.0 00:01:35.380 [445/710] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:35.380 [446/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_model_mcore_dispatch.c.o 00:01:35.380 [447/710] Compiling C object lib/librte_node.a.p/node_ip4_reassembly.c.o 00:01:35.380 [448/710] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:35.380 [449/710] Linking target lib/librte_mbuf.so.24.0 00:01:35.642 [450/710] Linking static target lib/librte_graph.a 00:01:35.642 [451/710] Linking target lib/librte_rib.so.24.0 00:01:35.642 [452/710] Compiling C object lib/librte_node.a.p/node_kernel_rx.c.o 00:01:35.642 [453/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:35.642 [454/710] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:35.642 [455/710] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:35.642 [456/710] Generating symbol file lib/librte_rib.so.24.0.p/librte_rib.so.24.0.symbols 00:01:35.905 [457/710] Linking target lib/librte_net.so.24.0 00:01:35.905 [458/710] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:35.905 [459/710] Linking target lib/librte_bbdev.so.24.0 00:01:35.905 [460/710] Compiling C object app/dpdk-graph.p/graph_cli.c.o 00:01:35.905 [461/710] Linking target lib/librte_compressdev.so.24.0 00:01:35.905 [462/710] Linking target lib/librte_cryptodev.so.24.0 00:01:35.905 [463/710] Linking target lib/librte_distributor.so.24.0 00:01:35.905 [464/710] Linking target lib/librte_regexdev.so.24.0 00:01:35.905 [465/710] Linking target lib/librte_gpudev.so.24.0 00:01:35.905 [466/710] Compiling C object app/dpdk-graph.p/graph_conn.c.o 00:01:35.905 [467/710] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:35.905 [468/710] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:35.905 [469/710] Linking target lib/librte_reorder.so.24.0 00:01:35.905 [470/710] Linking static target drivers/librte_bus_pci.a 00:01:35.905 [471/710] Linking target lib/librte_mldev.so.24.0 00:01:35.905 [472/710] Linking target lib/librte_sched.so.24.0 00:01:35.905 [473/710] Compiling C object app/dpdk-graph.p/graph_ethdev_rx.c.o 00:01:35.905 [474/710] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:35.905 [475/710] Linking target lib/librte_fib.so.24.0 00:01:35.905 [476/710] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:35.905 [477/710] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:36.163 [478/710] Linking static target drivers/librte_bus_vdev.a 00:01:36.163 [479/710] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:36.163 [480/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:36.163 [481/710] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:36.163 [482/710] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:36.163 [483/710] Linking target lib/librte_cmdline.so.24.0 00:01:36.163 [484/710] Linking target lib/librte_hash.so.24.0 00:01:36.163 [485/710] Linking target lib/librte_security.so.24.0 00:01:36.163 [486/710] Generating symbol file lib/librte_reorder.so.24.0.p/librte_reorder.so.24.0.symbols 00:01:36.163 [487/710] Generating symbol file lib/librte_sched.so.24.0.p/librte_sched.so.24.0.symbols 00:01:36.163 [488/710] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.430 [489/710] Compiling C object app/dpdk-graph.p/graph_graph.c.o 00:01:36.430 [490/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:36.430 [491/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:36.430 [492/710] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:36.430 [493/710] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:36.430 [494/710] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.430 [495/710] Linking static target drivers/librte_mempool_ring.a 00:01:36.430 [496/710] Generating symbol file lib/librte_security.so.24.0.p/librte_security.so.24.0.symbols 00:01:36.430 [497/710] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:36.430 [498/710] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:36.430 [499/710] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.430 [500/710] Compiling C object app/dpdk-graph.p/graph_ethdev.c.o 00:01:36.430 [501/710] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:36.430 [502/710] Linking target drivers/librte_bus_vdev.so.24.0 00:01:36.430 [503/710] Linking target lib/librte_lpm.so.24.0 00:01:36.430 [504/710] Linking target lib/librte_efd.so.24.0 00:01:36.694 [505/710] Linking target lib/librte_member.so.24.0 00:01:36.694 [506/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_recycle_mbufs_vec_common.c.o 00:01:36.694 [507/710] Linking target drivers/librte_mempool_ring.so.24.0 00:01:36.694 [508/710] Linking target lib/librte_ipsec.so.24.0 00:01:36.694 [509/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:36.694 [510/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:36.694 [511/710] Compiling C object app/dpdk-graph.p/graph_ip4_route.c.o 00:01:36.694 [512/710] Compiling C object app/dpdk-graph.p/graph_ip6_route.c.o 00:01:36.694 [513/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:36.694 [514/710] Compiling C object lib/librte_node.a.p/node_ip4_local.c.o 00:01:36.694 [515/710] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.694 [516/710] Generating symbol file drivers/librte_bus_vdev.so.24.0.p/librte_bus_vdev.so.24.0.symbols 00:01:36.694 [517/710] Generating symbol file lib/librte_lpm.so.24.0.p/librte_lpm.so.24.0.symbols 00:01:36.694 [518/710] Generating symbol file lib/librte_ipsec.so.24.0.p/librte_ipsec.so.24.0.symbols 00:01:36.952 [519/710] Linking target drivers/librte_bus_pci.so.24.0 00:01:36.952 [520/710] Compiling C object app/dpdk-graph.p/graph_main.c.o 00:01:36.952 [521/710] Compiling C object app/dpdk-graph.p/graph_l3fwd.c.o 00:01:36.952 [522/710] Compiling C object app/dpdk-graph.p/graph_mempool.c.o 00:01:36.952 [523/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:36.952 [524/710] Generating symbol file drivers/librte_bus_pci.so.24.0.p/librte_bus_pci.so.24.0.symbols 00:01:37.525 [525/710] Compiling C object app/dpdk-graph.p/graph_utils.c.o 00:01:37.525 [526/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:37.525 [527/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:37.794 [528/710] Compiling C object app/dpdk-graph.p/graph_neigh.c.o 00:01:37.794 [529/710] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:37.794 [530/710] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:37.794 [531/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:37.794 [532/710] Compiling C object lib/librte_node.a.p/node_udp4_input.c.o 00:01:38.087 [533/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:38.087 [534/710] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:38.087 [535/710] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:38.087 [536/710] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:38.087 [537/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:38.087 [538/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:38.087 [539/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:38.087 [540/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:38.370 [541/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:38.370 [542/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:38.370 [543/710] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:38.645 [544/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:38.645 [545/710] Compiling C object lib/librte_node.a.p/node_ip6_lookup.c.o 00:01:38.645 [546/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:38.645 [547/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:38.645 [548/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:38.645 [549/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:38.645 [550/710] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:38.645 [551/710] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:38.904 [552/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:38.904 [553/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_main.c.o 00:01:38.904 [554/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_test.c.o 00:01:39.166 [555/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:39.166 [556/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_parser.c.o 00:01:39.166 [557/710] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:39.166 [558/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:39.166 [559/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:39.737 [560/710] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.737 [561/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:39.737 [562/710] Linking target lib/librte_ethdev.so.24.0 00:01:39.737 [563/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:40.001 [564/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_main.c.o 00:01:40.001 [565/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:40.002 [566/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:40.002 [567/710] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:40.002 [568/710] Linking target lib/librte_metrics.so.24.0 00:01:40.002 [569/710] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:40.266 [570/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_device_ops.c.o 00:01:40.266 [571/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_options.c.o 00:01:40.266 [572/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:40.266 [573/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:40.266 [574/710] Linking target lib/librte_bpf.so.24.0 00:01:40.266 [575/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:40.266 [576/710] Linking target lib/librte_gro.so.24.0 00:01:40.266 [577/710] Linking target lib/librte_eventdev.so.24.0 00:01:40.266 [578/710] Linking target lib/librte_gso.so.24.0 00:01:40.266 [579/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_common.c.o 00:01:40.266 [580/710] Linking target lib/librte_ip_frag.so.24.0 00:01:40.266 [581/710] Generating symbol file lib/librte_metrics.so.24.0.p/librte_metrics.so.24.0.symbols 00:01:40.266 [582/710] Linking target lib/librte_pcapng.so.24.0 00:01:40.266 [583/710] Linking target lib/librte_power.so.24.0 00:01:40.266 [584/710] Linking target lib/librte_bitratestats.so.24.0 00:01:40.531 [585/710] Linking target lib/librte_latencystats.so.24.0 00:01:40.531 [586/710] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:40.531 [587/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:40.531 [588/710] Generating symbol file lib/librte_bpf.so.24.0.p/librte_bpf.so.24.0.symbols 00:01:40.531 [589/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_interleave.c.o 00:01:40.531 [590/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_ops.c.o 00:01:40.531 [591/710] Generating symbol file lib/librte_eventdev.so.24.0.p/librte_eventdev.so.24.0.symbols 00:01:40.532 [592/710] Generating symbol file lib/librte_ip_frag.so.24.0.p/librte_ip_frag.so.24.0.symbols 00:01:40.532 [593/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_ordered.c.o 00:01:40.532 [594/710] Generating symbol file lib/librte_pcapng.so.24.0.p/librte_pcapng.so.24.0.symbols 00:01:40.532 [595/710] Linking target lib/librte_dispatcher.so.24.0 00:01:40.532 [596/710] Linking target lib/librte_pdump.so.24.0 00:01:40.791 [597/710] Linking target lib/librte_port.so.24.0 00:01:40.791 [598/710] Linking target lib/librte_graph.so.24.0 00:01:40.791 [599/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:40.791 [600/710] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:40.791 [601/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_benchmark.c.o 00:01:40.791 [602/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:40.791 [603/710] Generating symbol file lib/librte_port.so.24.0.p/librte_port.so.24.0.symbols 00:01:40.791 [604/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_stats.c.o 00:01:41.050 [605/710] Generating symbol file lib/librte_graph.so.24.0.p/librte_graph.so.24.0.symbols 00:01:41.050 [606/710] Linking target lib/librte_table.so.24.0 00:01:41.050 [607/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_common.c.o 00:01:41.050 [608/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:41.050 [609/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_process.c.o 00:01:41.050 [610/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:41.312 [611/710] Linking static target lib/librte_pdcp.a 00:01:41.312 [612/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:41.312 [613/710] Generating symbol file lib/librte_table.so.24.0.p/librte_table.so.24.0.symbols 00:01:41.312 [614/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:41.312 [615/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:41.312 [616/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:41.578 [617/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:41.578 [618/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:41.578 [619/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:41.578 [620/710] Generating lib/pdcp.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.843 [621/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:41.843 [622/710] Linking target lib/librte_pdcp.so.24.0 00:01:41.843 [623/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:41.843 [624/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:01:41.843 [625/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:41.843 [626/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_cman.c.o 00:01:41.843 [627/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:42.104 [628/710] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:42.104 [629/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:42.104 [630/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:01:42.368 [631/710] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:01:42.627 [632/710] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:01:42.627 [633/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:42.627 [634/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:42.627 [635/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:01:42.627 [636/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:01:42.627 [637/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:42.627 [638/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:42.627 [639/710] Compiling C object app/dpdk-testpmd.p/test-pmd_recycle_mbufs.c.o 00:01:42.627 [640/710] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:01:42.627 [641/710] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:01:42.886 [642/710] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:42.886 [643/710] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:01:42.886 [644/710] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:43.145 [645/710] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:43.404 [646/710] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:01:43.404 [647/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:43.404 [648/710] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:43.404 [649/710] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:01:43.404 [650/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:43.663 [651/710] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:01:43.663 [652/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:01:43.663 [653/710] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:01:43.663 [654/710] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:01:43.922 [655/710] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:01:43.922 [656/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:01:43.922 [657/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:01:43.922 [658/710] Linking static target drivers/libtmp_rte_net_i40e.a 00:01:43.922 [659/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:01:44.181 [660/710] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:01:44.440 [661/710] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:44.440 [662/710] Compiling C object drivers/librte_net_i40e.so.24.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:44.440 [663/710] Linking static target drivers/librte_net_i40e.a 00:01:44.440 [664/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:01:44.699 [665/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:01:44.699 [666/710] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:01:44.699 [667/710] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:01:44.699 [668/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:01:44.958 [669/710] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.958 [670/710] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:01:44.958 [671/710] Linking target drivers/librte_net_i40e.so.24.0 00:01:45.526 [672/710] Compiling C object lib/librte_node.a.p/node_ip6_rewrite.c.o 00:01:45.526 [673/710] Linking static target lib/librte_node.a 00:01:45.526 [674/710] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:01:45.785 [675/710] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.785 [676/710] Linking target lib/librte_node.so.24.0 00:01:47.161 [677/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_common.c.o 00:01:47.161 [678/710] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:01:47.419 [679/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:01:48.794 [680/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:01:49.052 [681/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:01:55.613 [682/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:27.685 [683/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:27.685 [684/710] Linking static target lib/librte_vhost.a 00:02:27.685 [685/710] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:27.685 [686/710] Linking target lib/librte_vhost.so.24.0 00:02:37.690 [687/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:37.690 [688/710] Linking static target lib/librte_pipeline.a 00:02:37.690 [689/710] Linking target app/dpdk-dumpcap 00:02:37.690 [690/710] Linking target app/dpdk-test-cmdline 00:02:37.690 [691/710] Linking target app/dpdk-test-acl 00:02:37.690 [692/710] Linking target app/dpdk-test-regex 00:02:37.690 [693/710] Linking target app/dpdk-test-gpudev 00:02:37.690 [694/710] Linking target app/dpdk-pdump 00:02:37.690 [695/710] Linking target app/dpdk-test-security-perf 00:02:37.690 [696/710] Linking target app/dpdk-test-flow-perf 00:02:37.690 [697/710] Linking target app/dpdk-proc-info 00:02:37.690 [698/710] Linking target app/dpdk-test-sad 00:02:37.690 [699/710] Linking target app/dpdk-test-compress-perf 00:02:37.690 [700/710] Linking target app/dpdk-test-crypto-perf 00:02:37.690 [701/710] Linking target app/dpdk-test-pipeline 00:02:37.690 [702/710] Linking target app/dpdk-test-dma-perf 00:02:37.690 [703/710] Linking target app/dpdk-test-fib 00:02:37.690 [704/710] Linking target app/dpdk-graph 00:02:37.690 [705/710] Linking target app/dpdk-test-eventdev 00:02:37.690 [706/710] Linking target app/dpdk-test-mldev 00:02:37.690 [707/710] Linking target app/dpdk-test-bbdev 00:02:37.690 [708/710] Linking target app/dpdk-testpmd 00:02:39.068 [709/710] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:39.068 [710/710] Linking target lib/librte_pipeline.so.24.0 00:02:39.068 15:46:28 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:39.068 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:39.068 [0/1] Installing files. 00:02:39.330 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.330 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:39.331 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:39.332 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.333 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.599 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.600 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec_sa.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:39.601 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:39.601 Installing lib/librte_log.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.601 Installing lib/librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_dispatcher.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_mldev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:39.602 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_pdcp.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing lib/librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing drivers/librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:40.313 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing drivers/librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:40.313 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing drivers/librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:40.313 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.313 Installing drivers/librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:40.313 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-graph to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-dma-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-mldev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.313 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.313 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/log/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.313 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.313 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.313 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:40.313 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:40.313 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:40.313 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lock_annotations.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_stdatomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.314 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_dtls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_pdcp_hdr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.315 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_dma_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dispatcher/rte_dispatcher.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.316 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_mcore_dispatch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_rtc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip6_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_udp4_input_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/dpdk-cmdline-gen.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-rss-flows.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:40.317 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:40.317 Installing symlink pointing to librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so.24 00:02:40.317 Installing symlink pointing to librte_log.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so 00:02:40.317 Installing symlink pointing to librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.24 00:02:40.317 Installing symlink pointing to librte_kvargs.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:40.317 Installing symlink pointing to librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.24 00:02:40.317 Installing symlink pointing to librte_telemetry.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:40.317 Installing symlink pointing to librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.24 00:02:40.317 Installing symlink pointing to librte_eal.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:40.317 Installing symlink pointing to librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.24 00:02:40.317 Installing symlink pointing to librte_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:40.317 Installing symlink pointing to librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.24 00:02:40.317 Installing symlink pointing to librte_rcu.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:40.317 Installing symlink pointing to librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.24 00:02:40.317 Installing symlink pointing to librte_mempool.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:40.317 Installing symlink pointing to librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.24 00:02:40.317 Installing symlink pointing to librte_mbuf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:40.317 Installing symlink pointing to librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.24 00:02:40.317 Installing symlink pointing to librte_net.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:40.317 Installing symlink pointing to librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.24 00:02:40.317 Installing symlink pointing to librte_meter.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:40.317 Installing symlink pointing to librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.24 00:02:40.317 Installing symlink pointing to librte_ethdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:40.317 Installing symlink pointing to librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.24 00:02:40.317 Installing symlink pointing to librte_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:40.318 Installing symlink pointing to librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.24 00:02:40.318 Installing symlink pointing to librte_cmdline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:40.318 Installing symlink pointing to librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.24 00:02:40.318 Installing symlink pointing to librte_metrics.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:40.318 Installing symlink pointing to librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.24 00:02:40.318 Installing symlink pointing to librte_hash.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:40.318 Installing symlink pointing to librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.24 00:02:40.318 Installing symlink pointing to librte_timer.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:40.318 Installing symlink pointing to librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.24 00:02:40.318 Installing symlink pointing to librte_acl.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:40.318 Installing symlink pointing to librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.24 00:02:40.318 Installing symlink pointing to librte_bbdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:40.318 Installing symlink pointing to librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.24 00:02:40.318 Installing symlink pointing to librte_bitratestats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:40.318 Installing symlink pointing to librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.24 00:02:40.318 Installing symlink pointing to librte_bpf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:40.318 Installing symlink pointing to librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.24 00:02:40.318 Installing symlink pointing to librte_cfgfile.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:40.318 Installing symlink pointing to librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.24 00:02:40.318 Installing symlink pointing to librte_compressdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:40.318 Installing symlink pointing to librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.24 00:02:40.318 Installing symlink pointing to librte_cryptodev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:40.318 Installing symlink pointing to librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.24 00:02:40.318 Installing symlink pointing to librte_distributor.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:40.318 Installing symlink pointing to librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.24 00:02:40.318 Installing symlink pointing to librte_dmadev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:40.318 Installing symlink pointing to librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.24 00:02:40.318 Installing symlink pointing to librte_efd.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:40.318 Installing symlink pointing to librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.24 00:02:40.318 Installing symlink pointing to librte_eventdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:40.318 Installing symlink pointing to librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so.24 00:02:40.318 Installing symlink pointing to librte_dispatcher.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so 00:02:40.318 Installing symlink pointing to librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.24 00:02:40.318 Installing symlink pointing to librte_gpudev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:40.318 Installing symlink pointing to librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.24 00:02:40.318 Installing symlink pointing to librte_gro.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:40.318 Installing symlink pointing to librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.24 00:02:40.318 Installing symlink pointing to librte_gso.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:40.318 Installing symlink pointing to librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.24 00:02:40.318 Installing symlink pointing to librte_ip_frag.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:40.318 Installing symlink pointing to librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.24 00:02:40.318 Installing symlink pointing to librte_jobstats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:40.318 Installing symlink pointing to librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.24 00:02:40.318 Installing symlink pointing to librte_latencystats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:40.318 Installing symlink pointing to librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.24 00:02:40.318 Installing symlink pointing to librte_lpm.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:40.318 Installing symlink pointing to librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.24 00:02:40.318 Installing symlink pointing to librte_member.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:40.318 Installing symlink pointing to librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.24 00:02:40.318 Installing symlink pointing to librte_pcapng.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:40.318 Installing symlink pointing to librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.24 00:02:40.318 Installing symlink pointing to librte_power.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:40.318 './librte_bus_pci.so' -> 'dpdk/pmds-24.0/librte_bus_pci.so' 00:02:40.318 './librte_bus_pci.so.24' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24' 00:02:40.318 './librte_bus_pci.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24.0' 00:02:40.318 './librte_bus_vdev.so' -> 'dpdk/pmds-24.0/librte_bus_vdev.so' 00:02:40.318 './librte_bus_vdev.so.24' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24' 00:02:40.318 './librte_bus_vdev.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24.0' 00:02:40.318 './librte_mempool_ring.so' -> 'dpdk/pmds-24.0/librte_mempool_ring.so' 00:02:40.318 './librte_mempool_ring.so.24' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24' 00:02:40.318 './librte_mempool_ring.so.24.0' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24.0' 00:02:40.318 './librte_net_i40e.so' -> 'dpdk/pmds-24.0/librte_net_i40e.so' 00:02:40.318 './librte_net_i40e.so.24' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24' 00:02:40.318 './librte_net_i40e.so.24.0' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24.0' 00:02:40.318 Installing symlink pointing to librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.24 00:02:40.318 Installing symlink pointing to librte_rawdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:40.318 Installing symlink pointing to librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.24 00:02:40.318 Installing symlink pointing to librte_regexdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:40.318 Installing symlink pointing to librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so.24 00:02:40.318 Installing symlink pointing to librte_mldev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so 00:02:40.318 Installing symlink pointing to librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.24 00:02:40.318 Installing symlink pointing to librte_rib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:40.318 Installing symlink pointing to librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.24 00:02:40.318 Installing symlink pointing to librte_reorder.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:40.318 Installing symlink pointing to librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.24 00:02:40.318 Installing symlink pointing to librte_sched.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:40.318 Installing symlink pointing to librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.24 00:02:40.318 Installing symlink pointing to librte_security.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:40.318 Installing symlink pointing to librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.24 00:02:40.318 Installing symlink pointing to librte_stack.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:40.318 Installing symlink pointing to librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.24 00:02:40.318 Installing symlink pointing to librte_vhost.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:40.318 Installing symlink pointing to librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.24 00:02:40.318 Installing symlink pointing to librte_ipsec.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:40.318 Installing symlink pointing to librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so.24 00:02:40.318 Installing symlink pointing to librte_pdcp.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so 00:02:40.318 Installing symlink pointing to librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.24 00:02:40.318 Installing symlink pointing to librte_fib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:40.318 Installing symlink pointing to librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.24 00:02:40.318 Installing symlink pointing to librte_port.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:40.318 Installing symlink pointing to librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.24 00:02:40.318 Installing symlink pointing to librte_pdump.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:40.318 Installing symlink pointing to librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.24 00:02:40.318 Installing symlink pointing to librte_table.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:40.318 Installing symlink pointing to librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.24 00:02:40.318 Installing symlink pointing to librte_pipeline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:40.318 Installing symlink pointing to librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.24 00:02:40.318 Installing symlink pointing to librte_graph.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:40.318 Installing symlink pointing to librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.24 00:02:40.318 Installing symlink pointing to librte_node.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:40.318 Installing symlink pointing to librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24 00:02:40.318 Installing symlink pointing to librte_bus_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:02:40.319 Installing symlink pointing to librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24 00:02:40.319 Installing symlink pointing to librte_bus_vdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:02:40.319 Installing symlink pointing to librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24 00:02:40.319 Installing symlink pointing to librte_mempool_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:02:40.319 Installing symlink pointing to librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24 00:02:40.319 Installing symlink pointing to librte_net_i40e.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:02:40.319 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-24.0' 00:02:40.319 15:46:30 -- common/autobuild_common.sh@192 -- $ uname -s 00:02:40.319 15:46:30 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:40.319 15:46:30 -- common/autobuild_common.sh@203 -- $ cat 00:02:40.319 15:46:30 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:40.319 00:02:40.319 real 1m25.412s 00:02:40.319 user 17m59.575s 00:02:40.319 sys 2m8.930s 00:02:40.319 15:46:30 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:02:40.319 15:46:30 -- common/autotest_common.sh@10 -- $ set +x 00:02:40.319 ************************************ 00:02:40.319 END TEST build_native_dpdk 00:02:40.319 ************************************ 00:02:40.319 15:46:30 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:40.319 15:46:30 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:40.319 15:46:30 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:40.319 15:46:30 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:40.319 15:46:30 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:40.319 15:46:30 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:40.319 15:46:30 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:40.319 15:46:30 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:40.319 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:40.576 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:40.576 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:40.576 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:40.834 Using 'verbs' RDMA provider 00:02:51.083 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:03:01.076 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:03:01.076 Creating mk/config.mk...done. 00:03:01.076 Creating mk/cc.flags.mk...done. 00:03:01.076 Type 'make' to build. 00:03:01.076 15:46:49 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:03:01.076 15:46:49 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:03:01.076 15:46:49 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:03:01.076 15:46:49 -- common/autotest_common.sh@10 -- $ set +x 00:03:01.076 ************************************ 00:03:01.076 START TEST make 00:03:01.076 ************************************ 00:03:01.076 15:46:49 -- common/autotest_common.sh@1104 -- $ make -j48 00:03:01.076 make[1]: Nothing to be done for 'all'. 00:03:02.024 The Meson build system 00:03:02.024 Version: 1.5.0 00:03:02.024 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:02.024 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:02.024 Build type: native build 00:03:02.024 Project name: libvfio-user 00:03:02.024 Project version: 0.0.1 00:03:02.024 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:03:02.024 C linker for the host machine: gcc ld.bfd 2.40-14 00:03:02.024 Host machine cpu family: x86_64 00:03:02.024 Host machine cpu: x86_64 00:03:02.024 Run-time dependency threads found: YES 00:03:02.024 Library dl found: YES 00:03:02.024 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:03:02.024 Run-time dependency json-c found: YES 0.17 00:03:02.024 Run-time dependency cmocka found: YES 1.1.7 00:03:02.024 Program pytest-3 found: NO 00:03:02.024 Program flake8 found: NO 00:03:02.024 Program misspell-fixer found: NO 00:03:02.024 Program restructuredtext-lint found: NO 00:03:02.024 Program valgrind found: YES (/usr/bin/valgrind) 00:03:02.024 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:02.024 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:02.024 Compiler for C supports arguments -Wwrite-strings: YES 00:03:02.024 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:02.024 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:02.024 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:02.024 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:02.024 Build targets in project: 8 00:03:02.024 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:02.024 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:02.024 00:03:02.024 libvfio-user 0.0.1 00:03:02.024 00:03:02.024 User defined options 00:03:02.024 buildtype : debug 00:03:02.024 default_library: shared 00:03:02.024 libdir : /usr/local/lib 00:03:02.024 00:03:02.024 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:02.599 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:02.868 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:02.868 [2/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:02.868 [3/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:02.868 [4/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:02.868 [5/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:02.868 [6/37] Compiling C object samples/null.p/null.c.o 00:03:03.132 [7/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:03.132 [8/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:03.132 [9/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:03.132 [10/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:03.132 [11/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:03.132 [12/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:03.132 [13/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:03.132 [14/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:03.132 [15/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:03.132 [16/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:03.132 [17/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:03.132 [18/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:03.132 [19/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:03.132 [20/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:03.132 [21/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:03.132 [22/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:03.132 [23/37] Compiling C object samples/server.p/server.c.o 00:03:03.132 [24/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:03.132 [25/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:03.132 [26/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:03.132 [27/37] Compiling C object samples/client.p/client.c.o 00:03:03.132 [28/37] Linking target lib/libvfio-user.so.0.0.1 00:03:03.393 [29/37] Linking target samples/client 00:03:03.393 [30/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:03.393 [31/37] Linking target test/unit_tests 00:03:03.393 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:03.656 [33/37] Linking target samples/server 00:03:03.656 [34/37] Linking target samples/null 00:03:03.656 [35/37] Linking target samples/shadow_ioeventfd_server 00:03:03.656 [36/37] Linking target samples/lspci 00:03:03.656 [37/37] Linking target samples/gpio-pci-idio-16 00:03:03.656 INFO: autodetecting backend as ninja 00:03:03.656 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:03.656 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:04.596 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:04.596 ninja: no work to do. 00:03:16.807 CC lib/log/log.o 00:03:16.807 CC lib/log/log_flags.o 00:03:16.807 CC lib/log/log_deprecated.o 00:03:16.807 CC lib/ut_mock/mock.o 00:03:16.807 CC lib/ut/ut.o 00:03:16.807 LIB libspdk_ut_mock.a 00:03:16.807 SO libspdk_ut_mock.so.5.0 00:03:16.807 LIB libspdk_log.a 00:03:16.807 LIB libspdk_ut.a 00:03:16.807 SO libspdk_ut.so.1.0 00:03:16.807 SO libspdk_log.so.6.1 00:03:16.807 SYMLINK libspdk_ut_mock.so 00:03:16.807 SYMLINK libspdk_ut.so 00:03:16.807 SYMLINK libspdk_log.so 00:03:16.807 CC lib/util/base64.o 00:03:16.807 CC lib/ioat/ioat.o 00:03:16.807 CC lib/dma/dma.o 00:03:16.807 CXX lib/trace_parser/trace.o 00:03:16.807 CC lib/util/bit_array.o 00:03:16.807 CC lib/util/cpuset.o 00:03:16.807 CC lib/util/crc16.o 00:03:16.807 CC lib/util/crc32.o 00:03:16.807 CC lib/util/crc32c.o 00:03:16.807 CC lib/util/crc32_ieee.o 00:03:16.807 CC lib/util/crc64.o 00:03:16.807 CC lib/util/dif.o 00:03:16.807 CC lib/util/fd.o 00:03:16.807 CC lib/util/file.o 00:03:16.807 CC lib/util/hexlify.o 00:03:16.807 CC lib/util/iov.o 00:03:16.807 CC lib/util/math.o 00:03:16.807 CC lib/util/pipe.o 00:03:16.807 CC lib/util/strerror_tls.o 00:03:16.807 CC lib/util/string.o 00:03:16.807 CC lib/util/uuid.o 00:03:16.807 CC lib/util/fd_group.o 00:03:16.807 CC lib/util/xor.o 00:03:16.807 CC lib/util/zipf.o 00:03:16.807 CC lib/vfio_user/host/vfio_user_pci.o 00:03:16.807 CC lib/vfio_user/host/vfio_user.o 00:03:16.807 LIB libspdk_dma.a 00:03:16.807 SO libspdk_dma.so.3.0 00:03:16.807 SYMLINK libspdk_dma.so 00:03:16.807 LIB libspdk_ioat.a 00:03:16.807 SO libspdk_ioat.so.6.0 00:03:16.807 LIB libspdk_vfio_user.a 00:03:16.807 SO libspdk_vfio_user.so.4.0 00:03:16.807 SYMLINK libspdk_ioat.so 00:03:16.807 SYMLINK libspdk_vfio_user.so 00:03:16.807 LIB libspdk_util.a 00:03:16.807 SO libspdk_util.so.8.0 00:03:16.807 SYMLINK libspdk_util.so 00:03:16.807 CC lib/json/json_parse.o 00:03:16.807 CC lib/vmd/vmd.o 00:03:16.807 CC lib/env_dpdk/env.o 00:03:16.807 CC lib/rdma/common.o 00:03:16.807 CC lib/idxd/idxd.o 00:03:16.807 CC lib/vmd/led.o 00:03:16.807 CC lib/env_dpdk/memory.o 00:03:16.807 CC lib/json/json_util.o 00:03:16.807 CC lib/conf/conf.o 00:03:16.807 CC lib/idxd/idxd_user.o 00:03:16.807 CC lib/rdma/rdma_verbs.o 00:03:16.807 CC lib/env_dpdk/pci.o 00:03:16.807 CC lib/json/json_write.o 00:03:16.807 CC lib/idxd/idxd_kernel.o 00:03:16.807 CC lib/env_dpdk/init.o 00:03:16.807 CC lib/env_dpdk/threads.o 00:03:16.807 CC lib/env_dpdk/pci_ioat.o 00:03:16.807 CC lib/env_dpdk/pci_virtio.o 00:03:16.807 CC lib/env_dpdk/pci_vmd.o 00:03:16.807 CC lib/env_dpdk/pci_idxd.o 00:03:16.807 CC lib/env_dpdk/pci_event.o 00:03:16.807 CC lib/env_dpdk/sigbus_handler.o 00:03:16.807 CC lib/env_dpdk/pci_dpdk.o 00:03:16.807 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:16.807 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:16.807 LIB libspdk_trace_parser.a 00:03:16.807 SO libspdk_trace_parser.so.4.0 00:03:16.807 SYMLINK libspdk_trace_parser.so 00:03:16.807 LIB libspdk_conf.a 00:03:16.807 SO libspdk_conf.so.5.0 00:03:16.807 LIB libspdk_json.a 00:03:16.807 LIB libspdk_rdma.a 00:03:16.807 SYMLINK libspdk_conf.so 00:03:16.807 SO libspdk_json.so.5.1 00:03:16.807 SO libspdk_rdma.so.5.0 00:03:16.807 SYMLINK libspdk_json.so 00:03:16.807 SYMLINK libspdk_rdma.so 00:03:16.807 CC lib/jsonrpc/jsonrpc_server.o 00:03:16.807 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:16.807 CC lib/jsonrpc/jsonrpc_client.o 00:03:16.807 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:16.807 LIB libspdk_idxd.a 00:03:16.807 SO libspdk_idxd.so.11.0 00:03:16.807 SYMLINK libspdk_idxd.so 00:03:16.807 LIB libspdk_vmd.a 00:03:16.807 SO libspdk_vmd.so.5.0 00:03:16.807 SYMLINK libspdk_vmd.so 00:03:16.807 LIB libspdk_jsonrpc.a 00:03:16.807 SO libspdk_jsonrpc.so.5.1 00:03:16.807 SYMLINK libspdk_jsonrpc.so 00:03:17.066 CC lib/rpc/rpc.o 00:03:17.066 LIB libspdk_rpc.a 00:03:17.066 SO libspdk_rpc.so.5.0 00:03:17.324 SYMLINK libspdk_rpc.so 00:03:17.324 CC lib/notify/notify.o 00:03:17.324 CC lib/notify/notify_rpc.o 00:03:17.324 CC lib/sock/sock.o 00:03:17.324 CC lib/sock/sock_rpc.o 00:03:17.324 CC lib/trace/trace.o 00:03:17.324 CC lib/trace/trace_flags.o 00:03:17.324 CC lib/trace/trace_rpc.o 00:03:17.582 LIB libspdk_notify.a 00:03:17.582 SO libspdk_notify.so.5.0 00:03:17.582 LIB libspdk_trace.a 00:03:17.582 SYMLINK libspdk_notify.so 00:03:17.582 SO libspdk_trace.so.9.0 00:03:17.582 SYMLINK libspdk_trace.so 00:03:17.841 LIB libspdk_sock.a 00:03:17.841 SO libspdk_sock.so.8.0 00:03:17.841 CC lib/thread/thread.o 00:03:17.841 CC lib/thread/iobuf.o 00:03:17.841 SYMLINK libspdk_sock.so 00:03:17.841 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:17.841 CC lib/nvme/nvme_ctrlr.o 00:03:17.841 CC lib/nvme/nvme_fabric.o 00:03:17.841 CC lib/nvme/nvme_ns_cmd.o 00:03:17.841 CC lib/nvme/nvme_ns.o 00:03:17.841 CC lib/nvme/nvme_pcie_common.o 00:03:17.841 CC lib/nvme/nvme_pcie.o 00:03:17.841 CC lib/nvme/nvme_qpair.o 00:03:17.841 CC lib/nvme/nvme.o 00:03:17.841 CC lib/nvme/nvme_quirks.o 00:03:17.841 CC lib/nvme/nvme_transport.o 00:03:17.841 CC lib/nvme/nvme_discovery.o 00:03:17.841 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:17.841 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:17.841 CC lib/nvme/nvme_tcp.o 00:03:17.841 CC lib/nvme/nvme_opal.o 00:03:17.841 CC lib/nvme/nvme_io_msg.o 00:03:17.841 CC lib/nvme/nvme_poll_group.o 00:03:17.841 CC lib/nvme/nvme_zns.o 00:03:17.841 CC lib/nvme/nvme_cuse.o 00:03:17.841 CC lib/nvme/nvme_rdma.o 00:03:17.841 CC lib/nvme/nvme_vfio_user.o 00:03:18.100 LIB libspdk_env_dpdk.a 00:03:18.100 SO libspdk_env_dpdk.so.13.0 00:03:18.358 SYMLINK libspdk_env_dpdk.so 00:03:19.291 LIB libspdk_thread.a 00:03:19.549 SO libspdk_thread.so.9.0 00:03:19.549 SYMLINK libspdk_thread.so 00:03:19.549 CC lib/blob/blobstore.o 00:03:19.549 CC lib/vfu_tgt/tgt_endpoint.o 00:03:19.549 CC lib/virtio/virtio.o 00:03:19.549 CC lib/accel/accel.o 00:03:19.549 CC lib/init/json_config.o 00:03:19.549 CC lib/init/subsystem.o 00:03:19.549 CC lib/vfu_tgt/tgt_rpc.o 00:03:19.549 CC lib/blob/request.o 00:03:19.549 CC lib/virtio/virtio_vhost_user.o 00:03:19.549 CC lib/init/subsystem_rpc.o 00:03:19.549 CC lib/accel/accel_rpc.o 00:03:19.549 CC lib/blob/zeroes.o 00:03:19.549 CC lib/virtio/virtio_vfio_user.o 00:03:19.549 CC lib/init/rpc.o 00:03:19.549 CC lib/accel/accel_sw.o 00:03:19.549 CC lib/blob/blob_bs_dev.o 00:03:19.549 CC lib/virtio/virtio_pci.o 00:03:19.807 LIB libspdk_init.a 00:03:19.807 SO libspdk_init.so.4.0 00:03:20.065 SYMLINK libspdk_init.so 00:03:20.065 LIB libspdk_virtio.a 00:03:20.065 LIB libspdk_vfu_tgt.a 00:03:20.065 SO libspdk_vfu_tgt.so.2.0 00:03:20.065 SO libspdk_virtio.so.6.0 00:03:20.065 SYMLINK libspdk_vfu_tgt.so 00:03:20.065 SYMLINK libspdk_virtio.so 00:03:20.065 CC lib/event/app.o 00:03:20.065 CC lib/event/reactor.o 00:03:20.065 CC lib/event/log_rpc.o 00:03:20.065 CC lib/event/app_rpc.o 00:03:20.065 CC lib/event/scheduler_static.o 00:03:20.322 LIB libspdk_nvme.a 00:03:20.322 SO libspdk_nvme.so.12.0 00:03:20.578 LIB libspdk_event.a 00:03:20.578 SO libspdk_event.so.12.0 00:03:20.578 SYMLINK libspdk_nvme.so 00:03:20.578 SYMLINK libspdk_event.so 00:03:20.578 LIB libspdk_accel.a 00:03:20.578 SO libspdk_accel.so.14.0 00:03:20.835 SYMLINK libspdk_accel.so 00:03:20.835 CC lib/bdev/bdev.o 00:03:20.835 CC lib/bdev/bdev_rpc.o 00:03:20.835 CC lib/bdev/bdev_zone.o 00:03:20.835 CC lib/bdev/part.o 00:03:20.835 CC lib/bdev/scsi_nvme.o 00:03:22.733 LIB libspdk_blob.a 00:03:22.733 SO libspdk_blob.so.10.1 00:03:22.733 SYMLINK libspdk_blob.so 00:03:22.733 CC lib/blobfs/blobfs.o 00:03:22.733 CC lib/blobfs/tree.o 00:03:22.733 CC lib/lvol/lvol.o 00:03:23.299 LIB libspdk_bdev.a 00:03:23.299 SO libspdk_bdev.so.14.0 00:03:23.299 LIB libspdk_blobfs.a 00:03:23.299 SO libspdk_blobfs.so.9.0 00:03:23.563 SYMLINK libspdk_bdev.so 00:03:23.563 SYMLINK libspdk_blobfs.so 00:03:23.563 LIB libspdk_lvol.a 00:03:23.563 SO libspdk_lvol.so.9.1 00:03:23.563 CC lib/nbd/nbd.o 00:03:23.563 CC lib/nvmf/ctrlr.o 00:03:23.563 CC lib/ublk/ublk.o 00:03:23.563 CC lib/nbd/nbd_rpc.o 00:03:23.563 CC lib/nvmf/ctrlr_discovery.o 00:03:23.563 CC lib/scsi/dev.o 00:03:23.563 CC lib/ublk/ublk_rpc.o 00:03:23.563 CC lib/ftl/ftl_core.o 00:03:23.563 CC lib/nvmf/ctrlr_bdev.o 00:03:23.563 CC lib/ftl/ftl_init.o 00:03:23.563 CC lib/scsi/lun.o 00:03:23.563 CC lib/ftl/ftl_layout.o 00:03:23.563 CC lib/nvmf/subsystem.o 00:03:23.563 CC lib/scsi/port.o 00:03:23.563 CC lib/ftl/ftl_debug.o 00:03:23.564 CC lib/ftl/ftl_io.o 00:03:23.564 CC lib/scsi/scsi.o 00:03:23.564 SYMLINK libspdk_lvol.so 00:03:23.564 CC lib/nvmf/nvmf.o 00:03:23.564 CC lib/scsi/scsi_bdev.o 00:03:23.564 CC lib/ftl/ftl_sb.o 00:03:23.564 CC lib/nvmf/nvmf_rpc.o 00:03:23.564 CC lib/scsi/scsi_pr.o 00:03:23.564 CC lib/ftl/ftl_l2p.o 00:03:23.564 CC lib/nvmf/transport.o 00:03:23.564 CC lib/ftl/ftl_l2p_flat.o 00:03:23.564 CC lib/scsi/scsi_rpc.o 00:03:23.564 CC lib/nvmf/tcp.o 00:03:23.564 CC lib/scsi/task.o 00:03:23.564 CC lib/nvmf/vfio_user.o 00:03:23.564 CC lib/nvmf/rdma.o 00:03:23.564 CC lib/ftl/ftl_nv_cache.o 00:03:23.564 CC lib/ftl/ftl_band.o 00:03:23.564 CC lib/ftl/ftl_writer.o 00:03:23.564 CC lib/ftl/ftl_band_ops.o 00:03:23.564 CC lib/ftl/ftl_rq.o 00:03:23.564 CC lib/ftl/ftl_reloc.o 00:03:23.564 CC lib/ftl/ftl_l2p_cache.o 00:03:23.564 CC lib/ftl/ftl_p2l.o 00:03:23.564 CC lib/ftl/mngt/ftl_mngt.o 00:03:23.564 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:23.564 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:23.564 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:23.564 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:23.564 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:23.564 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:23.564 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:23.564 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:23.564 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:23.822 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:23.823 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:24.087 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:24.087 CC lib/ftl/utils/ftl_conf.o 00:03:24.087 CC lib/ftl/utils/ftl_md.o 00:03:24.087 CC lib/ftl/utils/ftl_mempool.o 00:03:24.087 CC lib/ftl/utils/ftl_bitmap.o 00:03:24.087 CC lib/ftl/utils/ftl_property.o 00:03:24.087 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:24.087 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:24.087 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:24.087 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:24.087 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:24.087 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:24.087 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:24.087 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:24.087 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:24.087 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:24.087 CC lib/ftl/base/ftl_base_dev.o 00:03:24.087 CC lib/ftl/base/ftl_base_bdev.o 00:03:24.087 CC lib/ftl/ftl_trace.o 00:03:24.347 LIB libspdk_nbd.a 00:03:24.347 SO libspdk_nbd.so.6.0 00:03:24.347 SYMLINK libspdk_nbd.so 00:03:24.605 LIB libspdk_scsi.a 00:03:24.605 SO libspdk_scsi.so.8.0 00:03:24.605 SYMLINK libspdk_scsi.so 00:03:24.605 LIB libspdk_ublk.a 00:03:24.605 SO libspdk_ublk.so.2.0 00:03:24.605 CC lib/vhost/vhost.o 00:03:24.605 CC lib/iscsi/conn.o 00:03:24.605 CC lib/vhost/vhost_rpc.o 00:03:24.605 CC lib/iscsi/init_grp.o 00:03:24.605 CC lib/vhost/vhost_scsi.o 00:03:24.605 CC lib/iscsi/iscsi.o 00:03:24.605 CC lib/iscsi/md5.o 00:03:24.605 CC lib/vhost/vhost_blk.o 00:03:24.605 CC lib/iscsi/param.o 00:03:24.605 CC lib/vhost/rte_vhost_user.o 00:03:24.605 CC lib/iscsi/portal_grp.o 00:03:24.605 CC lib/iscsi/tgt_node.o 00:03:24.605 CC lib/iscsi/iscsi_subsystem.o 00:03:24.605 CC lib/iscsi/iscsi_rpc.o 00:03:24.605 CC lib/iscsi/task.o 00:03:24.605 SYMLINK libspdk_ublk.so 00:03:24.863 LIB libspdk_ftl.a 00:03:25.121 SO libspdk_ftl.so.8.0 00:03:25.379 SYMLINK libspdk_ftl.so 00:03:25.946 LIB libspdk_vhost.a 00:03:25.946 SO libspdk_vhost.so.7.1 00:03:25.946 SYMLINK libspdk_vhost.so 00:03:25.946 LIB libspdk_nvmf.a 00:03:26.205 SO libspdk_nvmf.so.17.0 00:03:26.205 LIB libspdk_iscsi.a 00:03:26.205 SO libspdk_iscsi.so.7.0 00:03:26.205 SYMLINK libspdk_nvmf.so 00:03:26.205 SYMLINK libspdk_iscsi.so 00:03:26.499 CC module/vfu_device/vfu_virtio.o 00:03:26.499 CC module/vfu_device/vfu_virtio_blk.o 00:03:26.499 CC module/env_dpdk/env_dpdk_rpc.o 00:03:26.499 CC module/vfu_device/vfu_virtio_scsi.o 00:03:26.499 CC module/vfu_device/vfu_virtio_rpc.o 00:03:26.499 CC module/accel/iaa/accel_iaa.o 00:03:26.499 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:26.499 CC module/accel/iaa/accel_iaa_rpc.o 00:03:26.499 CC module/accel/dsa/accel_dsa.o 00:03:26.499 CC module/accel/error/accel_error.o 00:03:26.499 CC module/accel/ioat/accel_ioat.o 00:03:26.499 CC module/accel/dsa/accel_dsa_rpc.o 00:03:26.499 CC module/accel/error/accel_error_rpc.o 00:03:26.499 CC module/accel/ioat/accel_ioat_rpc.o 00:03:26.499 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:26.499 CC module/scheduler/gscheduler/gscheduler.o 00:03:26.499 CC module/blob/bdev/blob_bdev.o 00:03:26.499 CC module/sock/posix/posix.o 00:03:26.758 LIB libspdk_env_dpdk_rpc.a 00:03:26.758 SO libspdk_env_dpdk_rpc.so.5.0 00:03:26.758 SYMLINK libspdk_env_dpdk_rpc.so 00:03:26.758 LIB libspdk_scheduler_gscheduler.a 00:03:26.758 LIB libspdk_scheduler_dpdk_governor.a 00:03:26.758 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:26.758 SO libspdk_scheduler_gscheduler.so.3.0 00:03:26.758 LIB libspdk_accel_error.a 00:03:26.758 LIB libspdk_accel_ioat.a 00:03:26.758 LIB libspdk_scheduler_dynamic.a 00:03:26.758 SO libspdk_accel_error.so.1.0 00:03:26.758 LIB libspdk_accel_iaa.a 00:03:26.758 SO libspdk_accel_ioat.so.5.0 00:03:26.758 SO libspdk_scheduler_dynamic.so.3.0 00:03:26.758 SYMLINK libspdk_scheduler_gscheduler.so 00:03:26.758 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:26.758 SO libspdk_accel_iaa.so.2.0 00:03:26.758 LIB libspdk_accel_dsa.a 00:03:26.758 SYMLINK libspdk_accel_error.so 00:03:26.758 SYMLINK libspdk_scheduler_dynamic.so 00:03:26.758 SYMLINK libspdk_accel_ioat.so 00:03:26.758 SO libspdk_accel_dsa.so.4.0 00:03:26.758 LIB libspdk_blob_bdev.a 00:03:26.758 SYMLINK libspdk_accel_iaa.so 00:03:27.017 SO libspdk_blob_bdev.so.10.1 00:03:27.017 SYMLINK libspdk_accel_dsa.so 00:03:27.017 SYMLINK libspdk_blob_bdev.so 00:03:27.017 CC module/bdev/malloc/bdev_malloc.o 00:03:27.017 CC module/bdev/delay/vbdev_delay.o 00:03:27.017 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:27.017 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:27.017 CC module/bdev/lvol/vbdev_lvol.o 00:03:27.017 CC module/bdev/error/vbdev_error.o 00:03:27.017 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:27.017 CC module/bdev/gpt/gpt.o 00:03:27.017 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:27.017 CC module/bdev/null/bdev_null.o 00:03:27.017 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:27.017 CC module/bdev/nvme/bdev_nvme.o 00:03:27.017 CC module/bdev/error/vbdev_error_rpc.o 00:03:27.017 CC module/bdev/gpt/vbdev_gpt.o 00:03:27.017 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:27.017 CC module/bdev/aio/bdev_aio.o 00:03:27.017 CC module/bdev/nvme/nvme_rpc.o 00:03:27.017 CC module/bdev/passthru/vbdev_passthru.o 00:03:27.017 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:27.017 CC module/bdev/ftl/bdev_ftl.o 00:03:27.017 CC module/blobfs/bdev/blobfs_bdev.o 00:03:27.017 CC module/bdev/null/bdev_null_rpc.o 00:03:27.017 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:27.017 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:27.017 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:27.017 CC module/bdev/raid/bdev_raid.o 00:03:27.017 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:27.017 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:27.017 CC module/bdev/aio/bdev_aio_rpc.o 00:03:27.017 CC module/bdev/iscsi/bdev_iscsi.o 00:03:27.017 CC module/bdev/nvme/bdev_mdns_client.o 00:03:27.017 CC module/bdev/nvme/vbdev_opal.o 00:03:27.017 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:27.017 CC module/bdev/raid/bdev_raid_rpc.o 00:03:27.017 CC module/bdev/split/vbdev_split.o 00:03:27.017 CC module/bdev/raid/bdev_raid_sb.o 00:03:27.017 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:27.017 CC module/bdev/split/vbdev_split_rpc.o 00:03:27.017 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:27.017 CC module/bdev/raid/raid0.o 00:03:27.017 CC module/bdev/raid/raid1.o 00:03:27.017 CC module/bdev/raid/concat.o 00:03:27.276 LIB libspdk_vfu_device.a 00:03:27.276 SO libspdk_vfu_device.so.2.0 00:03:27.276 SYMLINK libspdk_vfu_device.so 00:03:27.534 LIB libspdk_blobfs_bdev.a 00:03:27.534 SO libspdk_blobfs_bdev.so.5.0 00:03:27.534 LIB libspdk_sock_posix.a 00:03:27.534 LIB libspdk_bdev_error.a 00:03:27.534 SYMLINK libspdk_blobfs_bdev.so 00:03:27.534 SO libspdk_sock_posix.so.5.0 00:03:27.534 LIB libspdk_bdev_gpt.a 00:03:27.534 LIB libspdk_bdev_split.a 00:03:27.534 SO libspdk_bdev_error.so.5.0 00:03:27.534 SO libspdk_bdev_split.so.5.0 00:03:27.534 SO libspdk_bdev_gpt.so.5.0 00:03:27.534 LIB libspdk_bdev_null.a 00:03:27.534 SO libspdk_bdev_null.so.5.0 00:03:27.534 SYMLINK libspdk_sock_posix.so 00:03:27.534 SYMLINK libspdk_bdev_error.so 00:03:27.534 LIB libspdk_bdev_ftl.a 00:03:27.534 SYMLINK libspdk_bdev_gpt.so 00:03:27.534 SYMLINK libspdk_bdev_split.so 00:03:27.534 SO libspdk_bdev_ftl.so.5.0 00:03:27.534 LIB libspdk_bdev_passthru.a 00:03:27.792 SYMLINK libspdk_bdev_null.so 00:03:27.792 LIB libspdk_bdev_iscsi.a 00:03:27.792 SO libspdk_bdev_passthru.so.5.0 00:03:27.792 SO libspdk_bdev_iscsi.so.5.0 00:03:27.792 LIB libspdk_bdev_aio.a 00:03:27.792 SYMLINK libspdk_bdev_ftl.so 00:03:27.792 LIB libspdk_bdev_zone_block.a 00:03:27.792 LIB libspdk_bdev_delay.a 00:03:27.792 SO libspdk_bdev_aio.so.5.0 00:03:27.792 LIB libspdk_bdev_malloc.a 00:03:27.792 SO libspdk_bdev_zone_block.so.5.0 00:03:27.792 SYMLINK libspdk_bdev_passthru.so 00:03:27.792 SO libspdk_bdev_delay.so.5.0 00:03:27.792 SYMLINK libspdk_bdev_iscsi.so 00:03:27.792 SO libspdk_bdev_malloc.so.5.0 00:03:27.792 SYMLINK libspdk_bdev_aio.so 00:03:27.792 SYMLINK libspdk_bdev_zone_block.so 00:03:27.792 SYMLINK libspdk_bdev_delay.so 00:03:27.792 SYMLINK libspdk_bdev_malloc.so 00:03:27.792 LIB libspdk_bdev_lvol.a 00:03:27.792 SO libspdk_bdev_lvol.so.5.0 00:03:27.792 LIB libspdk_bdev_virtio.a 00:03:27.792 SO libspdk_bdev_virtio.so.5.0 00:03:27.792 SYMLINK libspdk_bdev_lvol.so 00:03:28.050 SYMLINK libspdk_bdev_virtio.so 00:03:28.311 LIB libspdk_bdev_raid.a 00:03:28.311 SO libspdk_bdev_raid.so.5.0 00:03:28.311 SYMLINK libspdk_bdev_raid.so 00:03:29.251 LIB libspdk_bdev_nvme.a 00:03:29.509 SO libspdk_bdev_nvme.so.6.0 00:03:29.510 SYMLINK libspdk_bdev_nvme.so 00:03:29.767 CC module/event/subsystems/vmd/vmd.o 00:03:29.768 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:29.768 CC module/event/subsystems/iobuf/iobuf.o 00:03:29.768 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:29.768 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:29.768 CC module/event/subsystems/sock/sock.o 00:03:29.768 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:29.768 CC module/event/subsystems/scheduler/scheduler.o 00:03:29.768 LIB libspdk_event_sock.a 00:03:29.768 LIB libspdk_event_vhost_blk.a 00:03:29.768 LIB libspdk_event_scheduler.a 00:03:29.768 LIB libspdk_event_vfu_tgt.a 00:03:29.768 LIB libspdk_event_vmd.a 00:03:29.768 SO libspdk_event_sock.so.4.0 00:03:29.768 SO libspdk_event_vhost_blk.so.2.0 00:03:29.768 SO libspdk_event_scheduler.so.3.0 00:03:29.768 LIB libspdk_event_iobuf.a 00:03:29.768 SO libspdk_event_vfu_tgt.so.2.0 00:03:29.768 SO libspdk_event_vmd.so.5.0 00:03:30.025 SO libspdk_event_iobuf.so.2.0 00:03:30.025 SYMLINK libspdk_event_sock.so 00:03:30.025 SYMLINK libspdk_event_vhost_blk.so 00:03:30.025 SYMLINK libspdk_event_scheduler.so 00:03:30.025 SYMLINK libspdk_event_vfu_tgt.so 00:03:30.025 SYMLINK libspdk_event_vmd.so 00:03:30.025 SYMLINK libspdk_event_iobuf.so 00:03:30.025 CC module/event/subsystems/accel/accel.o 00:03:30.284 LIB libspdk_event_accel.a 00:03:30.284 SO libspdk_event_accel.so.5.0 00:03:30.284 SYMLINK libspdk_event_accel.so 00:03:30.542 CC module/event/subsystems/bdev/bdev.o 00:03:30.542 LIB libspdk_event_bdev.a 00:03:30.542 SO libspdk_event_bdev.so.5.0 00:03:30.801 SYMLINK libspdk_event_bdev.so 00:03:30.801 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:30.801 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:30.801 CC module/event/subsystems/ublk/ublk.o 00:03:30.801 CC module/event/subsystems/scsi/scsi.o 00:03:30.801 CC module/event/subsystems/nbd/nbd.o 00:03:30.801 LIB libspdk_event_nbd.a 00:03:31.060 LIB libspdk_event_ublk.a 00:03:31.060 SO libspdk_event_nbd.so.5.0 00:03:31.060 LIB libspdk_event_scsi.a 00:03:31.060 SO libspdk_event_ublk.so.2.0 00:03:31.060 SO libspdk_event_scsi.so.5.0 00:03:31.060 SYMLINK libspdk_event_nbd.so 00:03:31.060 SYMLINK libspdk_event_ublk.so 00:03:31.060 LIB libspdk_event_nvmf.a 00:03:31.060 SYMLINK libspdk_event_scsi.so 00:03:31.060 SO libspdk_event_nvmf.so.5.0 00:03:31.060 SYMLINK libspdk_event_nvmf.so 00:03:31.060 CC module/event/subsystems/iscsi/iscsi.o 00:03:31.060 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:31.320 LIB libspdk_event_vhost_scsi.a 00:03:31.320 LIB libspdk_event_iscsi.a 00:03:31.320 SO libspdk_event_vhost_scsi.so.2.0 00:03:31.320 SO libspdk_event_iscsi.so.5.0 00:03:31.320 SYMLINK libspdk_event_vhost_scsi.so 00:03:31.320 SYMLINK libspdk_event_iscsi.so 00:03:31.585 SO libspdk.so.5.0 00:03:31.585 SYMLINK libspdk.so 00:03:31.585 CC app/trace_record/trace_record.o 00:03:31.585 CXX app/trace/trace.o 00:03:31.585 CC app/spdk_lspci/spdk_lspci.o 00:03:31.585 CC app/spdk_nvme_identify/identify.o 00:03:31.585 CC app/spdk_top/spdk_top.o 00:03:31.585 CC app/spdk_nvme_discover/discovery_aer.o 00:03:31.585 CC app/spdk_nvme_perf/perf.o 00:03:31.585 TEST_HEADER include/spdk/accel.h 00:03:31.585 TEST_HEADER include/spdk/accel_module.h 00:03:31.585 TEST_HEADER include/spdk/assert.h 00:03:31.585 TEST_HEADER include/spdk/barrier.h 00:03:31.585 CC test/rpc_client/rpc_client_test.o 00:03:31.585 TEST_HEADER include/spdk/base64.h 00:03:31.585 TEST_HEADER include/spdk/bdev.h 00:03:31.585 TEST_HEADER include/spdk/bdev_module.h 00:03:31.585 TEST_HEADER include/spdk/bdev_zone.h 00:03:31.585 TEST_HEADER include/spdk/bit_array.h 00:03:31.585 TEST_HEADER include/spdk/bit_pool.h 00:03:31.585 TEST_HEADER include/spdk/blob_bdev.h 00:03:31.585 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:31.585 TEST_HEADER include/spdk/blobfs.h 00:03:31.585 TEST_HEADER include/spdk/blob.h 00:03:31.585 TEST_HEADER include/spdk/conf.h 00:03:31.585 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:31.585 CC app/spdk_dd/spdk_dd.o 00:03:31.585 TEST_HEADER include/spdk/config.h 00:03:31.585 TEST_HEADER include/spdk/cpuset.h 00:03:31.585 TEST_HEADER include/spdk/crc16.h 00:03:31.585 CC app/nvmf_tgt/nvmf_main.o 00:03:31.585 TEST_HEADER include/spdk/crc32.h 00:03:31.585 TEST_HEADER include/spdk/crc64.h 00:03:31.585 CC app/iscsi_tgt/iscsi_tgt.o 00:03:31.585 TEST_HEADER include/spdk/dif.h 00:03:31.585 CC app/vhost/vhost.o 00:03:31.585 TEST_HEADER include/spdk/dma.h 00:03:31.585 TEST_HEADER include/spdk/endian.h 00:03:31.585 TEST_HEADER include/spdk/env_dpdk.h 00:03:31.585 CC examples/nvme/hello_world/hello_world.o 00:03:31.585 CC examples/idxd/perf/perf.o 00:03:31.585 TEST_HEADER include/spdk/env.h 00:03:31.585 CC examples/ioat/perf/perf.o 00:03:31.585 CC examples/ioat/verify/verify.o 00:03:31.585 CC examples/util/zipf/zipf.o 00:03:31.585 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:31.585 TEST_HEADER include/spdk/event.h 00:03:31.585 CC examples/vmd/lsvmd/lsvmd.o 00:03:31.585 TEST_HEADER include/spdk/fd_group.h 00:03:31.585 CC examples/nvme/hotplug/hotplug.o 00:03:31.585 CC examples/accel/perf/accel_perf.o 00:03:31.848 CC examples/sock/hello_world/hello_sock.o 00:03:31.848 CC examples/nvme/abort/abort.o 00:03:31.848 TEST_HEADER include/spdk/fd.h 00:03:31.848 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:31.848 CC examples/vmd/led/led.o 00:03:31.848 TEST_HEADER include/spdk/file.h 00:03:31.849 CC app/fio/nvme/fio_plugin.o 00:03:31.849 TEST_HEADER include/spdk/ftl.h 00:03:31.849 CC examples/nvme/reconnect/reconnect.o 00:03:31.849 CC test/thread/poller_perf/poller_perf.o 00:03:31.849 CC examples/nvme/arbitration/arbitration.o 00:03:31.849 TEST_HEADER include/spdk/gpt_spec.h 00:03:31.849 TEST_HEADER include/spdk/hexlify.h 00:03:31.849 CC app/spdk_tgt/spdk_tgt.o 00:03:31.849 CC test/event/event_perf/event_perf.o 00:03:31.849 TEST_HEADER include/spdk/histogram_data.h 00:03:31.849 TEST_HEADER include/spdk/idxd.h 00:03:31.849 TEST_HEADER include/spdk/idxd_spec.h 00:03:31.849 CC test/nvme/aer/aer.o 00:03:31.849 TEST_HEADER include/spdk/init.h 00:03:31.849 TEST_HEADER include/spdk/ioat.h 00:03:31.849 TEST_HEADER include/spdk/ioat_spec.h 00:03:31.849 TEST_HEADER include/spdk/iscsi_spec.h 00:03:31.849 TEST_HEADER include/spdk/json.h 00:03:31.849 TEST_HEADER include/spdk/jsonrpc.h 00:03:31.849 TEST_HEADER include/spdk/likely.h 00:03:31.849 TEST_HEADER include/spdk/log.h 00:03:31.849 TEST_HEADER include/spdk/lvol.h 00:03:31.849 TEST_HEADER include/spdk/memory.h 00:03:31.849 TEST_HEADER include/spdk/mmio.h 00:03:31.849 CC examples/bdev/hello_world/hello_bdev.o 00:03:31.849 CC examples/bdev/bdevperf/bdevperf.o 00:03:31.849 TEST_HEADER include/spdk/nbd.h 00:03:31.849 TEST_HEADER include/spdk/notify.h 00:03:31.849 CC examples/nvmf/nvmf/nvmf.o 00:03:31.849 TEST_HEADER include/spdk/nvme.h 00:03:31.849 CC examples/blob/hello_world/hello_blob.o 00:03:31.849 TEST_HEADER include/spdk/nvme_intel.h 00:03:31.849 CC examples/thread/thread/thread_ex.o 00:03:31.849 CC examples/blob/cli/blobcli.o 00:03:31.849 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:31.849 CC test/dma/test_dma/test_dma.o 00:03:31.849 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:31.849 CC app/fio/bdev/fio_plugin.o 00:03:31.849 CC test/blobfs/mkfs/mkfs.o 00:03:31.849 CC test/accel/dif/dif.o 00:03:31.849 CC test/bdev/bdevio/bdevio.o 00:03:31.849 TEST_HEADER include/spdk/nvme_spec.h 00:03:31.849 CC test/app/bdev_svc/bdev_svc.o 00:03:31.849 TEST_HEADER include/spdk/nvme_zns.h 00:03:31.849 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:31.849 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:31.849 TEST_HEADER include/spdk/nvmf.h 00:03:31.849 TEST_HEADER include/spdk/nvmf_spec.h 00:03:31.849 TEST_HEADER include/spdk/nvmf_transport.h 00:03:31.849 TEST_HEADER include/spdk/opal.h 00:03:31.849 TEST_HEADER include/spdk/opal_spec.h 00:03:31.849 TEST_HEADER include/spdk/pci_ids.h 00:03:31.849 CC test/lvol/esnap/esnap.o 00:03:31.849 CC test/env/mem_callbacks/mem_callbacks.o 00:03:31.849 TEST_HEADER include/spdk/pipe.h 00:03:31.849 TEST_HEADER include/spdk/queue.h 00:03:31.849 TEST_HEADER include/spdk/reduce.h 00:03:31.849 TEST_HEADER include/spdk/rpc.h 00:03:31.849 TEST_HEADER include/spdk/scheduler.h 00:03:31.849 TEST_HEADER include/spdk/scsi.h 00:03:31.849 TEST_HEADER include/spdk/scsi_spec.h 00:03:31.849 TEST_HEADER include/spdk/sock.h 00:03:31.849 TEST_HEADER include/spdk/stdinc.h 00:03:31.849 TEST_HEADER include/spdk/string.h 00:03:31.849 TEST_HEADER include/spdk/thread.h 00:03:31.849 LINK spdk_lspci 00:03:31.849 TEST_HEADER include/spdk/trace.h 00:03:31.849 TEST_HEADER include/spdk/trace_parser.h 00:03:31.849 TEST_HEADER include/spdk/tree.h 00:03:31.849 TEST_HEADER include/spdk/ublk.h 00:03:31.849 TEST_HEADER include/spdk/util.h 00:03:31.849 TEST_HEADER include/spdk/uuid.h 00:03:31.849 TEST_HEADER include/spdk/version.h 00:03:31.849 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:31.849 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:31.849 TEST_HEADER include/spdk/vhost.h 00:03:31.849 TEST_HEADER include/spdk/vmd.h 00:03:31.849 TEST_HEADER include/spdk/xor.h 00:03:31.849 TEST_HEADER include/spdk/zipf.h 00:03:31.849 CXX test/cpp_headers/accel.o 00:03:32.118 LINK lsvmd 00:03:32.118 LINK spdk_nvme_discover 00:03:32.118 LINK rpc_client_test 00:03:32.118 LINK led 00:03:32.118 LINK poller_perf 00:03:32.118 LINK interrupt_tgt 00:03:32.118 LINK zipf 00:03:32.118 LINK event_perf 00:03:32.118 LINK nvmf_tgt 00:03:32.118 LINK vhost 00:03:32.118 LINK cmb_copy 00:03:32.118 LINK spdk_trace_record 00:03:32.118 LINK iscsi_tgt 00:03:32.118 LINK ioat_perf 00:03:32.118 LINK verify 00:03:32.118 LINK spdk_tgt 00:03:32.118 LINK hello_world 00:03:32.118 LINK hotplug 00:03:32.118 LINK bdev_svc 00:03:32.118 LINK hello_sock 00:03:32.118 LINK mkfs 00:03:32.376 LINK hello_bdev 00:03:32.376 LINK hello_blob 00:03:32.376 LINK thread 00:03:32.376 CC test/nvme/reset/reset.o 00:03:32.376 LINK aer 00:03:32.376 CXX test/cpp_headers/accel_module.o 00:03:32.376 CXX test/cpp_headers/assert.o 00:03:32.376 LINK spdk_dd 00:03:32.376 LINK idxd_perf 00:03:32.376 LINK nvmf 00:03:32.376 LINK arbitration 00:03:32.376 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:32.376 CXX test/cpp_headers/barrier.o 00:03:32.376 LINK reconnect 00:03:32.376 CC test/event/reactor/reactor.o 00:03:32.376 CC test/env/vtophys/vtophys.o 00:03:32.376 CC test/event/reactor_perf/reactor_perf.o 00:03:32.376 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:32.376 LINK spdk_trace 00:03:32.376 LINK abort 00:03:32.376 CC test/env/memory/memory_ut.o 00:03:32.636 CC test/env/pci/pci_ut.o 00:03:32.636 CXX test/cpp_headers/base64.o 00:03:32.636 LINK dif 00:03:32.636 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:32.636 CC test/app/histogram_perf/histogram_perf.o 00:03:32.636 LINK test_dma 00:03:32.636 LINK bdevio 00:03:32.636 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:32.636 CC test/app/jsoncat/jsoncat.o 00:03:32.636 CC test/nvme/sgl/sgl.o 00:03:32.636 CC test/event/app_repeat/app_repeat.o 00:03:32.636 LINK accel_perf 00:03:32.636 CXX test/cpp_headers/bdev.o 00:03:32.636 CXX test/cpp_headers/bdev_module.o 00:03:32.636 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:32.636 LINK nvme_manage 00:03:32.636 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:32.636 CC test/event/scheduler/scheduler.o 00:03:32.636 CXX test/cpp_headers/bdev_zone.o 00:03:32.636 CC test/app/stub/stub.o 00:03:32.636 CXX test/cpp_headers/bit_array.o 00:03:32.636 CC test/nvme/e2edp/nvme_dp.o 00:03:32.636 LINK reactor_perf 00:03:32.636 CXX test/cpp_headers/bit_pool.o 00:03:32.636 LINK reactor 00:03:32.636 CC test/nvme/err_injection/err_injection.o 00:03:32.636 CC test/nvme/overhead/overhead.o 00:03:32.636 LINK vtophys 00:03:32.636 LINK blobcli 00:03:32.900 LINK spdk_bdev 00:03:32.900 CXX test/cpp_headers/blob_bdev.o 00:03:32.900 LINK pmr_persistence 00:03:32.900 LINK env_dpdk_post_init 00:03:32.900 LINK spdk_nvme 00:03:32.900 CC test/nvme/reserve/reserve.o 00:03:32.900 CC test/nvme/startup/startup.o 00:03:32.900 LINK reset 00:03:32.900 LINK histogram_perf 00:03:32.900 CC test/nvme/simple_copy/simple_copy.o 00:03:32.900 LINK jsoncat 00:03:32.900 CC test/nvme/boot_partition/boot_partition.o 00:03:32.900 CC test/nvme/connect_stress/connect_stress.o 00:03:32.900 CC test/nvme/compliance/nvme_compliance.o 00:03:32.900 CXX test/cpp_headers/blobfs_bdev.o 00:03:32.900 LINK app_repeat 00:03:32.900 CXX test/cpp_headers/blobfs.o 00:03:32.900 CXX test/cpp_headers/blob.o 00:03:32.900 CXX test/cpp_headers/conf.o 00:03:32.900 CC test/nvme/fused_ordering/fused_ordering.o 00:03:32.900 CXX test/cpp_headers/config.o 00:03:32.900 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:33.163 CXX test/cpp_headers/cpuset.o 00:03:33.163 CXX test/cpp_headers/crc16.o 00:03:33.163 CXX test/cpp_headers/crc32.o 00:03:33.163 CXX test/cpp_headers/crc64.o 00:03:33.163 CC test/nvme/cuse/cuse.o 00:03:33.163 CC test/nvme/fdp/fdp.o 00:03:33.163 LINK stub 00:03:33.163 CXX test/cpp_headers/dif.o 00:03:33.163 CXX test/cpp_headers/dma.o 00:03:33.163 LINK mem_callbacks 00:03:33.163 CXX test/cpp_headers/endian.o 00:03:33.163 CXX test/cpp_headers/env_dpdk.o 00:03:33.163 CXX test/cpp_headers/env.o 00:03:33.163 CXX test/cpp_headers/event.o 00:03:33.163 CXX test/cpp_headers/fd_group.o 00:03:33.163 CXX test/cpp_headers/fd.o 00:03:33.163 CXX test/cpp_headers/file.o 00:03:33.163 LINK sgl 00:03:33.163 LINK err_injection 00:03:33.163 LINK scheduler 00:03:33.163 LINK startup 00:03:33.163 CXX test/cpp_headers/ftl.o 00:03:33.163 CXX test/cpp_headers/gpt_spec.o 00:03:33.163 CXX test/cpp_headers/hexlify.o 00:03:33.163 LINK spdk_nvme_perf 00:03:33.163 LINK spdk_nvme_identify 00:03:33.163 LINK reserve 00:03:33.163 LINK boot_partition 00:03:33.163 LINK nvme_dp 00:03:33.163 LINK pci_ut 00:03:33.163 CXX test/cpp_headers/histogram_data.o 00:03:33.163 LINK bdevperf 00:03:33.163 LINK connect_stress 00:03:33.163 LINK spdk_top 00:03:33.427 CXX test/cpp_headers/idxd.o 00:03:33.427 CXX test/cpp_headers/idxd_spec.o 00:03:33.427 LINK overhead 00:03:33.427 CXX test/cpp_headers/init.o 00:03:33.427 LINK nvme_fuzz 00:03:33.427 CXX test/cpp_headers/ioat.o 00:03:33.427 CXX test/cpp_headers/ioat_spec.o 00:03:33.427 CXX test/cpp_headers/iscsi_spec.o 00:03:33.427 LINK simple_copy 00:03:33.427 LINK fused_ordering 00:03:33.427 CXX test/cpp_headers/json.o 00:03:33.427 CXX test/cpp_headers/jsonrpc.o 00:03:33.427 CXX test/cpp_headers/likely.o 00:03:33.427 LINK doorbell_aers 00:03:33.427 CXX test/cpp_headers/log.o 00:03:33.427 LINK vhost_fuzz 00:03:33.427 CXX test/cpp_headers/lvol.o 00:03:33.427 CXX test/cpp_headers/memory.o 00:03:33.427 CXX test/cpp_headers/mmio.o 00:03:33.427 CXX test/cpp_headers/nbd.o 00:03:33.427 CXX test/cpp_headers/notify.o 00:03:33.427 CXX test/cpp_headers/nvme.o 00:03:33.427 CXX test/cpp_headers/nvme_intel.o 00:03:33.427 CXX test/cpp_headers/nvme_ocssd.o 00:03:33.427 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:33.427 CXX test/cpp_headers/nvme_spec.o 00:03:33.427 CXX test/cpp_headers/nvme_zns.o 00:03:33.427 CXX test/cpp_headers/nvmf_cmd.o 00:03:33.427 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:33.427 CXX test/cpp_headers/nvmf.o 00:03:33.427 CXX test/cpp_headers/nvmf_spec.o 00:03:33.427 CXX test/cpp_headers/nvmf_transport.o 00:03:33.691 CXX test/cpp_headers/opal.o 00:03:33.691 CXX test/cpp_headers/opal_spec.o 00:03:33.691 CXX test/cpp_headers/pci_ids.o 00:03:33.691 CXX test/cpp_headers/pipe.o 00:03:33.691 LINK nvme_compliance 00:03:33.691 CXX test/cpp_headers/queue.o 00:03:33.691 CXX test/cpp_headers/reduce.o 00:03:33.691 CXX test/cpp_headers/rpc.o 00:03:33.691 CXX test/cpp_headers/scheduler.o 00:03:33.691 CXX test/cpp_headers/scsi.o 00:03:33.691 CXX test/cpp_headers/scsi_spec.o 00:03:33.691 CXX test/cpp_headers/sock.o 00:03:33.691 CXX test/cpp_headers/stdinc.o 00:03:33.691 CXX test/cpp_headers/string.o 00:03:33.691 CXX test/cpp_headers/thread.o 00:03:33.691 CXX test/cpp_headers/trace.o 00:03:33.691 CXX test/cpp_headers/trace_parser.o 00:03:33.691 CXX test/cpp_headers/tree.o 00:03:33.691 CXX test/cpp_headers/ublk.o 00:03:33.691 CXX test/cpp_headers/util.o 00:03:33.691 LINK fdp 00:03:33.691 CXX test/cpp_headers/uuid.o 00:03:33.691 CXX test/cpp_headers/vfio_user_pci.o 00:03:33.691 CXX test/cpp_headers/version.o 00:03:33.691 CXX test/cpp_headers/vfio_user_spec.o 00:03:33.691 CXX test/cpp_headers/vhost.o 00:03:33.691 CXX test/cpp_headers/vmd.o 00:03:33.691 CXX test/cpp_headers/xor.o 00:03:33.691 CXX test/cpp_headers/zipf.o 00:03:34.257 LINK memory_ut 00:03:34.516 LINK cuse 00:03:34.774 LINK iscsi_fuzz 00:03:37.313 LINK esnap 00:03:37.572 00:03:37.572 real 0m37.710s 00:03:37.572 user 7m15.928s 00:03:37.572 sys 1m39.032s 00:03:37.572 15:47:27 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:03:37.572 15:47:27 -- common/autotest_common.sh@10 -- $ set +x 00:03:37.572 ************************************ 00:03:37.572 END TEST make 00:03:37.572 ************************************ 00:03:37.831 15:47:27 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:37.831 15:47:27 -- nvmf/common.sh@7 -- # uname -s 00:03:37.831 15:47:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:37.831 15:47:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:37.831 15:47:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:37.831 15:47:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:37.831 15:47:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:37.831 15:47:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:37.831 15:47:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:37.831 15:47:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:37.831 15:47:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:37.831 15:47:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:37.831 15:47:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:37.831 15:47:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:37.831 15:47:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:37.831 15:47:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:37.831 15:47:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:37.831 15:47:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:37.831 15:47:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:37.831 15:47:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:37.831 15:47:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:37.831 15:47:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:37.831 15:47:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:37.831 15:47:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:37.831 15:47:27 -- paths/export.sh@5 -- # export PATH 00:03:37.831 15:47:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:37.831 15:47:27 -- nvmf/common.sh@46 -- # : 0 00:03:37.831 15:47:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:37.831 15:47:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:37.831 15:47:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:37.831 15:47:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:37.831 15:47:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:37.831 15:47:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:37.831 15:47:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:37.831 15:47:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:37.831 15:47:27 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:37.831 15:47:27 -- spdk/autotest.sh@32 -- # uname -s 00:03:37.831 15:47:27 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:37.831 15:47:27 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:37.831 15:47:27 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:37.831 15:47:27 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:37.831 15:47:27 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:37.831 15:47:27 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:37.831 15:47:27 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:37.831 15:47:27 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:37.831 15:47:27 -- spdk/autotest.sh@48 -- # udevadm_pid=2262880 00:03:37.831 15:47:27 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:37.831 15:47:27 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:37.831 15:47:27 -- spdk/autotest.sh@54 -- # echo 2262882 00:03:37.831 15:47:27 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:37.831 15:47:27 -- spdk/autotest.sh@56 -- # echo 2262883 00:03:37.832 15:47:27 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:37.832 15:47:27 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:37.832 15:47:27 -- spdk/autotest.sh@60 -- # echo 2262884 00:03:37.832 15:47:27 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:37.832 15:47:27 -- spdk/autotest.sh@62 -- # echo 2262885 00:03:37.832 15:47:27 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:37.832 15:47:27 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:37.832 15:47:27 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:37.832 15:47:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:37.832 15:47:27 -- common/autotest_common.sh@10 -- # set +x 00:03:37.832 15:47:27 -- spdk/autotest.sh@70 -- # create_test_list 00:03:37.832 15:47:27 -- common/autotest_common.sh@736 -- # xtrace_disable 00:03:37.832 15:47:27 -- common/autotest_common.sh@10 -- # set +x 00:03:37.832 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:37.832 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:37.832 15:47:27 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:37.832 15:47:27 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:37.832 15:47:27 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:37.832 15:47:27 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:37.832 15:47:27 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:37.832 15:47:27 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:37.832 15:47:27 -- common/autotest_common.sh@1440 -- # uname 00:03:37.832 15:47:27 -- common/autotest_common.sh@1440 -- # '[' Linux = FreeBSD ']' 00:03:37.832 15:47:27 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:37.832 15:47:27 -- common/autotest_common.sh@1460 -- # uname 00:03:37.832 15:47:27 -- common/autotest_common.sh@1460 -- # [[ Linux = FreeBSD ]] 00:03:37.832 15:47:27 -- spdk/autotest.sh@82 -- # grep CC_TYPE mk/cc.mk 00:03:37.832 15:47:27 -- spdk/autotest.sh@82 -- # CC_TYPE=CC_TYPE=gcc 00:03:37.832 15:47:27 -- spdk/autotest.sh@83 -- # hash lcov 00:03:37.832 15:47:27 -- spdk/autotest.sh@83 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:03:37.832 15:47:27 -- spdk/autotest.sh@91 -- # export 'LCOV_OPTS= 00:03:37.832 --rc lcov_branch_coverage=1 00:03:37.832 --rc lcov_function_coverage=1 00:03:37.832 --rc genhtml_branch_coverage=1 00:03:37.832 --rc genhtml_function_coverage=1 00:03:37.832 --rc genhtml_legend=1 00:03:37.832 --rc geninfo_all_blocks=1 00:03:37.832 ' 00:03:37.832 15:47:27 -- spdk/autotest.sh@91 -- # LCOV_OPTS=' 00:03:37.832 --rc lcov_branch_coverage=1 00:03:37.832 --rc lcov_function_coverage=1 00:03:37.832 --rc genhtml_branch_coverage=1 00:03:37.832 --rc genhtml_function_coverage=1 00:03:37.832 --rc genhtml_legend=1 00:03:37.832 --rc geninfo_all_blocks=1 00:03:37.832 ' 00:03:37.832 15:47:27 -- spdk/autotest.sh@92 -- # export 'LCOV=lcov 00:03:37.832 --rc lcov_branch_coverage=1 00:03:37.832 --rc lcov_function_coverage=1 00:03:37.832 --rc genhtml_branch_coverage=1 00:03:37.832 --rc genhtml_function_coverage=1 00:03:37.832 --rc genhtml_legend=1 00:03:37.832 --rc geninfo_all_blocks=1 00:03:37.832 --no-external' 00:03:37.832 15:47:27 -- spdk/autotest.sh@92 -- # LCOV='lcov 00:03:37.832 --rc lcov_branch_coverage=1 00:03:37.832 --rc lcov_function_coverage=1 00:03:37.832 --rc genhtml_branch_coverage=1 00:03:37.832 --rc genhtml_function_coverage=1 00:03:37.832 --rc genhtml_legend=1 00:03:37.832 --rc geninfo_all_blocks=1 00:03:37.832 --no-external' 00:03:37.832 15:47:27 -- spdk/autotest.sh@94 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:03:37.832 lcov: LCOV version 1.15 00:03:37.832 15:47:27 -- spdk/autotest.sh@96 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:03:39.732 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:03:39.732 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:03:39.733 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:03:39.733 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:03:57.810 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:03:57.810 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:03:57.810 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:03:57.810 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:57.810 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:03:57.810 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:12.685 15:48:00 -- spdk/autotest.sh@100 -- # timing_enter pre_cleanup 00:04:12.686 15:48:00 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:12.686 15:48:00 -- common/autotest_common.sh@10 -- # set +x 00:04:12.686 15:48:00 -- spdk/autotest.sh@102 -- # rm -f 00:04:12.686 15:48:00 -- spdk/autotest.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:12.686 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:12.686 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:12.686 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:12.686 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:12.686 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:12.686 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:12.686 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:12.686 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:12.686 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:12.686 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:12.686 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:12.686 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:12.686 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:12.686 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:12.686 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:12.686 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:12.686 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:12.686 15:48:02 -- spdk/autotest.sh@107 -- # get_zoned_devs 00:04:12.686 15:48:02 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:04:12.686 15:48:02 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:04:12.686 15:48:02 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:04:12.686 15:48:02 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:04:12.686 15:48:02 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:04:12.686 15:48:02 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:04:12.686 15:48:02 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:12.686 15:48:02 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:04:12.686 15:48:02 -- spdk/autotest.sh@109 -- # (( 0 > 0 )) 00:04:12.686 15:48:02 -- spdk/autotest.sh@121 -- # ls /dev/nvme0n1 00:04:12.686 15:48:02 -- spdk/autotest.sh@121 -- # grep -v p 00:04:12.686 15:48:02 -- spdk/autotest.sh@121 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:12.686 15:48:02 -- spdk/autotest.sh@123 -- # [[ -z '' ]] 00:04:12.686 15:48:02 -- spdk/autotest.sh@124 -- # block_in_use /dev/nvme0n1 00:04:12.686 15:48:02 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:12.686 15:48:02 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:12.686 No valid GPT data, bailing 00:04:12.686 15:48:02 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:12.686 15:48:02 -- scripts/common.sh@393 -- # pt= 00:04:12.686 15:48:02 -- scripts/common.sh@394 -- # return 1 00:04:12.686 15:48:02 -- spdk/autotest.sh@125 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:12.686 1+0 records in 00:04:12.686 1+0 records out 00:04:12.686 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00221187 s, 474 MB/s 00:04:12.686 15:48:02 -- spdk/autotest.sh@129 -- # sync 00:04:12.686 15:48:02 -- spdk/autotest.sh@131 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:12.686 15:48:02 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:12.686 15:48:02 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:14.586 15:48:04 -- spdk/autotest.sh@135 -- # uname -s 00:04:14.586 15:48:04 -- spdk/autotest.sh@135 -- # '[' Linux = Linux ']' 00:04:14.586 15:48:04 -- spdk/autotest.sh@136 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:14.586 15:48:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:14.586 15:48:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:14.586 15:48:04 -- common/autotest_common.sh@10 -- # set +x 00:04:14.586 ************************************ 00:04:14.586 START TEST setup.sh 00:04:14.586 ************************************ 00:04:14.586 15:48:04 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:14.586 * Looking for test storage... 00:04:14.586 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:14.586 15:48:04 -- setup/test-setup.sh@10 -- # uname -s 00:04:14.586 15:48:04 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:14.586 15:48:04 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:14.586 15:48:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:14.586 15:48:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:14.586 15:48:04 -- common/autotest_common.sh@10 -- # set +x 00:04:14.586 ************************************ 00:04:14.586 START TEST acl 00:04:14.586 ************************************ 00:04:14.586 15:48:04 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:14.586 * Looking for test storage... 00:04:14.586 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:14.586 15:48:04 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:14.586 15:48:04 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:04:14.586 15:48:04 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:04:14.586 15:48:04 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:04:14.586 15:48:04 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:04:14.586 15:48:04 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:04:14.586 15:48:04 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:04:14.586 15:48:04 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:14.586 15:48:04 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:04:14.586 15:48:04 -- setup/acl.sh@12 -- # devs=() 00:04:14.586 15:48:04 -- setup/acl.sh@12 -- # declare -a devs 00:04:14.586 15:48:04 -- setup/acl.sh@13 -- # drivers=() 00:04:14.586 15:48:04 -- setup/acl.sh@13 -- # declare -A drivers 00:04:14.586 15:48:04 -- setup/acl.sh@51 -- # setup reset 00:04:14.586 15:48:04 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:14.586 15:48:04 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:16.487 15:48:05 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:16.487 15:48:05 -- setup/acl.sh@16 -- # local dev driver 00:04:16.487 15:48:05 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:16.487 15:48:05 -- setup/acl.sh@15 -- # setup output status 00:04:16.487 15:48:05 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:16.487 15:48:05 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:17.423 Hugepages 00:04:17.423 node hugesize free / total 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 00:04:17.423 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # continue 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:17.423 15:48:07 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:17.423 15:48:07 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:17.423 15:48:07 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:17.423 15:48:07 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:17.423 15:48:07 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:17.423 15:48:07 -- setup/acl.sh@54 -- # run_test denied denied 00:04:17.423 15:48:07 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:17.423 15:48:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:17.423 15:48:07 -- common/autotest_common.sh@10 -- # set +x 00:04:17.423 ************************************ 00:04:17.423 START TEST denied 00:04:17.423 ************************************ 00:04:17.423 15:48:07 -- common/autotest_common.sh@1104 -- # denied 00:04:17.423 15:48:07 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:17.423 15:48:07 -- setup/acl.sh@38 -- # setup output config 00:04:17.423 15:48:07 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:17.423 15:48:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:17.423 15:48:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:18.821 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:18.821 15:48:08 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:18.821 15:48:08 -- setup/acl.sh@28 -- # local dev driver 00:04:18.821 15:48:08 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:18.821 15:48:08 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:18.821 15:48:08 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:18.821 15:48:08 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:18.821 15:48:08 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:18.821 15:48:08 -- setup/acl.sh@41 -- # setup reset 00:04:18.821 15:48:08 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:18.822 15:48:08 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:21.354 00:04:21.354 real 0m4.028s 00:04:21.354 user 0m1.167s 00:04:21.354 sys 0m1.929s 00:04:21.354 15:48:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:21.354 15:48:11 -- common/autotest_common.sh@10 -- # set +x 00:04:21.354 ************************************ 00:04:21.354 END TEST denied 00:04:21.354 ************************************ 00:04:21.354 15:48:11 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:21.354 15:48:11 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:21.354 15:48:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:21.354 15:48:11 -- common/autotest_common.sh@10 -- # set +x 00:04:21.354 ************************************ 00:04:21.354 START TEST allowed 00:04:21.354 ************************************ 00:04:21.354 15:48:11 -- common/autotest_common.sh@1104 -- # allowed 00:04:21.354 15:48:11 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:21.354 15:48:11 -- setup/acl.sh@45 -- # setup output config 00:04:21.354 15:48:11 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:21.354 15:48:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:21.354 15:48:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:23.893 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:23.893 15:48:13 -- setup/acl.sh@47 -- # verify 00:04:23.893 15:48:13 -- setup/acl.sh@28 -- # local dev driver 00:04:23.893 15:48:13 -- setup/acl.sh@48 -- # setup reset 00:04:23.893 15:48:13 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:23.893 15:48:13 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:25.802 00:04:25.802 real 0m4.009s 00:04:25.802 user 0m1.086s 00:04:25.802 sys 0m1.833s 00:04:25.802 15:48:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:25.802 15:48:15 -- common/autotest_common.sh@10 -- # set +x 00:04:25.802 ************************************ 00:04:25.802 END TEST allowed 00:04:25.802 ************************************ 00:04:25.802 00:04:25.802 real 0m10.887s 00:04:25.802 user 0m3.341s 00:04:25.802 sys 0m5.611s 00:04:25.802 15:48:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:25.802 15:48:15 -- common/autotest_common.sh@10 -- # set +x 00:04:25.802 ************************************ 00:04:25.802 END TEST acl 00:04:25.802 ************************************ 00:04:25.802 15:48:15 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:25.802 15:48:15 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:25.802 15:48:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:25.802 15:48:15 -- common/autotest_common.sh@10 -- # set +x 00:04:25.802 ************************************ 00:04:25.802 START TEST hugepages 00:04:25.802 ************************************ 00:04:25.802 15:48:15 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:25.802 * Looking for test storage... 00:04:25.802 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:25.802 15:48:15 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:25.802 15:48:15 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:25.802 15:48:15 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:25.802 15:48:15 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:25.802 15:48:15 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:25.802 15:48:15 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:25.802 15:48:15 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:25.802 15:48:15 -- setup/common.sh@18 -- # local node= 00:04:25.802 15:48:15 -- setup/common.sh@19 -- # local var val 00:04:25.802 15:48:15 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.802 15:48:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.802 15:48:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.802 15:48:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.802 15:48:15 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.803 15:48:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 41061400 kB' 'MemAvailable: 44812176 kB' 'Buffers: 2708 kB' 'Cached: 12785384 kB' 'SwapCached: 0 kB' 'Active: 9482484 kB' 'Inactive: 3752328 kB' 'Active(anon): 9089772 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449992 kB' 'Mapped: 206236 kB' 'Shmem: 8643052 kB' 'KReclaimable: 198632 kB' 'Slab: 695560 kB' 'SReclaimable: 198632 kB' 'SUnreclaim: 496928 kB' 'KernelStack: 12848 kB' 'PageTables: 8060 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559288 kB' 'Committed_AS: 10175096 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198168 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.803 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.803 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # continue 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.804 15:48:15 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.804 15:48:15 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:25.804 15:48:15 -- setup/common.sh@33 -- # echo 2048 00:04:25.804 15:48:15 -- setup/common.sh@33 -- # return 0 00:04:25.804 15:48:15 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:25.804 15:48:15 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:25.804 15:48:15 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:25.804 15:48:15 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:25.804 15:48:15 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:25.804 15:48:15 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:25.804 15:48:15 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:25.804 15:48:15 -- setup/hugepages.sh@207 -- # get_nodes 00:04:25.804 15:48:15 -- setup/hugepages.sh@27 -- # local node 00:04:25.804 15:48:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:25.804 15:48:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:25.804 15:48:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:25.804 15:48:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:25.804 15:48:15 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:25.804 15:48:15 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:25.804 15:48:15 -- setup/hugepages.sh@208 -- # clear_hp 00:04:25.804 15:48:15 -- setup/hugepages.sh@37 -- # local node hp 00:04:25.804 15:48:15 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:25.804 15:48:15 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:25.804 15:48:15 -- setup/hugepages.sh@41 -- # echo 0 00:04:25.804 15:48:15 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:25.804 15:48:15 -- setup/hugepages.sh@41 -- # echo 0 00:04:25.804 15:48:15 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:25.804 15:48:15 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:25.804 15:48:15 -- setup/hugepages.sh@41 -- # echo 0 00:04:25.804 15:48:15 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:25.804 15:48:15 -- setup/hugepages.sh@41 -- # echo 0 00:04:25.804 15:48:15 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:25.804 15:48:15 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:25.804 15:48:15 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:25.804 15:48:15 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:25.804 15:48:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:25.804 15:48:15 -- common/autotest_common.sh@10 -- # set +x 00:04:25.804 ************************************ 00:04:25.804 START TEST default_setup 00:04:25.804 ************************************ 00:04:25.804 15:48:15 -- common/autotest_common.sh@1104 -- # default_setup 00:04:25.804 15:48:15 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:25.804 15:48:15 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:25.804 15:48:15 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:25.804 15:48:15 -- setup/hugepages.sh@51 -- # shift 00:04:25.804 15:48:15 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:25.804 15:48:15 -- setup/hugepages.sh@52 -- # local node_ids 00:04:25.804 15:48:15 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:25.804 15:48:15 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:25.804 15:48:15 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:25.804 15:48:15 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:25.804 15:48:15 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:25.804 15:48:15 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:25.804 15:48:15 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:25.804 15:48:15 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:25.804 15:48:15 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:25.804 15:48:15 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:25.804 15:48:15 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:25.804 15:48:15 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:25.804 15:48:15 -- setup/hugepages.sh@73 -- # return 0 00:04:25.804 15:48:15 -- setup/hugepages.sh@137 -- # setup output 00:04:25.804 15:48:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:25.804 15:48:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:26.743 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:27.001 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:27.001 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:27.001 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:27.001 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:27.001 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:27.001 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:27.001 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:27.001 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:27.001 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:27.001 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:27.001 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:27.001 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:27.001 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:27.001 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:27.001 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:27.944 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:27.944 15:48:17 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:27.944 15:48:17 -- setup/hugepages.sh@89 -- # local node 00:04:27.944 15:48:17 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:27.944 15:48:17 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:27.944 15:48:17 -- setup/hugepages.sh@92 -- # local surp 00:04:27.944 15:48:17 -- setup/hugepages.sh@93 -- # local resv 00:04:27.944 15:48:17 -- setup/hugepages.sh@94 -- # local anon 00:04:27.944 15:48:17 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:27.944 15:48:17 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:27.944 15:48:17 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:27.944 15:48:17 -- setup/common.sh@18 -- # local node= 00:04:27.944 15:48:17 -- setup/common.sh@19 -- # local var val 00:04:27.944 15:48:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.944 15:48:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.944 15:48:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.944 15:48:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.944 15:48:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.944 15:48:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.944 15:48:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43169872 kB' 'MemAvailable: 46920612 kB' 'Buffers: 2708 kB' 'Cached: 12785476 kB' 'SwapCached: 0 kB' 'Active: 9501468 kB' 'Inactive: 3752328 kB' 'Active(anon): 9108756 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 468812 kB' 'Mapped: 206416 kB' 'Shmem: 8643144 kB' 'KReclaimable: 198560 kB' 'Slab: 695504 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 496944 kB' 'KernelStack: 12768 kB' 'PageTables: 7924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10195124 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.944 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.944 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.945 15:48:17 -- setup/common.sh@33 -- # echo 0 00:04:27.945 15:48:17 -- setup/common.sh@33 -- # return 0 00:04:27.945 15:48:17 -- setup/hugepages.sh@97 -- # anon=0 00:04:27.945 15:48:17 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:27.945 15:48:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:27.945 15:48:17 -- setup/common.sh@18 -- # local node= 00:04:27.945 15:48:17 -- setup/common.sh@19 -- # local var val 00:04:27.945 15:48:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.945 15:48:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.945 15:48:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.945 15:48:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.945 15:48:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.945 15:48:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43171732 kB' 'MemAvailable: 46922472 kB' 'Buffers: 2708 kB' 'Cached: 12785480 kB' 'SwapCached: 0 kB' 'Active: 9500216 kB' 'Inactive: 3752328 kB' 'Active(anon): 9107504 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 467632 kB' 'Mapped: 206408 kB' 'Shmem: 8643148 kB' 'KReclaimable: 198560 kB' 'Slab: 695532 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 496972 kB' 'KernelStack: 12784 kB' 'PageTables: 8052 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10195136 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.945 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.945 15:48:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.946 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.946 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.947 15:48:17 -- setup/common.sh@33 -- # echo 0 00:04:27.947 15:48:17 -- setup/common.sh@33 -- # return 0 00:04:27.947 15:48:17 -- setup/hugepages.sh@99 -- # surp=0 00:04:27.947 15:48:17 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:27.947 15:48:17 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:27.947 15:48:17 -- setup/common.sh@18 -- # local node= 00:04:27.947 15:48:17 -- setup/common.sh@19 -- # local var val 00:04:27.947 15:48:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.947 15:48:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.947 15:48:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.947 15:48:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.947 15:48:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.947 15:48:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43171492 kB' 'MemAvailable: 46922232 kB' 'Buffers: 2708 kB' 'Cached: 12785488 kB' 'SwapCached: 0 kB' 'Active: 9500128 kB' 'Inactive: 3752328 kB' 'Active(anon): 9107416 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 467536 kB' 'Mapped: 206408 kB' 'Shmem: 8643156 kB' 'KReclaimable: 198560 kB' 'Slab: 695540 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 496980 kB' 'KernelStack: 12768 kB' 'PageTables: 8020 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10195148 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.947 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.947 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.948 15:48:17 -- setup/common.sh@32 -- # continue 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.948 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:28.210 15:48:17 -- setup/common.sh@33 -- # echo 0 00:04:28.210 15:48:17 -- setup/common.sh@33 -- # return 0 00:04:28.210 15:48:17 -- setup/hugepages.sh@100 -- # resv=0 00:04:28.210 15:48:17 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:28.210 nr_hugepages=1024 00:04:28.210 15:48:17 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:28.210 resv_hugepages=0 00:04:28.210 15:48:17 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:28.210 surplus_hugepages=0 00:04:28.210 15:48:17 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:28.210 anon_hugepages=0 00:04:28.210 15:48:17 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:28.210 15:48:17 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:28.210 15:48:17 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:28.210 15:48:17 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:28.210 15:48:17 -- setup/common.sh@18 -- # local node= 00:04:28.210 15:48:17 -- setup/common.sh@19 -- # local var val 00:04:28.210 15:48:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:28.210 15:48:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:28.210 15:48:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:28.210 15:48:17 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:28.210 15:48:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:28.210 15:48:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.210 15:48:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43171572 kB' 'MemAvailable: 46922312 kB' 'Buffers: 2708 kB' 'Cached: 12785508 kB' 'SwapCached: 0 kB' 'Active: 9500204 kB' 'Inactive: 3752328 kB' 'Active(anon): 9107492 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 467568 kB' 'Mapped: 206332 kB' 'Shmem: 8643176 kB' 'KReclaimable: 198560 kB' 'Slab: 695512 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 496952 kB' 'KernelStack: 12768 kB' 'PageTables: 8016 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10195164 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.210 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.210 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.211 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.211 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:28.212 15:48:17 -- setup/common.sh@33 -- # echo 1024 00:04:28.212 15:48:17 -- setup/common.sh@33 -- # return 0 00:04:28.212 15:48:17 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:28.212 15:48:17 -- setup/hugepages.sh@112 -- # get_nodes 00:04:28.212 15:48:17 -- setup/hugepages.sh@27 -- # local node 00:04:28.212 15:48:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:28.212 15:48:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:28.212 15:48:17 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:28.212 15:48:17 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:28.212 15:48:17 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:28.212 15:48:17 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:28.212 15:48:17 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:28.212 15:48:17 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:28.212 15:48:17 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:28.212 15:48:17 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:28.212 15:48:17 -- setup/common.sh@18 -- # local node=0 00:04:28.212 15:48:17 -- setup/common.sh@19 -- # local var val 00:04:28.212 15:48:17 -- setup/common.sh@20 -- # local mem_f mem 00:04:28.212 15:48:17 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:28.212 15:48:17 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:28.212 15:48:17 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:28.212 15:48:17 -- setup/common.sh@28 -- # mapfile -t mem 00:04:28.212 15:48:17 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 24691776 kB' 'MemUsed: 8134080 kB' 'SwapCached: 0 kB' 'Active: 4542884 kB' 'Inactive: 241128 kB' 'Active(anon): 4352604 kB' 'Inactive(anon): 0 kB' 'Active(file): 190280 kB' 'Inactive(file): 241128 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 4450640 kB' 'Mapped: 142956 kB' 'AnonPages: 336512 kB' 'Shmem: 4019232 kB' 'KernelStack: 7752 kB' 'PageTables: 4984 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99944 kB' 'Slab: 404216 kB' 'SReclaimable: 99944 kB' 'SUnreclaim: 304272 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.212 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.212 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # continue 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # IFS=': ' 00:04:28.213 15:48:17 -- setup/common.sh@31 -- # read -r var val _ 00:04:28.213 15:48:17 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:28.213 15:48:17 -- setup/common.sh@33 -- # echo 0 00:04:28.213 15:48:17 -- setup/common.sh@33 -- # return 0 00:04:28.213 15:48:17 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:28.213 15:48:17 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:28.213 15:48:17 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:28.214 15:48:17 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:28.214 15:48:17 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:28.214 node0=1024 expecting 1024 00:04:28.214 15:48:17 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:28.214 00:04:28.214 real 0m2.525s 00:04:28.214 user 0m0.719s 00:04:28.214 sys 0m0.939s 00:04:28.214 15:48:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:28.214 15:48:17 -- common/autotest_common.sh@10 -- # set +x 00:04:28.214 ************************************ 00:04:28.214 END TEST default_setup 00:04:28.214 ************************************ 00:04:28.214 15:48:17 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:28.214 15:48:17 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:28.214 15:48:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:28.214 15:48:17 -- common/autotest_common.sh@10 -- # set +x 00:04:28.214 ************************************ 00:04:28.214 START TEST per_node_1G_alloc 00:04:28.214 ************************************ 00:04:28.214 15:48:17 -- common/autotest_common.sh@1104 -- # per_node_1G_alloc 00:04:28.214 15:48:17 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:28.214 15:48:17 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:28.214 15:48:17 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:28.214 15:48:17 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:28.214 15:48:17 -- setup/hugepages.sh@51 -- # shift 00:04:28.214 15:48:17 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:28.214 15:48:17 -- setup/hugepages.sh@52 -- # local node_ids 00:04:28.214 15:48:17 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:28.214 15:48:17 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:28.214 15:48:17 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:28.214 15:48:17 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:28.214 15:48:17 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:28.214 15:48:17 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:28.214 15:48:17 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:28.214 15:48:17 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:28.214 15:48:17 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:28.214 15:48:17 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:28.214 15:48:17 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:28.214 15:48:17 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:28.214 15:48:17 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:28.214 15:48:17 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:28.214 15:48:17 -- setup/hugepages.sh@73 -- # return 0 00:04:28.214 15:48:17 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:28.214 15:48:17 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:28.214 15:48:17 -- setup/hugepages.sh@146 -- # setup output 00:04:28.214 15:48:17 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:28.214 15:48:17 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:29.659 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:29.659 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:29.659 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:29.659 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:29.659 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:29.659 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:29.659 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:29.659 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:29.659 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:29.659 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:29.659 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:29.659 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:29.659 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:29.659 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:29.659 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:29.659 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:29.659 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:29.659 15:48:19 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:29.659 15:48:19 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:29.659 15:48:19 -- setup/hugepages.sh@89 -- # local node 00:04:29.659 15:48:19 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:29.659 15:48:19 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:29.659 15:48:19 -- setup/hugepages.sh@92 -- # local surp 00:04:29.659 15:48:19 -- setup/hugepages.sh@93 -- # local resv 00:04:29.659 15:48:19 -- setup/hugepages.sh@94 -- # local anon 00:04:29.659 15:48:19 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:29.659 15:48:19 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:29.659 15:48:19 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:29.659 15:48:19 -- setup/common.sh@18 -- # local node= 00:04:29.659 15:48:19 -- setup/common.sh@19 -- # local var val 00:04:29.659 15:48:19 -- setup/common.sh@20 -- # local mem_f mem 00:04:29.659 15:48:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:29.659 15:48:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:29.659 15:48:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:29.659 15:48:19 -- setup/common.sh@28 -- # mapfile -t mem 00:04:29.659 15:48:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.659 15:48:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43186368 kB' 'MemAvailable: 46937108 kB' 'Buffers: 2708 kB' 'Cached: 12785564 kB' 'SwapCached: 0 kB' 'Active: 9506112 kB' 'Inactive: 3752328 kB' 'Active(anon): 9113400 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 473512 kB' 'Mapped: 207192 kB' 'Shmem: 8643232 kB' 'KReclaimable: 198560 kB' 'Slab: 695764 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497204 kB' 'KernelStack: 12800 kB' 'PageTables: 8100 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10201912 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198284 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.659 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.659 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:29.660 15:48:19 -- setup/common.sh@33 -- # echo 0 00:04:29.660 15:48:19 -- setup/common.sh@33 -- # return 0 00:04:29.660 15:48:19 -- setup/hugepages.sh@97 -- # anon=0 00:04:29.660 15:48:19 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:29.660 15:48:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:29.660 15:48:19 -- setup/common.sh@18 -- # local node= 00:04:29.660 15:48:19 -- setup/common.sh@19 -- # local var val 00:04:29.660 15:48:19 -- setup/common.sh@20 -- # local mem_f mem 00:04:29.660 15:48:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:29.660 15:48:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:29.660 15:48:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:29.660 15:48:19 -- setup/common.sh@28 -- # mapfile -t mem 00:04:29.660 15:48:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43194972 kB' 'MemAvailable: 46945712 kB' 'Buffers: 2708 kB' 'Cached: 12785568 kB' 'SwapCached: 0 kB' 'Active: 9500524 kB' 'Inactive: 3752328 kB' 'Active(anon): 9107812 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 467944 kB' 'Mapped: 206820 kB' 'Shmem: 8643236 kB' 'KReclaimable: 198560 kB' 'Slab: 695764 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497204 kB' 'KernelStack: 12768 kB' 'PageTables: 8004 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10195804 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.660 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.660 15:48:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.661 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.661 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.662 15:48:19 -- setup/common.sh@33 -- # echo 0 00:04:29.662 15:48:19 -- setup/common.sh@33 -- # return 0 00:04:29.662 15:48:19 -- setup/hugepages.sh@99 -- # surp=0 00:04:29.662 15:48:19 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:29.662 15:48:19 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:29.662 15:48:19 -- setup/common.sh@18 -- # local node= 00:04:29.662 15:48:19 -- setup/common.sh@19 -- # local var val 00:04:29.662 15:48:19 -- setup/common.sh@20 -- # local mem_f mem 00:04:29.662 15:48:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:29.662 15:48:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:29.662 15:48:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:29.662 15:48:19 -- setup/common.sh@28 -- # mapfile -t mem 00:04:29.662 15:48:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43194136 kB' 'MemAvailable: 46944876 kB' 'Buffers: 2708 kB' 'Cached: 12785580 kB' 'SwapCached: 0 kB' 'Active: 9500412 kB' 'Inactive: 3752328 kB' 'Active(anon): 9107700 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 467780 kB' 'Mapped: 206344 kB' 'Shmem: 8643248 kB' 'KReclaimable: 198560 kB' 'Slab: 695772 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497212 kB' 'KernelStack: 12800 kB' 'PageTables: 7992 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10195820 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198232 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.662 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.662 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:29.663 15:48:19 -- setup/common.sh@33 -- # echo 0 00:04:29.663 15:48:19 -- setup/common.sh@33 -- # return 0 00:04:29.663 15:48:19 -- setup/hugepages.sh@100 -- # resv=0 00:04:29.663 15:48:19 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:29.663 nr_hugepages=1024 00:04:29.663 15:48:19 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:29.663 resv_hugepages=0 00:04:29.663 15:48:19 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:29.663 surplus_hugepages=0 00:04:29.663 15:48:19 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:29.663 anon_hugepages=0 00:04:29.663 15:48:19 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:29.663 15:48:19 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:29.663 15:48:19 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:29.663 15:48:19 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:29.663 15:48:19 -- setup/common.sh@18 -- # local node= 00:04:29.663 15:48:19 -- setup/common.sh@19 -- # local var val 00:04:29.663 15:48:19 -- setup/common.sh@20 -- # local mem_f mem 00:04:29.663 15:48:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:29.663 15:48:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:29.663 15:48:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:29.663 15:48:19 -- setup/common.sh@28 -- # mapfile -t mem 00:04:29.663 15:48:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43194136 kB' 'MemAvailable: 46944876 kB' 'Buffers: 2708 kB' 'Cached: 12785592 kB' 'SwapCached: 0 kB' 'Active: 9500644 kB' 'Inactive: 3752328 kB' 'Active(anon): 9107932 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 468020 kB' 'Mapped: 206344 kB' 'Shmem: 8643260 kB' 'KReclaimable: 198560 kB' 'Slab: 695876 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497316 kB' 'KernelStack: 12816 kB' 'PageTables: 8048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10195832 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.663 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.663 15:48:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.664 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.664 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:29.665 15:48:19 -- setup/common.sh@33 -- # echo 1024 00:04:29.665 15:48:19 -- setup/common.sh@33 -- # return 0 00:04:29.665 15:48:19 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:29.665 15:48:19 -- setup/hugepages.sh@112 -- # get_nodes 00:04:29.665 15:48:19 -- setup/hugepages.sh@27 -- # local node 00:04:29.665 15:48:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:29.665 15:48:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:29.665 15:48:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:29.665 15:48:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:29.665 15:48:19 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:29.665 15:48:19 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:29.665 15:48:19 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:29.665 15:48:19 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:29.665 15:48:19 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:29.665 15:48:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:29.665 15:48:19 -- setup/common.sh@18 -- # local node=0 00:04:29.665 15:48:19 -- setup/common.sh@19 -- # local var val 00:04:29.665 15:48:19 -- setup/common.sh@20 -- # local mem_f mem 00:04:29.665 15:48:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:29.665 15:48:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:29.665 15:48:19 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:29.665 15:48:19 -- setup/common.sh@28 -- # mapfile -t mem 00:04:29.665 15:48:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 25757340 kB' 'MemUsed: 7068516 kB' 'SwapCached: 0 kB' 'Active: 4543760 kB' 'Inactive: 241128 kB' 'Active(anon): 4353480 kB' 'Inactive(anon): 0 kB' 'Active(file): 190280 kB' 'Inactive(file): 241128 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 4450652 kB' 'Mapped: 142956 kB' 'AnonPages: 337456 kB' 'Shmem: 4019244 kB' 'KernelStack: 7752 kB' 'PageTables: 4976 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99944 kB' 'Slab: 404220 kB' 'SReclaimable: 99944 kB' 'SUnreclaim: 304276 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.665 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.665 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@33 -- # echo 0 00:04:29.666 15:48:19 -- setup/common.sh@33 -- # return 0 00:04:29.666 15:48:19 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:29.666 15:48:19 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:29.666 15:48:19 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:29.666 15:48:19 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:29.666 15:48:19 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:29.666 15:48:19 -- setup/common.sh@18 -- # local node=1 00:04:29.666 15:48:19 -- setup/common.sh@19 -- # local var val 00:04:29.666 15:48:19 -- setup/common.sh@20 -- # local mem_f mem 00:04:29.666 15:48:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:29.666 15:48:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:29.666 15:48:19 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:29.666 15:48:19 -- setup/common.sh@28 -- # mapfile -t mem 00:04:29.666 15:48:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709816 kB' 'MemFree: 17437048 kB' 'MemUsed: 10272768 kB' 'SwapCached: 0 kB' 'Active: 4956848 kB' 'Inactive: 3511200 kB' 'Active(anon): 4754416 kB' 'Inactive(anon): 0 kB' 'Active(file): 202432 kB' 'Inactive(file): 3511200 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8337676 kB' 'Mapped: 63388 kB' 'AnonPages: 130564 kB' 'Shmem: 4624044 kB' 'KernelStack: 5064 kB' 'PageTables: 3072 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98616 kB' 'Slab: 291656 kB' 'SReclaimable: 98616 kB' 'SUnreclaim: 193040 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.666 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.666 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.667 15:48:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.667 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.667 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.667 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.667 15:48:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.667 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.667 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.667 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.667 15:48:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.667 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.667 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.667 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.667 15:48:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.667 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.667 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.667 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.667 15:48:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.667 15:48:19 -- setup/common.sh@32 -- # continue 00:04:29.667 15:48:19 -- setup/common.sh@31 -- # IFS=': ' 00:04:29.667 15:48:19 -- setup/common.sh@31 -- # read -r var val _ 00:04:29.667 15:48:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:29.667 15:48:19 -- setup/common.sh@33 -- # echo 0 00:04:29.667 15:48:19 -- setup/common.sh@33 -- # return 0 00:04:29.667 15:48:19 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:29.667 15:48:19 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:29.667 15:48:19 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:29.667 15:48:19 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:29.667 15:48:19 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:29.667 node0=512 expecting 512 00:04:29.667 15:48:19 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:29.667 15:48:19 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:29.667 15:48:19 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:29.667 15:48:19 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:29.667 node1=512 expecting 512 00:04:29.667 15:48:19 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:29.667 00:04:29.667 real 0m1.521s 00:04:29.667 user 0m0.615s 00:04:29.667 sys 0m0.874s 00:04:29.667 15:48:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:29.667 15:48:19 -- common/autotest_common.sh@10 -- # set +x 00:04:29.667 ************************************ 00:04:29.667 END TEST per_node_1G_alloc 00:04:29.667 ************************************ 00:04:29.667 15:48:19 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:29.667 15:48:19 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:29.667 15:48:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:29.667 15:48:19 -- common/autotest_common.sh@10 -- # set +x 00:04:29.667 ************************************ 00:04:29.667 START TEST even_2G_alloc 00:04:29.667 ************************************ 00:04:29.667 15:48:19 -- common/autotest_common.sh@1104 -- # even_2G_alloc 00:04:29.667 15:48:19 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:29.667 15:48:19 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:29.667 15:48:19 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:29.667 15:48:19 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:29.667 15:48:19 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:29.667 15:48:19 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:29.667 15:48:19 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:29.667 15:48:19 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:29.667 15:48:19 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:29.667 15:48:19 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:29.667 15:48:19 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:29.667 15:48:19 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:29.667 15:48:19 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:29.667 15:48:19 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:29.667 15:48:19 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:29.667 15:48:19 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:29.667 15:48:19 -- setup/hugepages.sh@83 -- # : 512 00:04:29.667 15:48:19 -- setup/hugepages.sh@84 -- # : 1 00:04:29.667 15:48:19 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:29.667 15:48:19 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:29.667 15:48:19 -- setup/hugepages.sh@83 -- # : 0 00:04:29.667 15:48:19 -- setup/hugepages.sh@84 -- # : 0 00:04:29.667 15:48:19 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:29.667 15:48:19 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:29.667 15:48:19 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:29.667 15:48:19 -- setup/hugepages.sh@153 -- # setup output 00:04:29.667 15:48:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:29.667 15:48:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:31.050 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:31.050 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:31.050 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:31.050 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:31.050 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:31.050 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:31.050 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:31.050 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:31.050 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:31.050 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:31.050 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:31.050 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:31.050 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:31.050 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:31.050 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:31.050 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:31.050 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:31.050 15:48:20 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:31.050 15:48:20 -- setup/hugepages.sh@89 -- # local node 00:04:31.050 15:48:20 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:31.050 15:48:20 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:31.050 15:48:20 -- setup/hugepages.sh@92 -- # local surp 00:04:31.050 15:48:20 -- setup/hugepages.sh@93 -- # local resv 00:04:31.050 15:48:20 -- setup/hugepages.sh@94 -- # local anon 00:04:31.050 15:48:20 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:31.050 15:48:20 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:31.050 15:48:20 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:31.050 15:48:20 -- setup/common.sh@18 -- # local node= 00:04:31.050 15:48:20 -- setup/common.sh@19 -- # local var val 00:04:31.050 15:48:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:31.050 15:48:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:31.050 15:48:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:31.050 15:48:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:31.050 15:48:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:31.050 15:48:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:31.050 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.050 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.050 15:48:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43196840 kB' 'MemAvailable: 46947584 kB' 'Buffers: 2708 kB' 'Cached: 12785656 kB' 'SwapCached: 0 kB' 'Active: 9500176 kB' 'Inactive: 3752328 kB' 'Active(anon): 9107464 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 467352 kB' 'Mapped: 206404 kB' 'Shmem: 8643324 kB' 'KReclaimable: 198568 kB' 'Slab: 696052 kB' 'SReclaimable: 198568 kB' 'SUnreclaim: 497484 kB' 'KernelStack: 12816 kB' 'PageTables: 8056 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10196016 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:31.050 15:48:20 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.050 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.050 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.050 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.050 15:48:20 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.050 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.050 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.050 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.050 15:48:20 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.050 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.050 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.050 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.050 15:48:20 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.051 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.051 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:31.052 15:48:20 -- setup/common.sh@33 -- # echo 0 00:04:31.052 15:48:20 -- setup/common.sh@33 -- # return 0 00:04:31.052 15:48:20 -- setup/hugepages.sh@97 -- # anon=0 00:04:31.052 15:48:20 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:31.052 15:48:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:31.052 15:48:20 -- setup/common.sh@18 -- # local node= 00:04:31.052 15:48:20 -- setup/common.sh@19 -- # local var val 00:04:31.052 15:48:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:31.052 15:48:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:31.052 15:48:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:31.052 15:48:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:31.052 15:48:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:31.052 15:48:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43197516 kB' 'MemAvailable: 46948260 kB' 'Buffers: 2708 kB' 'Cached: 12785660 kB' 'SwapCached: 0 kB' 'Active: 9500108 kB' 'Inactive: 3752328 kB' 'Active(anon): 9107396 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 467256 kB' 'Mapped: 206404 kB' 'Shmem: 8643328 kB' 'KReclaimable: 198568 kB' 'Slab: 696052 kB' 'SReclaimable: 198568 kB' 'SUnreclaim: 497484 kB' 'KernelStack: 12752 kB' 'PageTables: 7864 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10196028 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.052 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.052 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.053 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.053 15:48:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.053 15:48:20 -- setup/common.sh@33 -- # echo 0 00:04:31.053 15:48:20 -- setup/common.sh@33 -- # return 0 00:04:31.053 15:48:20 -- setup/hugepages.sh@99 -- # surp=0 00:04:31.053 15:48:20 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:31.053 15:48:20 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:31.053 15:48:20 -- setup/common.sh@18 -- # local node= 00:04:31.053 15:48:20 -- setup/common.sh@19 -- # local var val 00:04:31.053 15:48:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:31.053 15:48:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:31.053 15:48:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:31.054 15:48:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:31.054 15:48:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:31.054 15:48:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43197620 kB' 'MemAvailable: 46948364 kB' 'Buffers: 2708 kB' 'Cached: 12785672 kB' 'SwapCached: 0 kB' 'Active: 9499864 kB' 'Inactive: 3752328 kB' 'Active(anon): 9107152 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 466992 kB' 'Mapped: 206344 kB' 'Shmem: 8643340 kB' 'KReclaimable: 198568 kB' 'Slab: 696124 kB' 'SReclaimable: 198568 kB' 'SUnreclaim: 497556 kB' 'KernelStack: 12800 kB' 'PageTables: 7952 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10196044 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.054 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.054 15:48:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.055 15:48:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:31.055 15:48:20 -- setup/common.sh@33 -- # echo 0 00:04:31.055 15:48:20 -- setup/common.sh@33 -- # return 0 00:04:31.055 15:48:20 -- setup/hugepages.sh@100 -- # resv=0 00:04:31.055 15:48:20 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:31.055 nr_hugepages=1024 00:04:31.055 15:48:20 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:31.055 resv_hugepages=0 00:04:31.055 15:48:20 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:31.055 surplus_hugepages=0 00:04:31.055 15:48:20 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:31.055 anon_hugepages=0 00:04:31.055 15:48:20 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:31.055 15:48:20 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:31.055 15:48:20 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:31.055 15:48:20 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:31.055 15:48:20 -- setup/common.sh@18 -- # local node= 00:04:31.055 15:48:20 -- setup/common.sh@19 -- # local var val 00:04:31.055 15:48:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:31.055 15:48:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:31.055 15:48:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:31.055 15:48:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:31.055 15:48:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:31.055 15:48:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.055 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43198296 kB' 'MemAvailable: 46949040 kB' 'Buffers: 2708 kB' 'Cached: 12785684 kB' 'SwapCached: 0 kB' 'Active: 9499916 kB' 'Inactive: 3752328 kB' 'Active(anon): 9107204 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 467068 kB' 'Mapped: 206344 kB' 'Shmem: 8643352 kB' 'KReclaimable: 198568 kB' 'Slab: 696124 kB' 'SReclaimable: 198568 kB' 'SUnreclaim: 497556 kB' 'KernelStack: 12832 kB' 'PageTables: 8048 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10196060 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.056 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.056 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.057 15:48:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:31.057 15:48:20 -- setup/common.sh@33 -- # echo 1024 00:04:31.057 15:48:20 -- setup/common.sh@33 -- # return 0 00:04:31.057 15:48:20 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:31.057 15:48:20 -- setup/hugepages.sh@112 -- # get_nodes 00:04:31.057 15:48:20 -- setup/hugepages.sh@27 -- # local node 00:04:31.057 15:48:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:31.057 15:48:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:31.057 15:48:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:31.057 15:48:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:31.057 15:48:20 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:31.057 15:48:20 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:31.057 15:48:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:31.057 15:48:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:31.057 15:48:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:31.057 15:48:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:31.057 15:48:20 -- setup/common.sh@18 -- # local node=0 00:04:31.057 15:48:20 -- setup/common.sh@19 -- # local var val 00:04:31.057 15:48:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:31.057 15:48:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:31.057 15:48:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:31.057 15:48:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:31.057 15:48:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:31.057 15:48:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.057 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 25754324 kB' 'MemUsed: 7071532 kB' 'SwapCached: 0 kB' 'Active: 4544200 kB' 'Inactive: 241128 kB' 'Active(anon): 4353920 kB' 'Inactive(anon): 0 kB' 'Active(file): 190280 kB' 'Inactive(file): 241128 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 4450664 kB' 'Mapped: 142956 kB' 'AnonPages: 337832 kB' 'Shmem: 4019256 kB' 'KernelStack: 7768 kB' 'PageTables: 5068 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99952 kB' 'Slab: 404348 kB' 'SReclaimable: 99952 kB' 'SUnreclaim: 304396 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.058 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.058 15:48:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.318 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.318 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@33 -- # echo 0 00:04:31.319 15:48:20 -- setup/common.sh@33 -- # return 0 00:04:31.319 15:48:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:31.319 15:48:20 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:31.319 15:48:20 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:31.319 15:48:20 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:31.319 15:48:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:31.319 15:48:20 -- setup/common.sh@18 -- # local node=1 00:04:31.319 15:48:20 -- setup/common.sh@19 -- # local var val 00:04:31.319 15:48:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:31.319 15:48:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:31.319 15:48:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:31.319 15:48:20 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:31.319 15:48:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:31.319 15:48:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709816 kB' 'MemFree: 17445556 kB' 'MemUsed: 10264260 kB' 'SwapCached: 0 kB' 'Active: 4955720 kB' 'Inactive: 3511200 kB' 'Active(anon): 4753288 kB' 'Inactive(anon): 0 kB' 'Active(file): 202432 kB' 'Inactive(file): 3511200 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8337764 kB' 'Mapped: 63388 kB' 'AnonPages: 129236 kB' 'Shmem: 4624132 kB' 'KernelStack: 5064 kB' 'PageTables: 2980 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98616 kB' 'Slab: 291776 kB' 'SReclaimable: 98616 kB' 'SUnreclaim: 193160 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.319 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.319 15:48:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # continue 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:31.320 15:48:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:31.320 15:48:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:31.320 15:48:20 -- setup/common.sh@33 -- # echo 0 00:04:31.320 15:48:20 -- setup/common.sh@33 -- # return 0 00:04:31.320 15:48:20 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:31.320 15:48:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:31.320 15:48:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:31.320 15:48:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:31.320 15:48:20 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:31.320 node0=512 expecting 512 00:04:31.320 15:48:20 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:31.320 15:48:20 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:31.320 15:48:20 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:31.320 15:48:20 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:31.320 node1=512 expecting 512 00:04:31.320 15:48:20 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:31.320 00:04:31.320 real 0m1.505s 00:04:31.320 user 0m0.619s 00:04:31.320 sys 0m0.853s 00:04:31.320 15:48:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:31.320 15:48:20 -- common/autotest_common.sh@10 -- # set +x 00:04:31.320 ************************************ 00:04:31.320 END TEST even_2G_alloc 00:04:31.320 ************************************ 00:04:31.320 15:48:20 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:31.320 15:48:20 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:31.320 15:48:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:31.320 15:48:20 -- common/autotest_common.sh@10 -- # set +x 00:04:31.320 ************************************ 00:04:31.320 START TEST odd_alloc 00:04:31.320 ************************************ 00:04:31.320 15:48:20 -- common/autotest_common.sh@1104 -- # odd_alloc 00:04:31.320 15:48:20 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:31.320 15:48:20 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:31.320 15:48:20 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:31.320 15:48:20 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:31.320 15:48:20 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:31.320 15:48:20 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:31.320 15:48:20 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:31.320 15:48:20 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:31.320 15:48:20 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:31.320 15:48:20 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:31.320 15:48:20 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:31.320 15:48:20 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:31.320 15:48:20 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:31.320 15:48:20 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:31.320 15:48:20 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:31.320 15:48:20 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:31.320 15:48:20 -- setup/hugepages.sh@83 -- # : 513 00:04:31.320 15:48:20 -- setup/hugepages.sh@84 -- # : 1 00:04:31.320 15:48:20 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:31.320 15:48:20 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:31.320 15:48:20 -- setup/hugepages.sh@83 -- # : 0 00:04:31.320 15:48:20 -- setup/hugepages.sh@84 -- # : 0 00:04:31.320 15:48:20 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:31.320 15:48:20 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:31.320 15:48:20 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:31.320 15:48:20 -- setup/hugepages.sh@160 -- # setup output 00:04:31.320 15:48:20 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:31.320 15:48:20 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:32.705 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:32.705 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:32.705 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:32.705 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:32.705 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:32.705 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:32.705 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:32.705 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:32.705 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:32.705 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:32.705 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:32.705 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:32.705 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:32.705 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:32.705 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:32.705 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:32.705 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:32.705 15:48:22 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:32.705 15:48:22 -- setup/hugepages.sh@89 -- # local node 00:04:32.705 15:48:22 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:32.705 15:48:22 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:32.705 15:48:22 -- setup/hugepages.sh@92 -- # local surp 00:04:32.705 15:48:22 -- setup/hugepages.sh@93 -- # local resv 00:04:32.705 15:48:22 -- setup/hugepages.sh@94 -- # local anon 00:04:32.705 15:48:22 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:32.705 15:48:22 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:32.705 15:48:22 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:32.705 15:48:22 -- setup/common.sh@18 -- # local node= 00:04:32.705 15:48:22 -- setup/common.sh@19 -- # local var val 00:04:32.705 15:48:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:32.705 15:48:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:32.705 15:48:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:32.705 15:48:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:32.705 15:48:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:32.705 15:48:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.705 15:48:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43203380 kB' 'MemAvailable: 46954120 kB' 'Buffers: 2708 kB' 'Cached: 12785748 kB' 'SwapCached: 0 kB' 'Active: 9497836 kB' 'Inactive: 3752328 kB' 'Active(anon): 9105124 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 464944 kB' 'Mapped: 205280 kB' 'Shmem: 8643416 kB' 'KReclaimable: 198560 kB' 'Slab: 695852 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497292 kB' 'KernelStack: 12736 kB' 'PageTables: 7612 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 10183920 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.705 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.705 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:32.706 15:48:22 -- setup/common.sh@33 -- # echo 0 00:04:32.706 15:48:22 -- setup/common.sh@33 -- # return 0 00:04:32.706 15:48:22 -- setup/hugepages.sh@97 -- # anon=0 00:04:32.706 15:48:22 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:32.706 15:48:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:32.706 15:48:22 -- setup/common.sh@18 -- # local node= 00:04:32.706 15:48:22 -- setup/common.sh@19 -- # local var val 00:04:32.706 15:48:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:32.706 15:48:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:32.706 15:48:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:32.706 15:48:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:32.706 15:48:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:32.706 15:48:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43204860 kB' 'MemAvailable: 46955600 kB' 'Buffers: 2708 kB' 'Cached: 12785752 kB' 'SwapCached: 0 kB' 'Active: 9498424 kB' 'Inactive: 3752328 kB' 'Active(anon): 9105712 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465620 kB' 'Mapped: 205348 kB' 'Shmem: 8643420 kB' 'KReclaimable: 198560 kB' 'Slab: 695932 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497372 kB' 'KernelStack: 12784 kB' 'PageTables: 7764 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 10183932 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.706 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.706 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.707 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.707 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.708 15:48:22 -- setup/common.sh@33 -- # echo 0 00:04:32.708 15:48:22 -- setup/common.sh@33 -- # return 0 00:04:32.708 15:48:22 -- setup/hugepages.sh@99 -- # surp=0 00:04:32.708 15:48:22 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:32.708 15:48:22 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:32.708 15:48:22 -- setup/common.sh@18 -- # local node= 00:04:32.708 15:48:22 -- setup/common.sh@19 -- # local var val 00:04:32.708 15:48:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:32.708 15:48:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:32.708 15:48:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:32.708 15:48:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:32.708 15:48:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:32.708 15:48:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43205152 kB' 'MemAvailable: 46955892 kB' 'Buffers: 2708 kB' 'Cached: 12785760 kB' 'SwapCached: 0 kB' 'Active: 9497856 kB' 'Inactive: 3752328 kB' 'Active(anon): 9105144 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 464976 kB' 'Mapped: 205348 kB' 'Shmem: 8643428 kB' 'KReclaimable: 198560 kB' 'Slab: 695932 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497372 kB' 'KernelStack: 12784 kB' 'PageTables: 7716 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 10183944 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.708 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.708 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:32.709 15:48:22 -- setup/common.sh@33 -- # echo 0 00:04:32.709 15:48:22 -- setup/common.sh@33 -- # return 0 00:04:32.709 15:48:22 -- setup/hugepages.sh@100 -- # resv=0 00:04:32.709 15:48:22 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:32.709 nr_hugepages=1025 00:04:32.709 15:48:22 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:32.709 resv_hugepages=0 00:04:32.709 15:48:22 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:32.709 surplus_hugepages=0 00:04:32.709 15:48:22 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:32.709 anon_hugepages=0 00:04:32.709 15:48:22 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:32.709 15:48:22 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:32.709 15:48:22 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:32.709 15:48:22 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:32.709 15:48:22 -- setup/common.sh@18 -- # local node= 00:04:32.709 15:48:22 -- setup/common.sh@19 -- # local var val 00:04:32.709 15:48:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:32.709 15:48:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:32.709 15:48:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:32.709 15:48:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:32.709 15:48:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:32.709 15:48:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43205564 kB' 'MemAvailable: 46956304 kB' 'Buffers: 2708 kB' 'Cached: 12785780 kB' 'SwapCached: 0 kB' 'Active: 9498040 kB' 'Inactive: 3752328 kB' 'Active(anon): 9105328 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465168 kB' 'Mapped: 205272 kB' 'Shmem: 8643448 kB' 'KReclaimable: 198560 kB' 'Slab: 695948 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497388 kB' 'KernelStack: 12784 kB' 'PageTables: 7712 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 10183960 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.709 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.709 15:48:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.710 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.710 15:48:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:32.710 15:48:22 -- setup/common.sh@33 -- # echo 1025 00:04:32.710 15:48:22 -- setup/common.sh@33 -- # return 0 00:04:32.710 15:48:22 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:32.710 15:48:22 -- setup/hugepages.sh@112 -- # get_nodes 00:04:32.710 15:48:22 -- setup/hugepages.sh@27 -- # local node 00:04:32.710 15:48:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:32.710 15:48:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:32.710 15:48:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:32.710 15:48:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:32.710 15:48:22 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:32.710 15:48:22 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:32.710 15:48:22 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:32.710 15:48:22 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:32.710 15:48:22 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:32.710 15:48:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:32.710 15:48:22 -- setup/common.sh@18 -- # local node=0 00:04:32.710 15:48:22 -- setup/common.sh@19 -- # local var val 00:04:32.710 15:48:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:32.710 15:48:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:32.710 15:48:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:32.711 15:48:22 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:32.711 15:48:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:32.711 15:48:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 25745664 kB' 'MemUsed: 7080192 kB' 'SwapCached: 0 kB' 'Active: 4541836 kB' 'Inactive: 241128 kB' 'Active(anon): 4351556 kB' 'Inactive(anon): 0 kB' 'Active(file): 190280 kB' 'Inactive(file): 241128 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 4450668 kB' 'Mapped: 142840 kB' 'AnonPages: 335444 kB' 'Shmem: 4019260 kB' 'KernelStack: 7688 kB' 'PageTables: 4620 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99952 kB' 'Slab: 404268 kB' 'SReclaimable: 99952 kB' 'SUnreclaim: 304316 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.711 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.711 15:48:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.711 15:48:22 -- setup/common.sh@33 -- # echo 0 00:04:32.711 15:48:22 -- setup/common.sh@33 -- # return 0 00:04:32.711 15:48:22 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:32.711 15:48:22 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:32.711 15:48:22 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:32.711 15:48:22 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:32.711 15:48:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:32.711 15:48:22 -- setup/common.sh@18 -- # local node=1 00:04:32.711 15:48:22 -- setup/common.sh@19 -- # local var val 00:04:32.711 15:48:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:32.711 15:48:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:32.711 15:48:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:32.712 15:48:22 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:32.712 15:48:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:32.712 15:48:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709816 kB' 'MemFree: 17459144 kB' 'MemUsed: 10250672 kB' 'SwapCached: 0 kB' 'Active: 4956256 kB' 'Inactive: 3511200 kB' 'Active(anon): 4753824 kB' 'Inactive(anon): 0 kB' 'Active(file): 202432 kB' 'Inactive(file): 3511200 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8337848 kB' 'Mapped: 62432 kB' 'AnonPages: 129716 kB' 'Shmem: 4624216 kB' 'KernelStack: 5096 kB' 'PageTables: 3092 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98608 kB' 'Slab: 291680 kB' 'SReclaimable: 98608 kB' 'SUnreclaim: 193072 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # continue 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:32.712 15:48:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:32.712 15:48:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:32.712 15:48:22 -- setup/common.sh@33 -- # echo 0 00:04:32.712 15:48:22 -- setup/common.sh@33 -- # return 0 00:04:32.712 15:48:22 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:32.712 15:48:22 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:32.712 15:48:22 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:32.712 15:48:22 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:32.712 15:48:22 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:32.712 node0=512 expecting 513 00:04:32.712 15:48:22 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:32.712 15:48:22 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:32.712 15:48:22 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:32.713 15:48:22 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:32.713 node1=513 expecting 512 00:04:32.713 15:48:22 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:32.713 00:04:32.713 real 0m1.546s 00:04:32.713 user 0m0.618s 00:04:32.713 sys 0m0.895s 00:04:32.713 15:48:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:32.713 15:48:22 -- common/autotest_common.sh@10 -- # set +x 00:04:32.713 ************************************ 00:04:32.713 END TEST odd_alloc 00:04:32.713 ************************************ 00:04:32.713 15:48:22 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:32.713 15:48:22 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:32.713 15:48:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:32.713 15:48:22 -- common/autotest_common.sh@10 -- # set +x 00:04:32.713 ************************************ 00:04:32.713 START TEST custom_alloc 00:04:32.713 ************************************ 00:04:32.713 15:48:22 -- common/autotest_common.sh@1104 -- # custom_alloc 00:04:32.713 15:48:22 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:32.713 15:48:22 -- setup/hugepages.sh@169 -- # local node 00:04:32.713 15:48:22 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:32.713 15:48:22 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:32.713 15:48:22 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:32.713 15:48:22 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:32.713 15:48:22 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:32.713 15:48:22 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:32.713 15:48:22 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:32.713 15:48:22 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:32.713 15:48:22 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:32.713 15:48:22 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:32.713 15:48:22 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:32.713 15:48:22 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:32.713 15:48:22 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:32.713 15:48:22 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:32.713 15:48:22 -- setup/hugepages.sh@83 -- # : 256 00:04:32.713 15:48:22 -- setup/hugepages.sh@84 -- # : 1 00:04:32.713 15:48:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:32.713 15:48:22 -- setup/hugepages.sh@83 -- # : 0 00:04:32.713 15:48:22 -- setup/hugepages.sh@84 -- # : 0 00:04:32.713 15:48:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:32.713 15:48:22 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:32.713 15:48:22 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:32.713 15:48:22 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:32.713 15:48:22 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:32.713 15:48:22 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:32.713 15:48:22 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:32.713 15:48:22 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:32.713 15:48:22 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:32.713 15:48:22 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:32.713 15:48:22 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:32.713 15:48:22 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:32.713 15:48:22 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:32.713 15:48:22 -- setup/hugepages.sh@78 -- # return 0 00:04:32.713 15:48:22 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:32.713 15:48:22 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:32.713 15:48:22 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:32.713 15:48:22 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:32.713 15:48:22 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:32.713 15:48:22 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:32.713 15:48:22 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:32.713 15:48:22 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:32.713 15:48:22 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:32.713 15:48:22 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:32.713 15:48:22 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:32.713 15:48:22 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:32.713 15:48:22 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:32.713 15:48:22 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:32.713 15:48:22 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:32.713 15:48:22 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:32.713 15:48:22 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:32.713 15:48:22 -- setup/hugepages.sh@78 -- # return 0 00:04:32.713 15:48:22 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:32.713 15:48:22 -- setup/hugepages.sh@187 -- # setup output 00:04:32.713 15:48:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:32.713 15:48:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:34.098 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:34.098 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:34.098 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:34.098 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:34.098 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:34.098 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:34.098 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:34.098 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:34.098 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:34.098 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:34.098 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:34.098 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:34.098 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:34.098 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:34.098 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:34.098 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:34.098 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:34.098 15:48:23 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:34.098 15:48:23 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:34.098 15:48:23 -- setup/hugepages.sh@89 -- # local node 00:04:34.098 15:48:23 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:34.098 15:48:23 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:34.098 15:48:23 -- setup/hugepages.sh@92 -- # local surp 00:04:34.098 15:48:23 -- setup/hugepages.sh@93 -- # local resv 00:04:34.098 15:48:23 -- setup/hugepages.sh@94 -- # local anon 00:04:34.098 15:48:23 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:34.098 15:48:23 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:34.098 15:48:23 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:34.098 15:48:23 -- setup/common.sh@18 -- # local node= 00:04:34.098 15:48:23 -- setup/common.sh@19 -- # local var val 00:04:34.098 15:48:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.098 15:48:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.098 15:48:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:34.098 15:48:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:34.098 15:48:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.098 15:48:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.098 15:48:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42157076 kB' 'MemAvailable: 45907816 kB' 'Buffers: 2708 kB' 'Cached: 12785848 kB' 'SwapCached: 0 kB' 'Active: 9498296 kB' 'Inactive: 3752328 kB' 'Active(anon): 9105584 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465232 kB' 'Mapped: 205296 kB' 'Shmem: 8643516 kB' 'KReclaimable: 198560 kB' 'Slab: 695788 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497228 kB' 'KernelStack: 12752 kB' 'PageTables: 7564 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 10184148 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.098 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.098 15:48:23 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:34.099 15:48:23 -- setup/common.sh@33 -- # echo 0 00:04:34.099 15:48:23 -- setup/common.sh@33 -- # return 0 00:04:34.099 15:48:23 -- setup/hugepages.sh@97 -- # anon=0 00:04:34.099 15:48:23 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:34.099 15:48:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:34.099 15:48:23 -- setup/common.sh@18 -- # local node= 00:04:34.099 15:48:23 -- setup/common.sh@19 -- # local var val 00:04:34.099 15:48:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.099 15:48:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.099 15:48:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:34.099 15:48:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:34.099 15:48:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.099 15:48:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42162456 kB' 'MemAvailable: 45913196 kB' 'Buffers: 2708 kB' 'Cached: 12785860 kB' 'SwapCached: 0 kB' 'Active: 9498264 kB' 'Inactive: 3752328 kB' 'Active(anon): 9105552 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465248 kB' 'Mapped: 205280 kB' 'Shmem: 8643528 kB' 'KReclaimable: 198560 kB' 'Slab: 695844 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497284 kB' 'KernelStack: 12800 kB' 'PageTables: 7656 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 10184160 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.099 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.099 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.100 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.100 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.101 15:48:23 -- setup/common.sh@33 -- # echo 0 00:04:34.101 15:48:23 -- setup/common.sh@33 -- # return 0 00:04:34.101 15:48:23 -- setup/hugepages.sh@99 -- # surp=0 00:04:34.101 15:48:23 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:34.101 15:48:23 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:34.101 15:48:23 -- setup/common.sh@18 -- # local node= 00:04:34.101 15:48:23 -- setup/common.sh@19 -- # local var val 00:04:34.101 15:48:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.101 15:48:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.101 15:48:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:34.101 15:48:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:34.101 15:48:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.101 15:48:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42162456 kB' 'MemAvailable: 45913196 kB' 'Buffers: 2708 kB' 'Cached: 12785864 kB' 'SwapCached: 0 kB' 'Active: 9498236 kB' 'Inactive: 3752328 kB' 'Active(anon): 9105524 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465268 kB' 'Mapped: 205280 kB' 'Shmem: 8643532 kB' 'KReclaimable: 198560 kB' 'Slab: 695844 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497284 kB' 'KernelStack: 12816 kB' 'PageTables: 7704 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 10184176 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.101 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.101 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.364 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.364 15:48:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:34.364 15:48:23 -- setup/common.sh@33 -- # echo 0 00:04:34.364 15:48:23 -- setup/common.sh@33 -- # return 0 00:04:34.364 15:48:23 -- setup/hugepages.sh@100 -- # resv=0 00:04:34.364 15:48:23 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:34.364 nr_hugepages=1536 00:04:34.364 15:48:23 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:34.364 resv_hugepages=0 00:04:34.365 15:48:23 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:34.365 surplus_hugepages=0 00:04:34.365 15:48:23 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:34.365 anon_hugepages=0 00:04:34.365 15:48:23 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:34.365 15:48:23 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:34.365 15:48:23 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:34.365 15:48:23 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:34.365 15:48:23 -- setup/common.sh@18 -- # local node= 00:04:34.365 15:48:23 -- setup/common.sh@19 -- # local var val 00:04:34.365 15:48:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.365 15:48:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.365 15:48:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:34.365 15:48:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:34.365 15:48:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.365 15:48:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42162780 kB' 'MemAvailable: 45913520 kB' 'Buffers: 2708 kB' 'Cached: 12785864 kB' 'SwapCached: 0 kB' 'Active: 9497924 kB' 'Inactive: 3752328 kB' 'Active(anon): 9105212 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 464956 kB' 'Mapped: 205280 kB' 'Shmem: 8643532 kB' 'KReclaimable: 198560 kB' 'Slab: 695844 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497284 kB' 'KernelStack: 12800 kB' 'PageTables: 7656 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 10184192 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:23 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.365 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.365 15:48:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:34.366 15:48:24 -- setup/common.sh@33 -- # echo 1536 00:04:34.366 15:48:24 -- setup/common.sh@33 -- # return 0 00:04:34.366 15:48:24 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:34.366 15:48:24 -- setup/hugepages.sh@112 -- # get_nodes 00:04:34.366 15:48:24 -- setup/hugepages.sh@27 -- # local node 00:04:34.366 15:48:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:34.366 15:48:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:34.366 15:48:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:34.366 15:48:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:34.366 15:48:24 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:34.366 15:48:24 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:34.366 15:48:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:34.366 15:48:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:34.366 15:48:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:34.366 15:48:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:34.366 15:48:24 -- setup/common.sh@18 -- # local node=0 00:04:34.366 15:48:24 -- setup/common.sh@19 -- # local var val 00:04:34.366 15:48:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.366 15:48:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.366 15:48:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:34.366 15:48:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:34.366 15:48:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.366 15:48:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 25747092 kB' 'MemUsed: 7078764 kB' 'SwapCached: 0 kB' 'Active: 4541780 kB' 'Inactive: 241128 kB' 'Active(anon): 4351500 kB' 'Inactive(anon): 0 kB' 'Active(file): 190280 kB' 'Inactive(file): 241128 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 4450672 kB' 'Mapped: 142840 kB' 'AnonPages: 335364 kB' 'Shmem: 4019264 kB' 'KernelStack: 7672 kB' 'PageTables: 4624 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99952 kB' 'Slab: 404196 kB' 'SReclaimable: 99952 kB' 'SUnreclaim: 304244 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.366 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.366 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@33 -- # echo 0 00:04:34.367 15:48:24 -- setup/common.sh@33 -- # return 0 00:04:34.367 15:48:24 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:34.367 15:48:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:34.367 15:48:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:34.367 15:48:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:34.367 15:48:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:34.367 15:48:24 -- setup/common.sh@18 -- # local node=1 00:04:34.367 15:48:24 -- setup/common.sh@19 -- # local var val 00:04:34.367 15:48:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:34.367 15:48:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:34.367 15:48:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:34.367 15:48:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:34.367 15:48:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:34.367 15:48:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709816 kB' 'MemFree: 16417432 kB' 'MemUsed: 11292384 kB' 'SwapCached: 0 kB' 'Active: 4956928 kB' 'Inactive: 3511200 kB' 'Active(anon): 4754496 kB' 'Inactive(anon): 0 kB' 'Active(file): 202432 kB' 'Inactive(file): 3511200 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8337944 kB' 'Mapped: 62440 kB' 'AnonPages: 129920 kB' 'Shmem: 4624312 kB' 'KernelStack: 5160 kB' 'PageTables: 3112 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 98608 kB' 'Slab: 291648 kB' 'SReclaimable: 98608 kB' 'SUnreclaim: 193040 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.367 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.367 15:48:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # continue 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:34.368 15:48:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:34.368 15:48:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:34.368 15:48:24 -- setup/common.sh@33 -- # echo 0 00:04:34.368 15:48:24 -- setup/common.sh@33 -- # return 0 00:04:34.368 15:48:24 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:34.368 15:48:24 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:34.368 15:48:24 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:34.368 15:48:24 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:34.368 15:48:24 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:34.368 node0=512 expecting 512 00:04:34.368 15:48:24 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:34.368 15:48:24 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:34.368 15:48:24 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:34.368 15:48:24 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:34.368 node1=1024 expecting 1024 00:04:34.368 15:48:24 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:34.368 00:04:34.368 real 0m1.508s 00:04:34.368 user 0m0.616s 00:04:34.368 sys 0m0.858s 00:04:34.368 15:48:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:34.368 15:48:24 -- common/autotest_common.sh@10 -- # set +x 00:04:34.368 ************************************ 00:04:34.368 END TEST custom_alloc 00:04:34.368 ************************************ 00:04:34.368 15:48:24 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:34.368 15:48:24 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:34.368 15:48:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:34.368 15:48:24 -- common/autotest_common.sh@10 -- # set +x 00:04:34.368 ************************************ 00:04:34.368 START TEST no_shrink_alloc 00:04:34.368 ************************************ 00:04:34.368 15:48:24 -- common/autotest_common.sh@1104 -- # no_shrink_alloc 00:04:34.368 15:48:24 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:34.368 15:48:24 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:34.368 15:48:24 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:34.368 15:48:24 -- setup/hugepages.sh@51 -- # shift 00:04:34.368 15:48:24 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:34.368 15:48:24 -- setup/hugepages.sh@52 -- # local node_ids 00:04:34.368 15:48:24 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:34.368 15:48:24 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:34.368 15:48:24 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:34.368 15:48:24 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:34.368 15:48:24 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:34.368 15:48:24 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:34.368 15:48:24 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:34.368 15:48:24 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:34.368 15:48:24 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:34.368 15:48:24 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:34.368 15:48:24 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:34.368 15:48:24 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:34.368 15:48:24 -- setup/hugepages.sh@73 -- # return 0 00:04:34.368 15:48:24 -- setup/hugepages.sh@198 -- # setup output 00:04:34.368 15:48:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:34.368 15:48:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:35.751 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:35.751 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:35.751 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:35.751 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:35.751 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:35.751 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:35.751 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:35.751 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:35.751 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:35.751 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:35.751 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:35.751 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:35.751 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:35.751 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:35.751 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:35.751 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:35.751 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:35.751 15:48:25 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:35.751 15:48:25 -- setup/hugepages.sh@89 -- # local node 00:04:35.751 15:48:25 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:35.751 15:48:25 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:35.751 15:48:25 -- setup/hugepages.sh@92 -- # local surp 00:04:35.751 15:48:25 -- setup/hugepages.sh@93 -- # local resv 00:04:35.751 15:48:25 -- setup/hugepages.sh@94 -- # local anon 00:04:35.751 15:48:25 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:35.751 15:48:25 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:35.751 15:48:25 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:35.751 15:48:25 -- setup/common.sh@18 -- # local node= 00:04:35.751 15:48:25 -- setup/common.sh@19 -- # local var val 00:04:35.751 15:48:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:35.751 15:48:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:35.751 15:48:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:35.751 15:48:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:35.751 15:48:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:35.751 15:48:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43189996 kB' 'MemAvailable: 46940736 kB' 'Buffers: 2708 kB' 'Cached: 12785936 kB' 'SwapCached: 0 kB' 'Active: 9498808 kB' 'Inactive: 3752328 kB' 'Active(anon): 9106096 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465688 kB' 'Mapped: 205320 kB' 'Shmem: 8643604 kB' 'KReclaimable: 198560 kB' 'Slab: 695740 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497180 kB' 'KernelStack: 12832 kB' 'PageTables: 7768 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10184240 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.751 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.751 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:35.752 15:48:25 -- setup/common.sh@33 -- # echo 0 00:04:35.752 15:48:25 -- setup/common.sh@33 -- # return 0 00:04:35.752 15:48:25 -- setup/hugepages.sh@97 -- # anon=0 00:04:35.752 15:48:25 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:35.752 15:48:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:35.752 15:48:25 -- setup/common.sh@18 -- # local node= 00:04:35.752 15:48:25 -- setup/common.sh@19 -- # local var val 00:04:35.752 15:48:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:35.752 15:48:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:35.752 15:48:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:35.752 15:48:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:35.752 15:48:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:35.752 15:48:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43196840 kB' 'MemAvailable: 46947580 kB' 'Buffers: 2708 kB' 'Cached: 12785940 kB' 'SwapCached: 0 kB' 'Active: 9498472 kB' 'Inactive: 3752328 kB' 'Active(anon): 9105760 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465380 kB' 'Mapped: 205288 kB' 'Shmem: 8643608 kB' 'KReclaimable: 198560 kB' 'Slab: 695740 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497180 kB' 'KernelStack: 12816 kB' 'PageTables: 7692 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10184252 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.752 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.752 15:48:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.753 15:48:25 -- setup/common.sh@33 -- # echo 0 00:04:35.753 15:48:25 -- setup/common.sh@33 -- # return 0 00:04:35.753 15:48:25 -- setup/hugepages.sh@99 -- # surp=0 00:04:35.753 15:48:25 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:35.753 15:48:25 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:35.753 15:48:25 -- setup/common.sh@18 -- # local node= 00:04:35.753 15:48:25 -- setup/common.sh@19 -- # local var val 00:04:35.753 15:48:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:35.753 15:48:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:35.753 15:48:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:35.753 15:48:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:35.753 15:48:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:35.753 15:48:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43197196 kB' 'MemAvailable: 46947936 kB' 'Buffers: 2708 kB' 'Cached: 12785952 kB' 'SwapCached: 0 kB' 'Active: 9498468 kB' 'Inactive: 3752328 kB' 'Active(anon): 9105756 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465356 kB' 'Mapped: 205288 kB' 'Shmem: 8643620 kB' 'KReclaimable: 198560 kB' 'Slab: 695808 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497248 kB' 'KernelStack: 12816 kB' 'PageTables: 7708 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10184264 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.753 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.753 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.754 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.754 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:35.755 15:48:25 -- setup/common.sh@33 -- # echo 0 00:04:35.755 15:48:25 -- setup/common.sh@33 -- # return 0 00:04:35.755 15:48:25 -- setup/hugepages.sh@100 -- # resv=0 00:04:35.755 15:48:25 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:35.755 nr_hugepages=1024 00:04:35.755 15:48:25 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:35.755 resv_hugepages=0 00:04:35.755 15:48:25 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:35.755 surplus_hugepages=0 00:04:35.755 15:48:25 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:35.755 anon_hugepages=0 00:04:35.755 15:48:25 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:35.755 15:48:25 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:35.755 15:48:25 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:35.755 15:48:25 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:35.755 15:48:25 -- setup/common.sh@18 -- # local node= 00:04:35.755 15:48:25 -- setup/common.sh@19 -- # local var val 00:04:35.755 15:48:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:35.755 15:48:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:35.755 15:48:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:35.755 15:48:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:35.755 15:48:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:35.755 15:48:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43199720 kB' 'MemAvailable: 46950460 kB' 'Buffers: 2708 kB' 'Cached: 12785968 kB' 'SwapCached: 0 kB' 'Active: 9498724 kB' 'Inactive: 3752328 kB' 'Active(anon): 9106012 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 465612 kB' 'Mapped: 205288 kB' 'Shmem: 8643636 kB' 'KReclaimable: 198560 kB' 'Slab: 695800 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 497240 kB' 'KernelStack: 12848 kB' 'PageTables: 7832 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10183912 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.755 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.755 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:35.756 15:48:25 -- setup/common.sh@33 -- # echo 1024 00:04:35.756 15:48:25 -- setup/common.sh@33 -- # return 0 00:04:35.756 15:48:25 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:35.756 15:48:25 -- setup/hugepages.sh@112 -- # get_nodes 00:04:35.756 15:48:25 -- setup/hugepages.sh@27 -- # local node 00:04:35.756 15:48:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:35.756 15:48:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:35.756 15:48:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:35.756 15:48:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:35.756 15:48:25 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:35.756 15:48:25 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:35.756 15:48:25 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:35.756 15:48:25 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:35.756 15:48:25 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:35.756 15:48:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:35.756 15:48:25 -- setup/common.sh@18 -- # local node=0 00:04:35.756 15:48:25 -- setup/common.sh@19 -- # local var val 00:04:35.756 15:48:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:35.756 15:48:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:35.756 15:48:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:35.756 15:48:25 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:35.756 15:48:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:35.756 15:48:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 24704224 kB' 'MemUsed: 8121632 kB' 'SwapCached: 0 kB' 'Active: 4541732 kB' 'Inactive: 241128 kB' 'Active(anon): 4351452 kB' 'Inactive(anon): 0 kB' 'Active(file): 190280 kB' 'Inactive(file): 241128 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 4450684 kB' 'Mapped: 142840 kB' 'AnonPages: 335332 kB' 'Shmem: 4019276 kB' 'KernelStack: 7640 kB' 'PageTables: 4508 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99952 kB' 'Slab: 404160 kB' 'SReclaimable: 99952 kB' 'SUnreclaim: 304208 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.756 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.756 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # continue 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:35.757 15:48:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:35.757 15:48:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:35.757 15:48:25 -- setup/common.sh@33 -- # echo 0 00:04:35.757 15:48:25 -- setup/common.sh@33 -- # return 0 00:04:35.757 15:48:25 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:35.757 15:48:25 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:35.757 15:48:25 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:35.757 15:48:25 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:35.757 15:48:25 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:35.757 node0=1024 expecting 1024 00:04:35.757 15:48:25 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:35.757 15:48:25 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:35.757 15:48:25 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:35.757 15:48:25 -- setup/hugepages.sh@202 -- # setup output 00:04:35.757 15:48:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:35.757 15:48:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:37.136 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:37.136 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:37.136 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:37.136 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:37.136 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:37.136 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:37.136 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:37.136 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:37.136 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:37.136 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:37.136 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:37.136 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:37.136 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:37.136 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:37.136 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:37.136 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:37.136 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:37.136 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:37.136 15:48:26 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:37.136 15:48:26 -- setup/hugepages.sh@89 -- # local node 00:04:37.136 15:48:26 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:37.136 15:48:26 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:37.136 15:48:26 -- setup/hugepages.sh@92 -- # local surp 00:04:37.136 15:48:26 -- setup/hugepages.sh@93 -- # local resv 00:04:37.136 15:48:26 -- setup/hugepages.sh@94 -- # local anon 00:04:37.136 15:48:26 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:37.136 15:48:26 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:37.136 15:48:26 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:37.136 15:48:26 -- setup/common.sh@18 -- # local node= 00:04:37.136 15:48:26 -- setup/common.sh@19 -- # local var val 00:04:37.136 15:48:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:37.136 15:48:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:37.136 15:48:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:37.136 15:48:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:37.136 15:48:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:37.136 15:48:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:37.136 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.136 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.136 15:48:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43197108 kB' 'MemAvailable: 46947848 kB' 'Buffers: 2708 kB' 'Cached: 12786020 kB' 'SwapCached: 0 kB' 'Active: 9499624 kB' 'Inactive: 3752328 kB' 'Active(anon): 9106912 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 466468 kB' 'Mapped: 205440 kB' 'Shmem: 8643688 kB' 'KReclaimable: 198560 kB' 'Slab: 695536 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 496976 kB' 'KernelStack: 12832 kB' 'PageTables: 7752 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10184588 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:37.136 15:48:26 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.136 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.136 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.136 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.136 15:48:26 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.136 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.136 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.136 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.136 15:48:26 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.136 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.137 15:48:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:37.137 15:48:26 -- setup/common.sh@33 -- # echo 0 00:04:37.137 15:48:26 -- setup/common.sh@33 -- # return 0 00:04:37.137 15:48:26 -- setup/hugepages.sh@97 -- # anon=0 00:04:37.137 15:48:26 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:37.137 15:48:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:37.137 15:48:26 -- setup/common.sh@18 -- # local node= 00:04:37.137 15:48:26 -- setup/common.sh@19 -- # local var val 00:04:37.137 15:48:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:37.137 15:48:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:37.137 15:48:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:37.137 15:48:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:37.137 15:48:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:37.137 15:48:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.137 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43197980 kB' 'MemAvailable: 46948720 kB' 'Buffers: 2708 kB' 'Cached: 12786024 kB' 'SwapCached: 0 kB' 'Active: 9499964 kB' 'Inactive: 3752328 kB' 'Active(anon): 9107252 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 466792 kB' 'Mapped: 205440 kB' 'Shmem: 8643692 kB' 'KReclaimable: 198560 kB' 'Slab: 695552 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 496992 kB' 'KernelStack: 12848 kB' 'PageTables: 7788 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10184600 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.138 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.138 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.139 15:48:26 -- setup/common.sh@33 -- # echo 0 00:04:37.139 15:48:26 -- setup/common.sh@33 -- # return 0 00:04:37.139 15:48:26 -- setup/hugepages.sh@99 -- # surp=0 00:04:37.139 15:48:26 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:37.139 15:48:26 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:37.139 15:48:26 -- setup/common.sh@18 -- # local node= 00:04:37.139 15:48:26 -- setup/common.sh@19 -- # local var val 00:04:37.139 15:48:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:37.139 15:48:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:37.139 15:48:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:37.139 15:48:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:37.139 15:48:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:37.139 15:48:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43199732 kB' 'MemAvailable: 46950472 kB' 'Buffers: 2708 kB' 'Cached: 12786036 kB' 'SwapCached: 0 kB' 'Active: 9499412 kB' 'Inactive: 3752328 kB' 'Active(anon): 9106700 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 466216 kB' 'Mapped: 205288 kB' 'Shmem: 8643704 kB' 'KReclaimable: 198560 kB' 'Slab: 695484 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 496924 kB' 'KernelStack: 12848 kB' 'PageTables: 7708 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10184612 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.139 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.139 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:26 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:37.140 15:48:27 -- setup/common.sh@33 -- # echo 0 00:04:37.140 15:48:27 -- setup/common.sh@33 -- # return 0 00:04:37.140 15:48:27 -- setup/hugepages.sh@100 -- # resv=0 00:04:37.140 15:48:27 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:37.140 nr_hugepages=1024 00:04:37.140 15:48:27 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:37.140 resv_hugepages=0 00:04:37.140 15:48:27 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:37.140 surplus_hugepages=0 00:04:37.140 15:48:27 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:37.140 anon_hugepages=0 00:04:37.140 15:48:27 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:37.140 15:48:27 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:37.140 15:48:27 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:37.140 15:48:27 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:37.140 15:48:27 -- setup/common.sh@18 -- # local node= 00:04:37.140 15:48:27 -- setup/common.sh@19 -- # local var val 00:04:37.140 15:48:27 -- setup/common.sh@20 -- # local mem_f mem 00:04:37.140 15:48:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:37.140 15:48:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:37.140 15:48:27 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:37.140 15:48:27 -- setup/common.sh@28 -- # mapfile -t mem 00:04:37.140 15:48:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 43199848 kB' 'MemAvailable: 46950588 kB' 'Buffers: 2708 kB' 'Cached: 12786052 kB' 'SwapCached: 0 kB' 'Active: 9499448 kB' 'Inactive: 3752328 kB' 'Active(anon): 9106736 kB' 'Inactive(anon): 0 kB' 'Active(file): 392712 kB' 'Inactive(file): 3752328 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 466260 kB' 'Mapped: 205288 kB' 'Shmem: 8643720 kB' 'KReclaimable: 198560 kB' 'Slab: 695484 kB' 'SReclaimable: 198560 kB' 'SUnreclaim: 496924 kB' 'KernelStack: 12864 kB' 'PageTables: 7756 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10184628 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 33984 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1656412 kB' 'DirectMap2M: 15040512 kB' 'DirectMap1G: 53477376 kB' 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.140 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.140 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.141 15:48:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.141 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.141 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.141 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.141 15:48:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.141 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.141 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.141 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.141 15:48:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.141 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.141 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.141 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.141 15:48:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.141 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.141 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.400 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.400 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:37.401 15:48:27 -- setup/common.sh@33 -- # echo 1024 00:04:37.401 15:48:27 -- setup/common.sh@33 -- # return 0 00:04:37.401 15:48:27 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:37.401 15:48:27 -- setup/hugepages.sh@112 -- # get_nodes 00:04:37.401 15:48:27 -- setup/hugepages.sh@27 -- # local node 00:04:37.401 15:48:27 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:37.401 15:48:27 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:37.401 15:48:27 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:37.401 15:48:27 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:37.401 15:48:27 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:37.401 15:48:27 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:37.401 15:48:27 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:37.401 15:48:27 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:37.401 15:48:27 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:37.401 15:48:27 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:37.401 15:48:27 -- setup/common.sh@18 -- # local node=0 00:04:37.401 15:48:27 -- setup/common.sh@19 -- # local var val 00:04:37.401 15:48:27 -- setup/common.sh@20 -- # local mem_f mem 00:04:37.401 15:48:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:37.401 15:48:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:37.401 15:48:27 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:37.401 15:48:27 -- setup/common.sh@28 -- # mapfile -t mem 00:04:37.401 15:48:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 24715900 kB' 'MemUsed: 8109956 kB' 'SwapCached: 0 kB' 'Active: 4543252 kB' 'Inactive: 241128 kB' 'Active(anon): 4352972 kB' 'Inactive(anon): 0 kB' 'Active(file): 190280 kB' 'Inactive(file): 241128 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 4450712 kB' 'Mapped: 142840 kB' 'AnonPages: 336800 kB' 'Shmem: 4019304 kB' 'KernelStack: 7688 kB' 'PageTables: 4672 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 99952 kB' 'Slab: 404092 kB' 'SReclaimable: 99952 kB' 'SUnreclaim: 304140 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.401 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.401 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # continue 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:37.402 15:48:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:37.402 15:48:27 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:37.402 15:48:27 -- setup/common.sh@33 -- # echo 0 00:04:37.402 15:48:27 -- setup/common.sh@33 -- # return 0 00:04:37.402 15:48:27 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:37.402 15:48:27 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:37.402 15:48:27 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:37.402 15:48:27 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:37.402 15:48:27 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:37.402 node0=1024 expecting 1024 00:04:37.402 15:48:27 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:37.402 00:04:37.402 real 0m2.965s 00:04:37.402 user 0m1.165s 00:04:37.402 sys 0m1.735s 00:04:37.402 15:48:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:37.402 15:48:27 -- common/autotest_common.sh@10 -- # set +x 00:04:37.402 ************************************ 00:04:37.402 END TEST no_shrink_alloc 00:04:37.402 ************************************ 00:04:37.402 15:48:27 -- setup/hugepages.sh@217 -- # clear_hp 00:04:37.402 15:48:27 -- setup/hugepages.sh@37 -- # local node hp 00:04:37.402 15:48:27 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:37.402 15:48:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:37.402 15:48:27 -- setup/hugepages.sh@41 -- # echo 0 00:04:37.402 15:48:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:37.402 15:48:27 -- setup/hugepages.sh@41 -- # echo 0 00:04:37.402 15:48:27 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:37.402 15:48:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:37.402 15:48:27 -- setup/hugepages.sh@41 -- # echo 0 00:04:37.402 15:48:27 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:37.402 15:48:27 -- setup/hugepages.sh@41 -- # echo 0 00:04:37.402 15:48:27 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:37.402 15:48:27 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:37.402 00:04:37.402 real 0m11.845s 00:04:37.402 user 0m4.474s 00:04:37.402 sys 0m6.338s 00:04:37.402 15:48:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:37.402 15:48:27 -- common/autotest_common.sh@10 -- # set +x 00:04:37.402 ************************************ 00:04:37.402 END TEST hugepages 00:04:37.402 ************************************ 00:04:37.402 15:48:27 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:37.402 15:48:27 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:37.402 15:48:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:37.402 15:48:27 -- common/autotest_common.sh@10 -- # set +x 00:04:37.402 ************************************ 00:04:37.402 START TEST driver 00:04:37.402 ************************************ 00:04:37.402 15:48:27 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:37.402 * Looking for test storage... 00:04:37.402 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:37.402 15:48:27 -- setup/driver.sh@68 -- # setup reset 00:04:37.402 15:48:27 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:37.402 15:48:27 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:39.939 15:48:29 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:39.939 15:48:29 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:39.939 15:48:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:39.939 15:48:29 -- common/autotest_common.sh@10 -- # set +x 00:04:39.939 ************************************ 00:04:39.939 START TEST guess_driver 00:04:39.939 ************************************ 00:04:39.939 15:48:29 -- common/autotest_common.sh@1104 -- # guess_driver 00:04:39.939 15:48:29 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:39.939 15:48:29 -- setup/driver.sh@47 -- # local fail=0 00:04:39.939 15:48:29 -- setup/driver.sh@49 -- # pick_driver 00:04:39.939 15:48:29 -- setup/driver.sh@36 -- # vfio 00:04:39.939 15:48:29 -- setup/driver.sh@21 -- # local iommu_grups 00:04:39.939 15:48:29 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:39.939 15:48:29 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:39.939 15:48:29 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:39.939 15:48:29 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:39.939 15:48:29 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:39.939 15:48:29 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:39.939 15:48:29 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:39.939 15:48:29 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:39.939 15:48:29 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:39.939 15:48:29 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:39.939 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:39.939 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:39.939 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:39.939 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:39.939 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:39.939 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:39.939 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:39.939 15:48:29 -- setup/driver.sh@30 -- # return 0 00:04:39.939 15:48:29 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:39.939 15:48:29 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:39.939 15:48:29 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:39.939 15:48:29 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:39.939 Looking for driver=vfio-pci 00:04:39.939 15:48:29 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:39.939 15:48:29 -- setup/driver.sh@45 -- # setup output config 00:04:39.939 15:48:29 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:39.939 15:48:29 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:41.317 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.317 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.317 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.317 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.317 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.317 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.317 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.317 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.317 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.317 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.317 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.317 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.317 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.317 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.317 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.317 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.317 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.317 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.317 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.317 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.317 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.317 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.317 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.317 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.317 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.317 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.317 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.317 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.317 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.317 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.317 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.317 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.317 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.576 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.577 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.577 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.577 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.577 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.577 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.577 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.577 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.577 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.577 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.577 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.577 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:41.577 15:48:31 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:41.577 15:48:31 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:41.577 15:48:31 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:42.515 15:48:32 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:42.515 15:48:32 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:42.515 15:48:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:42.515 15:48:32 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:42.515 15:48:32 -- setup/driver.sh@65 -- # setup reset 00:04:42.515 15:48:32 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:42.515 15:48:32 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:45.052 00:04:45.052 real 0m5.052s 00:04:45.052 user 0m1.184s 00:04:45.052 sys 0m1.988s 00:04:45.052 15:48:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:45.052 15:48:34 -- common/autotest_common.sh@10 -- # set +x 00:04:45.052 ************************************ 00:04:45.052 END TEST guess_driver 00:04:45.052 ************************************ 00:04:45.052 00:04:45.052 real 0m7.750s 00:04:45.052 user 0m1.799s 00:04:45.052 sys 0m3.089s 00:04:45.052 15:48:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:45.052 15:48:34 -- common/autotest_common.sh@10 -- # set +x 00:04:45.052 ************************************ 00:04:45.052 END TEST driver 00:04:45.052 ************************************ 00:04:45.052 15:48:34 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:45.052 15:48:34 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:45.052 15:48:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:45.052 15:48:34 -- common/autotest_common.sh@10 -- # set +x 00:04:45.052 ************************************ 00:04:45.052 START TEST devices 00:04:45.052 ************************************ 00:04:45.052 15:48:34 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:45.313 * Looking for test storage... 00:04:45.313 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:45.313 15:48:34 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:45.313 15:48:34 -- setup/devices.sh@192 -- # setup reset 00:04:45.313 15:48:34 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:45.313 15:48:34 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:46.694 15:48:36 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:46.694 15:48:36 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:04:46.694 15:48:36 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:04:46.694 15:48:36 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:04:46.694 15:48:36 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:04:46.694 15:48:36 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:04:46.694 15:48:36 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:04:46.694 15:48:36 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:46.694 15:48:36 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:04:46.694 15:48:36 -- setup/devices.sh@196 -- # blocks=() 00:04:46.694 15:48:36 -- setup/devices.sh@196 -- # declare -a blocks 00:04:46.694 15:48:36 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:46.694 15:48:36 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:46.694 15:48:36 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:46.694 15:48:36 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:46.694 15:48:36 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:46.694 15:48:36 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:46.694 15:48:36 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:04:46.694 15:48:36 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:46.694 15:48:36 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:46.694 15:48:36 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:04:46.694 15:48:36 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:46.694 No valid GPT data, bailing 00:04:46.694 15:48:36 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:46.694 15:48:36 -- scripts/common.sh@393 -- # pt= 00:04:46.694 15:48:36 -- scripts/common.sh@394 -- # return 1 00:04:46.694 15:48:36 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:46.694 15:48:36 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:46.694 15:48:36 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:46.694 15:48:36 -- setup/common.sh@80 -- # echo 1000204886016 00:04:46.694 15:48:36 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:04:46.694 15:48:36 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:46.694 15:48:36 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:04:46.694 15:48:36 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:46.694 15:48:36 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:46.694 15:48:36 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:46.694 15:48:36 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:46.694 15:48:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:46.694 15:48:36 -- common/autotest_common.sh@10 -- # set +x 00:04:46.694 ************************************ 00:04:46.694 START TEST nvme_mount 00:04:46.694 ************************************ 00:04:46.694 15:48:36 -- common/autotest_common.sh@1104 -- # nvme_mount 00:04:46.694 15:48:36 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:46.694 15:48:36 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:46.694 15:48:36 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:46.694 15:48:36 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:46.694 15:48:36 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:46.694 15:48:36 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:46.694 15:48:36 -- setup/common.sh@40 -- # local part_no=1 00:04:46.694 15:48:36 -- setup/common.sh@41 -- # local size=1073741824 00:04:46.694 15:48:36 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:46.694 15:48:36 -- setup/common.sh@44 -- # parts=() 00:04:46.694 15:48:36 -- setup/common.sh@44 -- # local parts 00:04:46.694 15:48:36 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:46.694 15:48:36 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:46.694 15:48:36 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:46.694 15:48:36 -- setup/common.sh@46 -- # (( part++ )) 00:04:46.694 15:48:36 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:46.694 15:48:36 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:46.694 15:48:36 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:46.694 15:48:36 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:04:48.073 Creating new GPT entries in memory. 00:04:48.073 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:48.073 other utilities. 00:04:48.073 15:48:37 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:48.073 15:48:37 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:48.073 15:48:37 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:48.073 15:48:37 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:48.073 15:48:37 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:49.014 Creating new GPT entries in memory. 00:04:49.014 The operation has completed successfully. 00:04:49.014 15:48:38 -- setup/common.sh@57 -- # (( part++ )) 00:04:49.014 15:48:38 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:49.014 15:48:38 -- setup/common.sh@62 -- # wait 2283632 00:04:49.014 15:48:38 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:49.014 15:48:38 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:04:49.014 15:48:38 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:49.014 15:48:38 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:04:49.014 15:48:38 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:04:49.014 15:48:38 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:49.014 15:48:38 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:49.014 15:48:38 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:49.014 15:48:38 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:04:49.014 15:48:38 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:49.014 15:48:38 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:49.014 15:48:38 -- setup/devices.sh@53 -- # local found=0 00:04:49.014 15:48:38 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:49.014 15:48:38 -- setup/devices.sh@56 -- # : 00:04:49.014 15:48:38 -- setup/devices.sh@59 -- # local pci status 00:04:49.014 15:48:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.014 15:48:38 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:49.014 15:48:38 -- setup/devices.sh@47 -- # setup output config 00:04:49.014 15:48:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:49.014 15:48:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:49.949 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.949 15:48:39 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:04:49.949 15:48:39 -- setup/devices.sh@63 -- # found=1 00:04:49.949 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.949 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.949 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.949 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.949 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.949 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.949 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.949 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.949 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.949 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.949 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.949 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:49.949 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.207 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.207 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.207 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.207 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.207 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.207 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.207 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.207 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.207 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.207 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.207 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.207 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.207 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.207 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.207 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.207 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.207 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.207 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.207 15:48:39 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:50.207 15:48:39 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.207 15:48:40 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:50.207 15:48:40 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:50.207 15:48:40 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:50.207 15:48:40 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:50.207 15:48:40 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:50.207 15:48:40 -- setup/devices.sh@110 -- # cleanup_nvme 00:04:50.207 15:48:40 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:50.207 15:48:40 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:50.207 15:48:40 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:50.207 15:48:40 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:50.207 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:50.207 15:48:40 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:50.207 15:48:40 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:50.774 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:50.774 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:50.774 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:50.774 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:50.774 15:48:40 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:04:50.774 15:48:40 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:04:50.774 15:48:40 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:50.774 15:48:40 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:04:50.774 15:48:40 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:04:50.774 15:48:40 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:50.774 15:48:40 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:50.774 15:48:40 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:50.774 15:48:40 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:04:50.774 15:48:40 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:50.774 15:48:40 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:50.774 15:48:40 -- setup/devices.sh@53 -- # local found=0 00:04:50.774 15:48:40 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:50.774 15:48:40 -- setup/devices.sh@56 -- # : 00:04:50.774 15:48:40 -- setup/devices.sh@59 -- # local pci status 00:04:50.775 15:48:40 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:50.775 15:48:40 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:50.775 15:48:40 -- setup/devices.sh@47 -- # setup output config 00:04:50.775 15:48:40 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:50.775 15:48:40 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:04:51.711 15:48:41 -- setup/devices.sh@63 -- # found=1 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.711 15:48:41 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:51.711 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.970 15:48:41 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:51.970 15:48:41 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:51.970 15:48:41 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:51.970 15:48:41 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:51.970 15:48:41 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:51.970 15:48:41 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:51.970 15:48:41 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:04:51.970 15:48:41 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:51.970 15:48:41 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:04:51.970 15:48:41 -- setup/devices.sh@50 -- # local mount_point= 00:04:51.970 15:48:41 -- setup/devices.sh@51 -- # local test_file= 00:04:51.970 15:48:41 -- setup/devices.sh@53 -- # local found=0 00:04:51.970 15:48:41 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:51.970 15:48:41 -- setup/devices.sh@59 -- # local pci status 00:04:51.970 15:48:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:51.970 15:48:41 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:51.970 15:48:41 -- setup/devices.sh@47 -- # setup output config 00:04:51.970 15:48:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:51.970 15:48:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:53.348 15:48:42 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:42 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:04:53.348 15:48:42 -- setup/devices.sh@63 -- # found=1 00:04:53.348 15:48:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:43 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:43 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:53.348 15:48:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:53.348 15:48:43 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:53.348 15:48:43 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:53.348 15:48:43 -- setup/devices.sh@68 -- # return 0 00:04:53.348 15:48:43 -- setup/devices.sh@128 -- # cleanup_nvme 00:04:53.348 15:48:43 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:53.348 15:48:43 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:53.348 15:48:43 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:53.348 15:48:43 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:53.348 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:53.348 00:04:53.348 real 0m6.666s 00:04:53.348 user 0m1.563s 00:04:53.348 sys 0m2.706s 00:04:53.348 15:48:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:53.348 15:48:43 -- common/autotest_common.sh@10 -- # set +x 00:04:53.348 ************************************ 00:04:53.348 END TEST nvme_mount 00:04:53.348 ************************************ 00:04:53.608 15:48:43 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:04:53.608 15:48:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:53.608 15:48:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:53.608 15:48:43 -- common/autotest_common.sh@10 -- # set +x 00:04:53.608 ************************************ 00:04:53.608 START TEST dm_mount 00:04:53.608 ************************************ 00:04:53.608 15:48:43 -- common/autotest_common.sh@1104 -- # dm_mount 00:04:53.608 15:48:43 -- setup/devices.sh@144 -- # pv=nvme0n1 00:04:53.608 15:48:43 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:04:53.608 15:48:43 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:04:53.608 15:48:43 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:04:53.608 15:48:43 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:53.608 15:48:43 -- setup/common.sh@40 -- # local part_no=2 00:04:53.608 15:48:43 -- setup/common.sh@41 -- # local size=1073741824 00:04:53.608 15:48:43 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:53.608 15:48:43 -- setup/common.sh@44 -- # parts=() 00:04:53.608 15:48:43 -- setup/common.sh@44 -- # local parts 00:04:53.608 15:48:43 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:53.608 15:48:43 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:53.608 15:48:43 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:53.608 15:48:43 -- setup/common.sh@46 -- # (( part++ )) 00:04:53.608 15:48:43 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:53.608 15:48:43 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:53.608 15:48:43 -- setup/common.sh@46 -- # (( part++ )) 00:04:53.608 15:48:43 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:53.608 15:48:43 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:53.608 15:48:43 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:53.608 15:48:43 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:04:54.545 Creating new GPT entries in memory. 00:04:54.545 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:54.545 other utilities. 00:04:54.545 15:48:44 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:54.545 15:48:44 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:54.545 15:48:44 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:54.545 15:48:44 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:54.545 15:48:44 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:55.484 Creating new GPT entries in memory. 00:04:55.484 The operation has completed successfully. 00:04:55.484 15:48:45 -- setup/common.sh@57 -- # (( part++ )) 00:04:55.484 15:48:45 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:55.484 15:48:45 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:55.484 15:48:45 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:55.484 15:48:45 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:04:56.424 The operation has completed successfully. 00:04:56.424 15:48:46 -- setup/common.sh@57 -- # (( part++ )) 00:04:56.424 15:48:46 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:56.424 15:48:46 -- setup/common.sh@62 -- # wait 2286091 00:04:56.683 15:48:46 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:04:56.683 15:48:46 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:56.683 15:48:46 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:56.683 15:48:46 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:04:56.683 15:48:46 -- setup/devices.sh@160 -- # for t in {1..5} 00:04:56.683 15:48:46 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:56.683 15:48:46 -- setup/devices.sh@161 -- # break 00:04:56.683 15:48:46 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:56.683 15:48:46 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:04:56.683 15:48:46 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:04:56.683 15:48:46 -- setup/devices.sh@166 -- # dm=dm-0 00:04:56.683 15:48:46 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:04:56.683 15:48:46 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:04:56.683 15:48:46 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:56.683 15:48:46 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:04:56.683 15:48:46 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:56.683 15:48:46 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:56.683 15:48:46 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:04:56.683 15:48:46 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:56.683 15:48:46 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:56.683 15:48:46 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:56.683 15:48:46 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:04:56.683 15:48:46 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:56.683 15:48:46 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:56.683 15:48:46 -- setup/devices.sh@53 -- # local found=0 00:04:56.683 15:48:46 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:56.683 15:48:46 -- setup/devices.sh@56 -- # : 00:04:56.683 15:48:46 -- setup/devices.sh@59 -- # local pci status 00:04:56.683 15:48:46 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:56.683 15:48:46 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:56.683 15:48:46 -- setup/devices.sh@47 -- # setup output config 00:04:56.683 15:48:46 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:56.683 15:48:46 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:04:58.065 15:48:47 -- setup/devices.sh@63 -- # found=1 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:58.065 15:48:47 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:04:58.065 15:48:47 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:58.065 15:48:47 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:58.065 15:48:47 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:58.065 15:48:47 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:58.065 15:48:47 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:04:58.065 15:48:47 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:58.065 15:48:47 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:04:58.065 15:48:47 -- setup/devices.sh@50 -- # local mount_point= 00:04:58.065 15:48:47 -- setup/devices.sh@51 -- # local test_file= 00:04:58.065 15:48:47 -- setup/devices.sh@53 -- # local found=0 00:04:58.065 15:48:47 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:58.065 15:48:47 -- setup/devices.sh@59 -- # local pci status 00:04:58.065 15:48:47 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:58.065 15:48:47 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:58.065 15:48:47 -- setup/devices.sh@47 -- # setup output config 00:04:58.065 15:48:47 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:58.065 15:48:47 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:59.443 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.443 15:48:48 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:04:59.443 15:48:48 -- setup/devices.sh@63 -- # found=1 00:04:59.443 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.443 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.443 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.443 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.443 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.443 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.443 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.443 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.443 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.443 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.443 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.443 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.443 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.443 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.443 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.443 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.443 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.443 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.443 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.443 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.443 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.443 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.443 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.443 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.443 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.444 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.444 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.444 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.444 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.444 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.444 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.444 15:48:48 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:59.444 15:48:48 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:59.444 15:48:49 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:59.444 15:48:49 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:59.444 15:48:49 -- setup/devices.sh@68 -- # return 0 00:04:59.444 15:48:49 -- setup/devices.sh@187 -- # cleanup_dm 00:04:59.444 15:48:49 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:59.444 15:48:49 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:59.444 15:48:49 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:04:59.444 15:48:49 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:59.444 15:48:49 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:04:59.444 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:59.444 15:48:49 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:59.444 15:48:49 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:04:59.444 00:04:59.444 real 0m5.966s 00:04:59.444 user 0m1.021s 00:04:59.444 sys 0m1.815s 00:04:59.444 15:48:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:59.444 15:48:49 -- common/autotest_common.sh@10 -- # set +x 00:04:59.444 ************************************ 00:04:59.444 END TEST dm_mount 00:04:59.444 ************************************ 00:04:59.444 15:48:49 -- setup/devices.sh@1 -- # cleanup 00:04:59.444 15:48:49 -- setup/devices.sh@11 -- # cleanup_nvme 00:04:59.444 15:48:49 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:59.444 15:48:49 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:59.444 15:48:49 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:59.444 15:48:49 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:59.444 15:48:49 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:59.703 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:59.703 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:59.703 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:59.703 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:59.703 15:48:49 -- setup/devices.sh@12 -- # cleanup_dm 00:04:59.703 15:48:49 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:59.703 15:48:49 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:59.703 15:48:49 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:59.703 15:48:49 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:59.703 15:48:49 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:04:59.703 15:48:49 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:04:59.703 00:04:59.703 real 0m14.622s 00:04:59.703 user 0m3.243s 00:04:59.703 sys 0m5.625s 00:04:59.703 15:48:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:59.703 15:48:49 -- common/autotest_common.sh@10 -- # set +x 00:04:59.703 ************************************ 00:04:59.703 END TEST devices 00:04:59.703 ************************************ 00:04:59.703 00:04:59.703 real 0m45.269s 00:04:59.703 user 0m12.933s 00:04:59.703 sys 0m20.773s 00:04:59.703 15:48:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:59.703 15:48:49 -- common/autotest_common.sh@10 -- # set +x 00:04:59.703 ************************************ 00:04:59.703 END TEST setup.sh 00:04:59.703 ************************************ 00:04:59.703 15:48:49 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:01.077 Hugepages 00:05:01.077 node hugesize free / total 00:05:01.077 node0 1048576kB 0 / 0 00:05:01.077 node0 2048kB 2048 / 2048 00:05:01.077 node1 1048576kB 0 / 0 00:05:01.077 node1 2048kB 0 / 0 00:05:01.077 00:05:01.077 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:01.077 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:01.077 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:01.077 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:01.077 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:01.077 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:01.077 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:01.077 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:01.077 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:01.077 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:01.077 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:01.077 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:01.077 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:01.077 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:01.077 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:01.077 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:01.077 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:01.077 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:01.077 15:48:50 -- spdk/autotest.sh@141 -- # uname -s 00:05:01.077 15:48:50 -- spdk/autotest.sh@141 -- # [[ Linux == Linux ]] 00:05:01.077 15:48:50 -- spdk/autotest.sh@143 -- # nvme_namespace_revert 00:05:01.077 15:48:50 -- common/autotest_common.sh@1516 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:02.456 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:02.456 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:02.456 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:02.456 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:02.456 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:02.456 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:02.456 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:02.456 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:02.456 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:02.456 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:02.456 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:02.456 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:02.456 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:02.456 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:02.456 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:02.456 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:03.396 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:03.396 15:48:53 -- common/autotest_common.sh@1517 -- # sleep 1 00:05:04.775 15:48:54 -- common/autotest_common.sh@1518 -- # bdfs=() 00:05:04.775 15:48:54 -- common/autotest_common.sh@1518 -- # local bdfs 00:05:04.775 15:48:54 -- common/autotest_common.sh@1519 -- # bdfs=($(get_nvme_bdfs)) 00:05:04.775 15:48:54 -- common/autotest_common.sh@1519 -- # get_nvme_bdfs 00:05:04.775 15:48:54 -- common/autotest_common.sh@1498 -- # bdfs=() 00:05:04.775 15:48:54 -- common/autotest_common.sh@1498 -- # local bdfs 00:05:04.775 15:48:54 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:04.775 15:48:54 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:04.775 15:48:54 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:05:04.775 15:48:54 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:05:04.775 15:48:54 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:05:04.775 15:48:54 -- common/autotest_common.sh@1521 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:05.711 Waiting for block devices as requested 00:05:05.711 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:05.970 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:05.970 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:06.230 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:06.230 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:06.230 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:06.230 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:06.489 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:06.489 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:06.489 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:06.747 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:06.747 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:06.747 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:06.747 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:07.007 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:07.007 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:07.007 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:07.267 15:48:56 -- common/autotest_common.sh@1523 -- # for bdf in "${bdfs[@]}" 00:05:07.267 15:48:56 -- common/autotest_common.sh@1524 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:07.267 15:48:56 -- common/autotest_common.sh@1487 -- # readlink -f /sys/class/nvme/nvme0 00:05:07.267 15:48:56 -- common/autotest_common.sh@1487 -- # grep 0000:88:00.0/nvme/nvme 00:05:07.267 15:48:56 -- common/autotest_common.sh@1487 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:07.267 15:48:56 -- common/autotest_common.sh@1488 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:07.267 15:48:56 -- common/autotest_common.sh@1492 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:07.267 15:48:56 -- common/autotest_common.sh@1492 -- # printf '%s\n' nvme0 00:05:07.267 15:48:56 -- common/autotest_common.sh@1524 -- # nvme_ctrlr=/dev/nvme0 00:05:07.267 15:48:56 -- common/autotest_common.sh@1525 -- # [[ -z /dev/nvme0 ]] 00:05:07.267 15:48:56 -- common/autotest_common.sh@1530 -- # nvme id-ctrl /dev/nvme0 00:05:07.267 15:48:56 -- common/autotest_common.sh@1530 -- # grep oacs 00:05:07.267 15:48:56 -- common/autotest_common.sh@1530 -- # cut -d: -f2 00:05:07.267 15:48:56 -- common/autotest_common.sh@1530 -- # oacs=' 0xf' 00:05:07.267 15:48:56 -- common/autotest_common.sh@1531 -- # oacs_ns_manage=8 00:05:07.267 15:48:56 -- common/autotest_common.sh@1533 -- # [[ 8 -ne 0 ]] 00:05:07.267 15:48:56 -- common/autotest_common.sh@1539 -- # nvme id-ctrl /dev/nvme0 00:05:07.267 15:48:56 -- common/autotest_common.sh@1539 -- # grep unvmcap 00:05:07.267 15:48:56 -- common/autotest_common.sh@1539 -- # cut -d: -f2 00:05:07.267 15:48:56 -- common/autotest_common.sh@1539 -- # unvmcap=' 0' 00:05:07.267 15:48:56 -- common/autotest_common.sh@1540 -- # [[ 0 -eq 0 ]] 00:05:07.267 15:48:56 -- common/autotest_common.sh@1542 -- # continue 00:05:07.267 15:48:56 -- spdk/autotest.sh@146 -- # timing_exit pre_cleanup 00:05:07.267 15:48:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:07.267 15:48:56 -- common/autotest_common.sh@10 -- # set +x 00:05:07.267 15:48:56 -- spdk/autotest.sh@149 -- # timing_enter afterboot 00:05:07.267 15:48:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:07.267 15:48:56 -- common/autotest_common.sh@10 -- # set +x 00:05:07.267 15:48:56 -- spdk/autotest.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:08.643 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:08.643 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:08.643 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:08.643 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:08.643 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:08.643 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:08.643 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:08.643 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:08.643 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:08.643 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:08.643 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:08.643 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:08.643 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:08.643 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:08.643 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:08.643 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:09.586 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:09.586 15:48:59 -- spdk/autotest.sh@151 -- # timing_exit afterboot 00:05:09.586 15:48:59 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:09.586 15:48:59 -- common/autotest_common.sh@10 -- # set +x 00:05:09.586 15:48:59 -- spdk/autotest.sh@155 -- # opal_revert_cleanup 00:05:09.586 15:48:59 -- common/autotest_common.sh@1576 -- # mapfile -t bdfs 00:05:09.586 15:48:59 -- common/autotest_common.sh@1576 -- # get_nvme_bdfs_by_id 0x0a54 00:05:09.586 15:48:59 -- common/autotest_common.sh@1562 -- # bdfs=() 00:05:09.586 15:48:59 -- common/autotest_common.sh@1562 -- # local bdfs 00:05:09.586 15:48:59 -- common/autotest_common.sh@1564 -- # get_nvme_bdfs 00:05:09.586 15:48:59 -- common/autotest_common.sh@1498 -- # bdfs=() 00:05:09.586 15:48:59 -- common/autotest_common.sh@1498 -- # local bdfs 00:05:09.586 15:48:59 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:09.586 15:48:59 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:09.586 15:48:59 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:05:09.845 15:48:59 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:05:09.845 15:48:59 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:05:09.845 15:48:59 -- common/autotest_common.sh@1564 -- # for bdf in $(get_nvme_bdfs) 00:05:09.845 15:48:59 -- common/autotest_common.sh@1565 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:09.845 15:48:59 -- common/autotest_common.sh@1565 -- # device=0x0a54 00:05:09.845 15:48:59 -- common/autotest_common.sh@1566 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:09.845 15:48:59 -- common/autotest_common.sh@1567 -- # bdfs+=($bdf) 00:05:09.845 15:48:59 -- common/autotest_common.sh@1571 -- # printf '%s\n' 0000:88:00.0 00:05:09.845 15:48:59 -- common/autotest_common.sh@1577 -- # [[ -z 0000:88:00.0 ]] 00:05:09.845 15:48:59 -- common/autotest_common.sh@1582 -- # spdk_tgt_pid=2291525 00:05:09.845 15:48:59 -- common/autotest_common.sh@1581 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:09.845 15:48:59 -- common/autotest_common.sh@1583 -- # waitforlisten 2291525 00:05:09.845 15:48:59 -- common/autotest_common.sh@819 -- # '[' -z 2291525 ']' 00:05:09.845 15:48:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:09.845 15:48:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:09.845 15:48:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:09.845 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:09.845 15:48:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:09.845 15:48:59 -- common/autotest_common.sh@10 -- # set +x 00:05:09.845 [2024-10-30 15:48:59.524901] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:09.845 [2024-10-30 15:48:59.524986] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2291525 ] 00:05:09.845 EAL: No free 2048 kB hugepages reported on node 1 00:05:09.845 [2024-10-30 15:48:59.583718] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:09.845 [2024-10-30 15:48:59.660567] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:09.845 [2024-10-30 15:48:59.660738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.778 15:49:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:10.778 15:49:00 -- common/autotest_common.sh@852 -- # return 0 00:05:10.778 15:49:00 -- common/autotest_common.sh@1585 -- # bdf_id=0 00:05:10.778 15:49:00 -- common/autotest_common.sh@1586 -- # for bdf in "${bdfs[@]}" 00:05:10.778 15:49:00 -- common/autotest_common.sh@1587 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:14.063 nvme0n1 00:05:14.063 15:49:03 -- common/autotest_common.sh@1589 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:14.063 [2024-10-30 15:49:03.794993] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:14.063 [2024-10-30 15:49:03.795035] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:14.063 request: 00:05:14.063 { 00:05:14.063 "nvme_ctrlr_name": "nvme0", 00:05:14.063 "password": "test", 00:05:14.063 "method": "bdev_nvme_opal_revert", 00:05:14.063 "req_id": 1 00:05:14.063 } 00:05:14.063 Got JSON-RPC error response 00:05:14.063 response: 00:05:14.063 { 00:05:14.063 "code": -32603, 00:05:14.063 "message": "Internal error" 00:05:14.063 } 00:05:14.063 15:49:03 -- common/autotest_common.sh@1589 -- # true 00:05:14.063 15:49:03 -- common/autotest_common.sh@1590 -- # (( ++bdf_id )) 00:05:14.063 15:49:03 -- common/autotest_common.sh@1593 -- # killprocess 2291525 00:05:14.063 15:49:03 -- common/autotest_common.sh@926 -- # '[' -z 2291525 ']' 00:05:14.063 15:49:03 -- common/autotest_common.sh@930 -- # kill -0 2291525 00:05:14.063 15:49:03 -- common/autotest_common.sh@931 -- # uname 00:05:14.063 15:49:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:14.063 15:49:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2291525 00:05:14.063 15:49:03 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:14.063 15:49:03 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:14.063 15:49:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2291525' 00:05:14.063 killing process with pid 2291525 00:05:14.063 15:49:03 -- common/autotest_common.sh@945 -- # kill 2291525 00:05:14.063 15:49:03 -- common/autotest_common.sh@950 -- # wait 2291525 00:05:15.962 15:49:05 -- spdk/autotest.sh@161 -- # '[' 0 -eq 1 ']' 00:05:15.962 15:49:05 -- spdk/autotest.sh@165 -- # '[' 1 -eq 1 ']' 00:05:15.962 15:49:05 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:05:15.962 15:49:05 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:05:15.962 15:49:05 -- spdk/autotest.sh@173 -- # timing_enter lib 00:05:15.962 15:49:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:15.962 15:49:05 -- common/autotest_common.sh@10 -- # set +x 00:05:15.962 15:49:05 -- spdk/autotest.sh@175 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:15.962 15:49:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:15.962 15:49:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:15.962 15:49:05 -- common/autotest_common.sh@10 -- # set +x 00:05:15.962 ************************************ 00:05:15.962 START TEST env 00:05:15.962 ************************************ 00:05:15.962 15:49:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:15.962 * Looking for test storage... 00:05:15.962 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:15.962 15:49:05 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:15.962 15:49:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:15.962 15:49:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:15.962 15:49:05 -- common/autotest_common.sh@10 -- # set +x 00:05:15.962 ************************************ 00:05:15.962 START TEST env_memory 00:05:15.962 ************************************ 00:05:15.962 15:49:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:15.962 00:05:15.962 00:05:15.962 CUnit - A unit testing framework for C - Version 2.1-3 00:05:15.962 http://cunit.sourceforge.net/ 00:05:15.962 00:05:15.962 00:05:15.962 Suite: memory 00:05:15.962 Test: alloc and free memory map ...[2024-10-30 15:49:05.694612] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:15.962 passed 00:05:15.962 Test: mem map translation ...[2024-10-30 15:49:05.715037] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:15.962 [2024-10-30 15:49:05.715060] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:15.962 [2024-10-30 15:49:05.715111] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:15.962 [2024-10-30 15:49:05.715122] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:15.962 passed 00:05:15.962 Test: mem map registration ...[2024-10-30 15:49:05.755924] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:15.962 [2024-10-30 15:49:05.755944] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:15.962 passed 00:05:15.962 Test: mem map adjacent registrations ...passed 00:05:15.962 00:05:15.962 Run Summary: Type Total Ran Passed Failed Inactive 00:05:15.962 suites 1 1 n/a 0 0 00:05:15.962 tests 4 4 4 0 0 00:05:15.962 asserts 152 152 152 0 n/a 00:05:15.962 00:05:15.962 Elapsed time = 0.141 seconds 00:05:15.962 00:05:15.962 real 0m0.150s 00:05:15.962 user 0m0.142s 00:05:15.962 sys 0m0.008s 00:05:15.962 15:49:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:15.962 15:49:05 -- common/autotest_common.sh@10 -- # set +x 00:05:15.962 ************************************ 00:05:15.962 END TEST env_memory 00:05:15.962 ************************************ 00:05:15.962 15:49:05 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:15.962 15:49:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:15.962 15:49:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:15.962 15:49:05 -- common/autotest_common.sh@10 -- # set +x 00:05:15.962 ************************************ 00:05:15.962 START TEST env_vtophys 00:05:15.962 ************************************ 00:05:15.962 15:49:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:16.222 EAL: lib.eal log level changed from notice to debug 00:05:16.222 EAL: Detected lcore 0 as core 0 on socket 0 00:05:16.222 EAL: Detected lcore 1 as core 1 on socket 0 00:05:16.222 EAL: Detected lcore 2 as core 2 on socket 0 00:05:16.222 EAL: Detected lcore 3 as core 3 on socket 0 00:05:16.222 EAL: Detected lcore 4 as core 4 on socket 0 00:05:16.222 EAL: Detected lcore 5 as core 5 on socket 0 00:05:16.222 EAL: Detected lcore 6 as core 8 on socket 0 00:05:16.222 EAL: Detected lcore 7 as core 9 on socket 0 00:05:16.222 EAL: Detected lcore 8 as core 10 on socket 0 00:05:16.222 EAL: Detected lcore 9 as core 11 on socket 0 00:05:16.222 EAL: Detected lcore 10 as core 12 on socket 0 00:05:16.222 EAL: Detected lcore 11 as core 13 on socket 0 00:05:16.222 EAL: Detected lcore 12 as core 0 on socket 1 00:05:16.222 EAL: Detected lcore 13 as core 1 on socket 1 00:05:16.222 EAL: Detected lcore 14 as core 2 on socket 1 00:05:16.222 EAL: Detected lcore 15 as core 3 on socket 1 00:05:16.222 EAL: Detected lcore 16 as core 4 on socket 1 00:05:16.222 EAL: Detected lcore 17 as core 5 on socket 1 00:05:16.222 EAL: Detected lcore 18 as core 8 on socket 1 00:05:16.222 EAL: Detected lcore 19 as core 9 on socket 1 00:05:16.222 EAL: Detected lcore 20 as core 10 on socket 1 00:05:16.222 EAL: Detected lcore 21 as core 11 on socket 1 00:05:16.222 EAL: Detected lcore 22 as core 12 on socket 1 00:05:16.222 EAL: Detected lcore 23 as core 13 on socket 1 00:05:16.222 EAL: Detected lcore 24 as core 0 on socket 0 00:05:16.222 EAL: Detected lcore 25 as core 1 on socket 0 00:05:16.222 EAL: Detected lcore 26 as core 2 on socket 0 00:05:16.222 EAL: Detected lcore 27 as core 3 on socket 0 00:05:16.222 EAL: Detected lcore 28 as core 4 on socket 0 00:05:16.222 EAL: Detected lcore 29 as core 5 on socket 0 00:05:16.222 EAL: Detected lcore 30 as core 8 on socket 0 00:05:16.222 EAL: Detected lcore 31 as core 9 on socket 0 00:05:16.222 EAL: Detected lcore 32 as core 10 on socket 0 00:05:16.222 EAL: Detected lcore 33 as core 11 on socket 0 00:05:16.222 EAL: Detected lcore 34 as core 12 on socket 0 00:05:16.222 EAL: Detected lcore 35 as core 13 on socket 0 00:05:16.222 EAL: Detected lcore 36 as core 0 on socket 1 00:05:16.222 EAL: Detected lcore 37 as core 1 on socket 1 00:05:16.222 EAL: Detected lcore 38 as core 2 on socket 1 00:05:16.222 EAL: Detected lcore 39 as core 3 on socket 1 00:05:16.222 EAL: Detected lcore 40 as core 4 on socket 1 00:05:16.222 EAL: Detected lcore 41 as core 5 on socket 1 00:05:16.222 EAL: Detected lcore 42 as core 8 on socket 1 00:05:16.222 EAL: Detected lcore 43 as core 9 on socket 1 00:05:16.222 EAL: Detected lcore 44 as core 10 on socket 1 00:05:16.222 EAL: Detected lcore 45 as core 11 on socket 1 00:05:16.222 EAL: Detected lcore 46 as core 12 on socket 1 00:05:16.222 EAL: Detected lcore 47 as core 13 on socket 1 00:05:16.222 EAL: Maximum logical cores by configuration: 128 00:05:16.222 EAL: Detected CPU lcores: 48 00:05:16.222 EAL: Detected NUMA nodes: 2 00:05:16.222 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:05:16.222 EAL: Detected shared linkage of DPDK 00:05:16.222 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24.0 00:05:16.222 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24.0 00:05:16.222 EAL: Registered [vdev] bus. 00:05:16.222 EAL: bus.vdev log level changed from disabled to notice 00:05:16.222 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24.0 00:05:16.222 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24.0 00:05:16.222 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:16.222 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:16.222 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:05:16.222 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:05:16.222 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:05:16.222 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:05:16.222 EAL: No shared files mode enabled, IPC will be disabled 00:05:16.222 EAL: No shared files mode enabled, IPC is disabled 00:05:16.222 EAL: Bus pci wants IOVA as 'DC' 00:05:16.222 EAL: Bus vdev wants IOVA as 'DC' 00:05:16.222 EAL: Buses did not request a specific IOVA mode. 00:05:16.222 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:16.222 EAL: Selected IOVA mode 'VA' 00:05:16.222 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.222 EAL: Probing VFIO support... 00:05:16.222 EAL: IOMMU type 1 (Type 1) is supported 00:05:16.222 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:16.222 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:16.222 EAL: VFIO support initialized 00:05:16.222 EAL: Ask a virtual area of 0x2e000 bytes 00:05:16.222 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:16.222 EAL: Setting up physically contiguous memory... 00:05:16.222 EAL: Setting maximum number of open files to 524288 00:05:16.222 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:16.222 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:16.222 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:16.222 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.222 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:16.222 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:16.222 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.222 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:16.222 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:16.222 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.222 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:16.222 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:16.222 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.222 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:16.222 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:16.222 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.222 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:16.222 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:16.222 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.222 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:16.222 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:16.222 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.222 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:16.222 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:16.222 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.222 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:16.222 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:16.222 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:16.222 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.222 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:16.222 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:16.222 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.222 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:16.222 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:16.222 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.222 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:16.222 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:16.222 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.222 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:16.222 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:16.222 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.222 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:16.222 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:16.222 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.222 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:16.222 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:16.222 EAL: Ask a virtual area of 0x61000 bytes 00:05:16.222 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:16.222 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:16.222 EAL: Ask a virtual area of 0x400000000 bytes 00:05:16.222 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:16.222 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:16.222 EAL: Hugepages will be freed exactly as allocated. 00:05:16.222 EAL: No shared files mode enabled, IPC is disabled 00:05:16.222 EAL: No shared files mode enabled, IPC is disabled 00:05:16.222 EAL: TSC frequency is ~2700000 KHz 00:05:16.222 EAL: Main lcore 0 is ready (tid=7fcfd0ab2a00;cpuset=[0]) 00:05:16.222 EAL: Trying to obtain current memory policy. 00:05:16.222 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.222 EAL: Restoring previous memory policy: 0 00:05:16.222 EAL: request: mp_malloc_sync 00:05:16.222 EAL: No shared files mode enabled, IPC is disabled 00:05:16.222 EAL: Heap on socket 0 was expanded by 2MB 00:05:16.222 EAL: No shared files mode enabled, IPC is disabled 00:05:16.222 EAL: No shared files mode enabled, IPC is disabled 00:05:16.222 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:16.222 EAL: Mem event callback 'spdk:(nil)' registered 00:05:16.222 00:05:16.222 00:05:16.222 CUnit - A unit testing framework for C - Version 2.1-3 00:05:16.222 http://cunit.sourceforge.net/ 00:05:16.222 00:05:16.222 00:05:16.222 Suite: components_suite 00:05:16.222 Test: vtophys_malloc_test ...passed 00:05:16.222 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:16.222 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.222 EAL: Restoring previous memory policy: 4 00:05:16.222 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.223 EAL: request: mp_malloc_sync 00:05:16.223 EAL: No shared files mode enabled, IPC is disabled 00:05:16.223 EAL: Heap on socket 0 was expanded by 4MB 00:05:16.223 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.223 EAL: request: mp_malloc_sync 00:05:16.223 EAL: No shared files mode enabled, IPC is disabled 00:05:16.223 EAL: Heap on socket 0 was shrunk by 4MB 00:05:16.223 EAL: Trying to obtain current memory policy. 00:05:16.223 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.223 EAL: Restoring previous memory policy: 4 00:05:16.223 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.223 EAL: request: mp_malloc_sync 00:05:16.223 EAL: No shared files mode enabled, IPC is disabled 00:05:16.223 EAL: Heap on socket 0 was expanded by 6MB 00:05:16.223 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.223 EAL: request: mp_malloc_sync 00:05:16.223 EAL: No shared files mode enabled, IPC is disabled 00:05:16.223 EAL: Heap on socket 0 was shrunk by 6MB 00:05:16.223 EAL: Trying to obtain current memory policy. 00:05:16.223 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.223 EAL: Restoring previous memory policy: 4 00:05:16.223 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.223 EAL: request: mp_malloc_sync 00:05:16.223 EAL: No shared files mode enabled, IPC is disabled 00:05:16.223 EAL: Heap on socket 0 was expanded by 10MB 00:05:16.223 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.223 EAL: request: mp_malloc_sync 00:05:16.223 EAL: No shared files mode enabled, IPC is disabled 00:05:16.223 EAL: Heap on socket 0 was shrunk by 10MB 00:05:16.223 EAL: Trying to obtain current memory policy. 00:05:16.223 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.223 EAL: Restoring previous memory policy: 4 00:05:16.223 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.223 EAL: request: mp_malloc_sync 00:05:16.223 EAL: No shared files mode enabled, IPC is disabled 00:05:16.223 EAL: Heap on socket 0 was expanded by 18MB 00:05:16.223 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.223 EAL: request: mp_malloc_sync 00:05:16.223 EAL: No shared files mode enabled, IPC is disabled 00:05:16.223 EAL: Heap on socket 0 was shrunk by 18MB 00:05:16.223 EAL: Trying to obtain current memory policy. 00:05:16.223 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.223 EAL: Restoring previous memory policy: 4 00:05:16.223 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.223 EAL: request: mp_malloc_sync 00:05:16.223 EAL: No shared files mode enabled, IPC is disabled 00:05:16.223 EAL: Heap on socket 0 was expanded by 34MB 00:05:16.223 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.223 EAL: request: mp_malloc_sync 00:05:16.223 EAL: No shared files mode enabled, IPC is disabled 00:05:16.223 EAL: Heap on socket 0 was shrunk by 34MB 00:05:16.223 EAL: Trying to obtain current memory policy. 00:05:16.223 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.223 EAL: Restoring previous memory policy: 4 00:05:16.223 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.223 EAL: request: mp_malloc_sync 00:05:16.223 EAL: No shared files mode enabled, IPC is disabled 00:05:16.223 EAL: Heap on socket 0 was expanded by 66MB 00:05:16.223 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.223 EAL: request: mp_malloc_sync 00:05:16.223 EAL: No shared files mode enabled, IPC is disabled 00:05:16.223 EAL: Heap on socket 0 was shrunk by 66MB 00:05:16.223 EAL: Trying to obtain current memory policy. 00:05:16.223 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.223 EAL: Restoring previous memory policy: 4 00:05:16.223 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.223 EAL: request: mp_malloc_sync 00:05:16.223 EAL: No shared files mode enabled, IPC is disabled 00:05:16.223 EAL: Heap on socket 0 was expanded by 130MB 00:05:16.223 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.223 EAL: request: mp_malloc_sync 00:05:16.223 EAL: No shared files mode enabled, IPC is disabled 00:05:16.223 EAL: Heap on socket 0 was shrunk by 130MB 00:05:16.223 EAL: Trying to obtain current memory policy. 00:05:16.223 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.481 EAL: Restoring previous memory policy: 4 00:05:16.481 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.481 EAL: request: mp_malloc_sync 00:05:16.481 EAL: No shared files mode enabled, IPC is disabled 00:05:16.481 EAL: Heap on socket 0 was expanded by 258MB 00:05:16.481 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.481 EAL: request: mp_malloc_sync 00:05:16.481 EAL: No shared files mode enabled, IPC is disabled 00:05:16.481 EAL: Heap on socket 0 was shrunk by 258MB 00:05:16.481 EAL: Trying to obtain current memory policy. 00:05:16.481 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.481 EAL: Restoring previous memory policy: 4 00:05:16.481 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.481 EAL: request: mp_malloc_sync 00:05:16.481 EAL: No shared files mode enabled, IPC is disabled 00:05:16.481 EAL: Heap on socket 0 was expanded by 514MB 00:05:16.739 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.739 EAL: request: mp_malloc_sync 00:05:16.739 EAL: No shared files mode enabled, IPC is disabled 00:05:16.739 EAL: Heap on socket 0 was shrunk by 514MB 00:05:16.739 EAL: Trying to obtain current memory policy. 00:05:16.739 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:16.997 EAL: Restoring previous memory policy: 4 00:05:16.997 EAL: Calling mem event callback 'spdk:(nil)' 00:05:16.997 EAL: request: mp_malloc_sync 00:05:16.997 EAL: No shared files mode enabled, IPC is disabled 00:05:16.997 EAL: Heap on socket 0 was expanded by 1026MB 00:05:17.255 EAL: Calling mem event callback 'spdk:(nil)' 00:05:17.514 EAL: request: mp_malloc_sync 00:05:17.514 EAL: No shared files mode enabled, IPC is disabled 00:05:17.514 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:17.514 passed 00:05:17.514 00:05:17.514 Run Summary: Type Total Ran Passed Failed Inactive 00:05:17.514 suites 1 1 n/a 0 0 00:05:17.514 tests 2 2 2 0 0 00:05:17.514 asserts 497 497 497 0 n/a 00:05:17.514 00:05:17.514 Elapsed time = 1.298 seconds 00:05:17.514 EAL: Calling mem event callback 'spdk:(nil)' 00:05:17.514 EAL: request: mp_malloc_sync 00:05:17.514 EAL: No shared files mode enabled, IPC is disabled 00:05:17.514 EAL: Heap on socket 0 was shrunk by 2MB 00:05:17.514 EAL: No shared files mode enabled, IPC is disabled 00:05:17.514 EAL: No shared files mode enabled, IPC is disabled 00:05:17.514 EAL: No shared files mode enabled, IPC is disabled 00:05:17.514 00:05:17.514 real 0m1.411s 00:05:17.514 user 0m0.811s 00:05:17.514 sys 0m0.561s 00:05:17.514 15:49:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:17.514 15:49:07 -- common/autotest_common.sh@10 -- # set +x 00:05:17.514 ************************************ 00:05:17.514 END TEST env_vtophys 00:05:17.514 ************************************ 00:05:17.514 15:49:07 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:17.514 15:49:07 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:17.514 15:49:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:17.514 15:49:07 -- common/autotest_common.sh@10 -- # set +x 00:05:17.514 ************************************ 00:05:17.514 START TEST env_pci 00:05:17.514 ************************************ 00:05:17.514 15:49:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:17.514 00:05:17.514 00:05:17.514 CUnit - A unit testing framework for C - Version 2.1-3 00:05:17.514 http://cunit.sourceforge.net/ 00:05:17.514 00:05:17.514 00:05:17.514 Suite: pci 00:05:17.514 Test: pci_hook ...[2024-10-30 15:49:07.285781] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 2292557 has claimed it 00:05:17.514 EAL: Cannot find device (10000:00:01.0) 00:05:17.514 EAL: Failed to attach device on primary process 00:05:17.514 passed 00:05:17.514 00:05:17.514 Run Summary: Type Total Ran Passed Failed Inactive 00:05:17.514 suites 1 1 n/a 0 0 00:05:17.514 tests 1 1 1 0 0 00:05:17.514 asserts 25 25 25 0 n/a 00:05:17.514 00:05:17.514 Elapsed time = 0.021 seconds 00:05:17.514 00:05:17.514 real 0m0.034s 00:05:17.514 user 0m0.011s 00:05:17.514 sys 0m0.023s 00:05:17.514 15:49:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:17.514 15:49:07 -- common/autotest_common.sh@10 -- # set +x 00:05:17.514 ************************************ 00:05:17.514 END TEST env_pci 00:05:17.514 ************************************ 00:05:17.514 15:49:07 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:17.514 15:49:07 -- env/env.sh@15 -- # uname 00:05:17.514 15:49:07 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:17.514 15:49:07 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:17.514 15:49:07 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:17.514 15:49:07 -- common/autotest_common.sh@1077 -- # '[' 5 -le 1 ']' 00:05:17.514 15:49:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:17.514 15:49:07 -- common/autotest_common.sh@10 -- # set +x 00:05:17.514 ************************************ 00:05:17.514 START TEST env_dpdk_post_init 00:05:17.514 ************************************ 00:05:17.514 15:49:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:17.514 EAL: Detected CPU lcores: 48 00:05:17.514 EAL: Detected NUMA nodes: 2 00:05:17.514 EAL: Detected shared linkage of DPDK 00:05:17.514 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:17.514 EAL: Selected IOVA mode 'VA' 00:05:17.514 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.514 EAL: VFIO support initialized 00:05:17.514 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:17.774 EAL: Using IOMMU type 1 (Type 1) 00:05:17.774 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:17.774 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:17.774 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:17.774 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:17.774 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:17.774 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:17.775 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:17.775 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:17.775 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:17.775 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:17.775 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:17.775 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:17.775 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:17.775 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:17.775 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:17.775 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:18.713 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:21.995 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:21.995 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:21.995 Starting DPDK initialization... 00:05:21.995 Starting SPDK post initialization... 00:05:21.995 SPDK NVMe probe 00:05:21.995 Attaching to 0000:88:00.0 00:05:21.995 Attached to 0000:88:00.0 00:05:21.995 Cleaning up... 00:05:21.995 00:05:21.995 real 0m4.387s 00:05:21.995 user 0m3.256s 00:05:21.995 sys 0m0.190s 00:05:21.995 15:49:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:21.995 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:05:21.995 ************************************ 00:05:21.995 END TEST env_dpdk_post_init 00:05:21.995 ************************************ 00:05:21.995 15:49:11 -- env/env.sh@26 -- # uname 00:05:21.995 15:49:11 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:21.995 15:49:11 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:21.995 15:49:11 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:21.995 15:49:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:21.995 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:05:21.995 ************************************ 00:05:21.995 START TEST env_mem_callbacks 00:05:21.995 ************************************ 00:05:21.995 15:49:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:21.995 EAL: Detected CPU lcores: 48 00:05:21.995 EAL: Detected NUMA nodes: 2 00:05:21.995 EAL: Detected shared linkage of DPDK 00:05:21.995 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:21.995 EAL: Selected IOVA mode 'VA' 00:05:21.995 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.995 EAL: VFIO support initialized 00:05:21.995 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:21.995 00:05:21.995 00:05:21.995 CUnit - A unit testing framework for C - Version 2.1-3 00:05:21.995 http://cunit.sourceforge.net/ 00:05:21.995 00:05:21.995 00:05:21.995 Suite: memory 00:05:21.995 Test: test ... 00:05:21.995 register 0x200000200000 2097152 00:05:21.995 malloc 3145728 00:05:21.995 register 0x200000400000 4194304 00:05:21.995 buf 0x200000500000 len 3145728 PASSED 00:05:21.995 malloc 64 00:05:21.995 buf 0x2000004fff40 len 64 PASSED 00:05:21.995 malloc 4194304 00:05:21.995 register 0x200000800000 6291456 00:05:21.995 buf 0x200000a00000 len 4194304 PASSED 00:05:21.995 free 0x200000500000 3145728 00:05:21.995 free 0x2000004fff40 64 00:05:21.995 unregister 0x200000400000 4194304 PASSED 00:05:21.995 free 0x200000a00000 4194304 00:05:21.995 unregister 0x200000800000 6291456 PASSED 00:05:21.995 malloc 8388608 00:05:21.995 register 0x200000400000 10485760 00:05:21.995 buf 0x200000600000 len 8388608 PASSED 00:05:21.995 free 0x200000600000 8388608 00:05:21.995 unregister 0x200000400000 10485760 PASSED 00:05:21.995 passed 00:05:21.995 00:05:21.995 Run Summary: Type Total Ran Passed Failed Inactive 00:05:21.995 suites 1 1 n/a 0 0 00:05:21.996 tests 1 1 1 0 0 00:05:21.996 asserts 15 15 15 0 n/a 00:05:21.996 00:05:21.996 Elapsed time = 0.005 seconds 00:05:21.996 00:05:21.996 real 0m0.050s 00:05:21.996 user 0m0.016s 00:05:21.996 sys 0m0.034s 00:05:21.996 15:49:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:21.996 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:05:21.996 ************************************ 00:05:21.996 END TEST env_mem_callbacks 00:05:21.996 ************************************ 00:05:21.996 00:05:21.996 real 0m6.227s 00:05:21.996 user 0m4.314s 00:05:21.996 sys 0m0.958s 00:05:21.996 15:49:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:21.996 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:05:21.996 ************************************ 00:05:21.996 END TEST env 00:05:21.996 ************************************ 00:05:21.996 15:49:11 -- spdk/autotest.sh@176 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:21.996 15:49:11 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:21.996 15:49:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:21.996 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:05:21.996 ************************************ 00:05:21.996 START TEST rpc 00:05:21.996 ************************************ 00:05:21.996 15:49:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:22.255 * Looking for test storage... 00:05:22.255 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:22.255 15:49:11 -- rpc/rpc.sh@65 -- # spdk_pid=2293217 00:05:22.255 15:49:11 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:22.255 15:49:11 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:22.255 15:49:11 -- rpc/rpc.sh@67 -- # waitforlisten 2293217 00:05:22.255 15:49:11 -- common/autotest_common.sh@819 -- # '[' -z 2293217 ']' 00:05:22.255 15:49:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:22.255 15:49:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:22.255 15:49:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:22.255 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:22.255 15:49:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:22.255 15:49:11 -- common/autotest_common.sh@10 -- # set +x 00:05:22.255 [2024-10-30 15:49:11.957065] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:22.255 [2024-10-30 15:49:11.957164] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2293217 ] 00:05:22.255 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.255 [2024-10-30 15:49:12.015715] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.255 [2024-10-30 15:49:12.097358] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:22.255 [2024-10-30 15:49:12.097525] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:22.255 [2024-10-30 15:49:12.097542] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 2293217' to capture a snapshot of events at runtime. 00:05:22.255 [2024-10-30 15:49:12.097554] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid2293217 for offline analysis/debug. 00:05:22.255 [2024-10-30 15:49:12.097593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.300 15:49:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:23.300 15:49:12 -- common/autotest_common.sh@852 -- # return 0 00:05:23.300 15:49:12 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:23.300 15:49:12 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:23.300 15:49:12 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:23.300 15:49:12 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:23.300 15:49:12 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:23.300 15:49:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:23.300 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:05:23.300 ************************************ 00:05:23.300 START TEST rpc_integrity 00:05:23.300 ************************************ 00:05:23.300 15:49:12 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:05:23.300 15:49:12 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:23.300 15:49:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.300 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:05:23.300 15:49:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.300 15:49:12 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:23.300 15:49:12 -- rpc/rpc.sh@13 -- # jq length 00:05:23.300 15:49:12 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:23.300 15:49:12 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:23.300 15:49:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.300 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:05:23.300 15:49:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.300 15:49:12 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:23.300 15:49:12 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:23.300 15:49:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.300 15:49:12 -- common/autotest_common.sh@10 -- # set +x 00:05:23.300 15:49:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.300 15:49:12 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:23.300 { 00:05:23.300 "name": "Malloc0", 00:05:23.300 "aliases": [ 00:05:23.300 "5e32bc7c-7f3f-4c5a-9a39-f56640321f4c" 00:05:23.300 ], 00:05:23.300 "product_name": "Malloc disk", 00:05:23.300 "block_size": 512, 00:05:23.300 "num_blocks": 16384, 00:05:23.300 "uuid": "5e32bc7c-7f3f-4c5a-9a39-f56640321f4c", 00:05:23.300 "assigned_rate_limits": { 00:05:23.300 "rw_ios_per_sec": 0, 00:05:23.300 "rw_mbytes_per_sec": 0, 00:05:23.300 "r_mbytes_per_sec": 0, 00:05:23.300 "w_mbytes_per_sec": 0 00:05:23.300 }, 00:05:23.300 "claimed": false, 00:05:23.300 "zoned": false, 00:05:23.300 "supported_io_types": { 00:05:23.300 "read": true, 00:05:23.300 "write": true, 00:05:23.300 "unmap": true, 00:05:23.300 "write_zeroes": true, 00:05:23.300 "flush": true, 00:05:23.300 "reset": true, 00:05:23.300 "compare": false, 00:05:23.300 "compare_and_write": false, 00:05:23.300 "abort": true, 00:05:23.300 "nvme_admin": false, 00:05:23.300 "nvme_io": false 00:05:23.300 }, 00:05:23.300 "memory_domains": [ 00:05:23.300 { 00:05:23.300 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:23.300 "dma_device_type": 2 00:05:23.300 } 00:05:23.300 ], 00:05:23.300 "driver_specific": {} 00:05:23.300 } 00:05:23.300 ]' 00:05:23.300 15:49:12 -- rpc/rpc.sh@17 -- # jq length 00:05:23.300 15:49:13 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:23.300 15:49:13 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:23.300 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.300 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.300 [2024-10-30 15:49:13.016219] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:23.300 [2024-10-30 15:49:13.016290] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:23.300 [2024-10-30 15:49:13.016313] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1fd2bf0 00:05:23.300 [2024-10-30 15:49:13.016329] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:23.300 [2024-10-30 15:49:13.017629] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:23.300 [2024-10-30 15:49:13.017652] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:23.300 Passthru0 00:05:23.300 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.300 15:49:13 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:23.300 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.300 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.300 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.300 15:49:13 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:23.300 { 00:05:23.300 "name": "Malloc0", 00:05:23.300 "aliases": [ 00:05:23.300 "5e32bc7c-7f3f-4c5a-9a39-f56640321f4c" 00:05:23.300 ], 00:05:23.300 "product_name": "Malloc disk", 00:05:23.300 "block_size": 512, 00:05:23.300 "num_blocks": 16384, 00:05:23.300 "uuid": "5e32bc7c-7f3f-4c5a-9a39-f56640321f4c", 00:05:23.300 "assigned_rate_limits": { 00:05:23.300 "rw_ios_per_sec": 0, 00:05:23.300 "rw_mbytes_per_sec": 0, 00:05:23.301 "r_mbytes_per_sec": 0, 00:05:23.301 "w_mbytes_per_sec": 0 00:05:23.301 }, 00:05:23.301 "claimed": true, 00:05:23.301 "claim_type": "exclusive_write", 00:05:23.301 "zoned": false, 00:05:23.301 "supported_io_types": { 00:05:23.301 "read": true, 00:05:23.301 "write": true, 00:05:23.301 "unmap": true, 00:05:23.301 "write_zeroes": true, 00:05:23.301 "flush": true, 00:05:23.301 "reset": true, 00:05:23.301 "compare": false, 00:05:23.301 "compare_and_write": false, 00:05:23.301 "abort": true, 00:05:23.301 "nvme_admin": false, 00:05:23.301 "nvme_io": false 00:05:23.301 }, 00:05:23.301 "memory_domains": [ 00:05:23.301 { 00:05:23.301 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:23.301 "dma_device_type": 2 00:05:23.301 } 00:05:23.301 ], 00:05:23.301 "driver_specific": {} 00:05:23.301 }, 00:05:23.301 { 00:05:23.301 "name": "Passthru0", 00:05:23.301 "aliases": [ 00:05:23.301 "4c67445f-23bb-53c4-b748-799e96678196" 00:05:23.301 ], 00:05:23.301 "product_name": "passthru", 00:05:23.301 "block_size": 512, 00:05:23.301 "num_blocks": 16384, 00:05:23.301 "uuid": "4c67445f-23bb-53c4-b748-799e96678196", 00:05:23.301 "assigned_rate_limits": { 00:05:23.301 "rw_ios_per_sec": 0, 00:05:23.301 "rw_mbytes_per_sec": 0, 00:05:23.301 "r_mbytes_per_sec": 0, 00:05:23.301 "w_mbytes_per_sec": 0 00:05:23.301 }, 00:05:23.301 "claimed": false, 00:05:23.301 "zoned": false, 00:05:23.301 "supported_io_types": { 00:05:23.301 "read": true, 00:05:23.301 "write": true, 00:05:23.301 "unmap": true, 00:05:23.301 "write_zeroes": true, 00:05:23.301 "flush": true, 00:05:23.301 "reset": true, 00:05:23.301 "compare": false, 00:05:23.301 "compare_and_write": false, 00:05:23.301 "abort": true, 00:05:23.301 "nvme_admin": false, 00:05:23.301 "nvme_io": false 00:05:23.301 }, 00:05:23.301 "memory_domains": [ 00:05:23.301 { 00:05:23.301 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:23.301 "dma_device_type": 2 00:05:23.301 } 00:05:23.301 ], 00:05:23.301 "driver_specific": { 00:05:23.301 "passthru": { 00:05:23.301 "name": "Passthru0", 00:05:23.301 "base_bdev_name": "Malloc0" 00:05:23.301 } 00:05:23.301 } 00:05:23.301 } 00:05:23.301 ]' 00:05:23.301 15:49:13 -- rpc/rpc.sh@21 -- # jq length 00:05:23.301 15:49:13 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:23.301 15:49:13 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:23.301 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.301 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.301 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.301 15:49:13 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:23.301 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.301 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.301 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.301 15:49:13 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:23.301 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.301 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.301 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.301 15:49:13 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:23.301 15:49:13 -- rpc/rpc.sh@26 -- # jq length 00:05:23.301 15:49:13 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:23.301 00:05:23.301 real 0m0.212s 00:05:23.301 user 0m0.133s 00:05:23.301 sys 0m0.020s 00:05:23.301 15:49:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:23.301 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.301 ************************************ 00:05:23.301 END TEST rpc_integrity 00:05:23.301 ************************************ 00:05:23.301 15:49:13 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:23.301 15:49:13 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:23.301 15:49:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:23.301 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.301 ************************************ 00:05:23.301 START TEST rpc_plugins 00:05:23.301 ************************************ 00:05:23.301 15:49:13 -- common/autotest_common.sh@1104 -- # rpc_plugins 00:05:23.301 15:49:13 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:23.301 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.301 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.584 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.584 15:49:13 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:23.584 15:49:13 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:23.584 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.584 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.584 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.584 15:49:13 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:23.584 { 00:05:23.584 "name": "Malloc1", 00:05:23.584 "aliases": [ 00:05:23.584 "7daa4304-d3b8-47af-bb8a-ab9832c87d78" 00:05:23.584 ], 00:05:23.584 "product_name": "Malloc disk", 00:05:23.584 "block_size": 4096, 00:05:23.584 "num_blocks": 256, 00:05:23.584 "uuid": "7daa4304-d3b8-47af-bb8a-ab9832c87d78", 00:05:23.584 "assigned_rate_limits": { 00:05:23.584 "rw_ios_per_sec": 0, 00:05:23.584 "rw_mbytes_per_sec": 0, 00:05:23.584 "r_mbytes_per_sec": 0, 00:05:23.584 "w_mbytes_per_sec": 0 00:05:23.584 }, 00:05:23.584 "claimed": false, 00:05:23.584 "zoned": false, 00:05:23.584 "supported_io_types": { 00:05:23.584 "read": true, 00:05:23.584 "write": true, 00:05:23.584 "unmap": true, 00:05:23.584 "write_zeroes": true, 00:05:23.584 "flush": true, 00:05:23.584 "reset": true, 00:05:23.584 "compare": false, 00:05:23.584 "compare_and_write": false, 00:05:23.584 "abort": true, 00:05:23.584 "nvme_admin": false, 00:05:23.584 "nvme_io": false 00:05:23.584 }, 00:05:23.584 "memory_domains": [ 00:05:23.584 { 00:05:23.584 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:23.584 "dma_device_type": 2 00:05:23.584 } 00:05:23.584 ], 00:05:23.584 "driver_specific": {} 00:05:23.584 } 00:05:23.584 ]' 00:05:23.584 15:49:13 -- rpc/rpc.sh@32 -- # jq length 00:05:23.584 15:49:13 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:23.584 15:49:13 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:23.584 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.584 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.584 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.584 15:49:13 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:23.584 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.584 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.584 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.584 15:49:13 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:23.584 15:49:13 -- rpc/rpc.sh@36 -- # jq length 00:05:23.584 15:49:13 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:23.584 00:05:23.584 real 0m0.102s 00:05:23.584 user 0m0.065s 00:05:23.584 sys 0m0.010s 00:05:23.584 15:49:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:23.584 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.584 ************************************ 00:05:23.584 END TEST rpc_plugins 00:05:23.584 ************************************ 00:05:23.584 15:49:13 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:23.584 15:49:13 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:23.584 15:49:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:23.584 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.584 ************************************ 00:05:23.584 START TEST rpc_trace_cmd_test 00:05:23.584 ************************************ 00:05:23.584 15:49:13 -- common/autotest_common.sh@1104 -- # rpc_trace_cmd_test 00:05:23.584 15:49:13 -- rpc/rpc.sh@40 -- # local info 00:05:23.584 15:49:13 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:23.584 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.584 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.584 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.584 15:49:13 -- rpc/rpc.sh@42 -- # info='{ 00:05:23.584 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid2293217", 00:05:23.584 "tpoint_group_mask": "0x8", 00:05:23.584 "iscsi_conn": { 00:05:23.584 "mask": "0x2", 00:05:23.584 "tpoint_mask": "0x0" 00:05:23.584 }, 00:05:23.584 "scsi": { 00:05:23.584 "mask": "0x4", 00:05:23.584 "tpoint_mask": "0x0" 00:05:23.584 }, 00:05:23.584 "bdev": { 00:05:23.584 "mask": "0x8", 00:05:23.584 "tpoint_mask": "0xffffffffffffffff" 00:05:23.584 }, 00:05:23.584 "nvmf_rdma": { 00:05:23.584 "mask": "0x10", 00:05:23.584 "tpoint_mask": "0x0" 00:05:23.584 }, 00:05:23.584 "nvmf_tcp": { 00:05:23.584 "mask": "0x20", 00:05:23.584 "tpoint_mask": "0x0" 00:05:23.584 }, 00:05:23.584 "ftl": { 00:05:23.584 "mask": "0x40", 00:05:23.584 "tpoint_mask": "0x0" 00:05:23.584 }, 00:05:23.584 "blobfs": { 00:05:23.584 "mask": "0x80", 00:05:23.584 "tpoint_mask": "0x0" 00:05:23.584 }, 00:05:23.584 "dsa": { 00:05:23.584 "mask": "0x200", 00:05:23.584 "tpoint_mask": "0x0" 00:05:23.584 }, 00:05:23.584 "thread": { 00:05:23.584 "mask": "0x400", 00:05:23.584 "tpoint_mask": "0x0" 00:05:23.584 }, 00:05:23.584 "nvme_pcie": { 00:05:23.584 "mask": "0x800", 00:05:23.584 "tpoint_mask": "0x0" 00:05:23.584 }, 00:05:23.584 "iaa": { 00:05:23.584 "mask": "0x1000", 00:05:23.584 "tpoint_mask": "0x0" 00:05:23.584 }, 00:05:23.584 "nvme_tcp": { 00:05:23.584 "mask": "0x2000", 00:05:23.584 "tpoint_mask": "0x0" 00:05:23.584 }, 00:05:23.584 "bdev_nvme": { 00:05:23.584 "mask": "0x4000", 00:05:23.584 "tpoint_mask": "0x0" 00:05:23.584 } 00:05:23.584 }' 00:05:23.584 15:49:13 -- rpc/rpc.sh@43 -- # jq length 00:05:23.584 15:49:13 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:23.585 15:49:13 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:23.585 15:49:13 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:23.585 15:49:13 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:23.585 15:49:13 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:23.585 15:49:13 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:23.585 15:49:13 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:23.585 15:49:13 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:23.844 15:49:13 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:23.844 00:05:23.844 real 0m0.183s 00:05:23.844 user 0m0.160s 00:05:23.844 sys 0m0.017s 00:05:23.844 15:49:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:23.844 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.844 ************************************ 00:05:23.844 END TEST rpc_trace_cmd_test 00:05:23.844 ************************************ 00:05:23.844 15:49:13 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:23.844 15:49:13 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:23.844 15:49:13 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:23.844 15:49:13 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:23.844 15:49:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:23.844 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.844 ************************************ 00:05:23.844 START TEST rpc_daemon_integrity 00:05:23.844 ************************************ 00:05:23.844 15:49:13 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:05:23.844 15:49:13 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:23.844 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.844 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.844 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.844 15:49:13 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:23.844 15:49:13 -- rpc/rpc.sh@13 -- # jq length 00:05:23.844 15:49:13 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:23.844 15:49:13 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:23.844 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.844 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.844 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.844 15:49:13 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:23.844 15:49:13 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:23.844 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.844 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.844 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.844 15:49:13 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:23.844 { 00:05:23.844 "name": "Malloc2", 00:05:23.844 "aliases": [ 00:05:23.844 "c93cdf5e-058d-4c5c-9a3f-1764f756bb73" 00:05:23.844 ], 00:05:23.844 "product_name": "Malloc disk", 00:05:23.844 "block_size": 512, 00:05:23.844 "num_blocks": 16384, 00:05:23.844 "uuid": "c93cdf5e-058d-4c5c-9a3f-1764f756bb73", 00:05:23.844 "assigned_rate_limits": { 00:05:23.844 "rw_ios_per_sec": 0, 00:05:23.844 "rw_mbytes_per_sec": 0, 00:05:23.844 "r_mbytes_per_sec": 0, 00:05:23.844 "w_mbytes_per_sec": 0 00:05:23.844 }, 00:05:23.844 "claimed": false, 00:05:23.844 "zoned": false, 00:05:23.844 "supported_io_types": { 00:05:23.844 "read": true, 00:05:23.844 "write": true, 00:05:23.844 "unmap": true, 00:05:23.844 "write_zeroes": true, 00:05:23.844 "flush": true, 00:05:23.844 "reset": true, 00:05:23.844 "compare": false, 00:05:23.844 "compare_and_write": false, 00:05:23.844 "abort": true, 00:05:23.844 "nvme_admin": false, 00:05:23.844 "nvme_io": false 00:05:23.844 }, 00:05:23.844 "memory_domains": [ 00:05:23.844 { 00:05:23.844 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:23.844 "dma_device_type": 2 00:05:23.844 } 00:05:23.844 ], 00:05:23.844 "driver_specific": {} 00:05:23.844 } 00:05:23.844 ]' 00:05:23.844 15:49:13 -- rpc/rpc.sh@17 -- # jq length 00:05:23.844 15:49:13 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:23.844 15:49:13 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:23.844 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.844 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.844 [2024-10-30 15:49:13.585841] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:23.844 [2024-10-30 15:49:13.585885] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:23.844 [2024-10-30 15:49:13.585905] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x2172940 00:05:23.844 [2024-10-30 15:49:13.585917] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:23.844 [2024-10-30 15:49:13.587062] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:23.844 [2024-10-30 15:49:13.587085] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:23.844 Passthru0 00:05:23.844 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.844 15:49:13 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:23.844 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.844 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.844 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.844 15:49:13 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:23.844 { 00:05:23.844 "name": "Malloc2", 00:05:23.844 "aliases": [ 00:05:23.844 "c93cdf5e-058d-4c5c-9a3f-1764f756bb73" 00:05:23.844 ], 00:05:23.844 "product_name": "Malloc disk", 00:05:23.844 "block_size": 512, 00:05:23.844 "num_blocks": 16384, 00:05:23.844 "uuid": "c93cdf5e-058d-4c5c-9a3f-1764f756bb73", 00:05:23.844 "assigned_rate_limits": { 00:05:23.844 "rw_ios_per_sec": 0, 00:05:23.844 "rw_mbytes_per_sec": 0, 00:05:23.844 "r_mbytes_per_sec": 0, 00:05:23.844 "w_mbytes_per_sec": 0 00:05:23.844 }, 00:05:23.844 "claimed": true, 00:05:23.844 "claim_type": "exclusive_write", 00:05:23.844 "zoned": false, 00:05:23.844 "supported_io_types": { 00:05:23.844 "read": true, 00:05:23.844 "write": true, 00:05:23.844 "unmap": true, 00:05:23.844 "write_zeroes": true, 00:05:23.844 "flush": true, 00:05:23.844 "reset": true, 00:05:23.844 "compare": false, 00:05:23.844 "compare_and_write": false, 00:05:23.844 "abort": true, 00:05:23.844 "nvme_admin": false, 00:05:23.844 "nvme_io": false 00:05:23.844 }, 00:05:23.844 "memory_domains": [ 00:05:23.844 { 00:05:23.844 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:23.844 "dma_device_type": 2 00:05:23.844 } 00:05:23.844 ], 00:05:23.844 "driver_specific": {} 00:05:23.844 }, 00:05:23.844 { 00:05:23.844 "name": "Passthru0", 00:05:23.844 "aliases": [ 00:05:23.844 "c31aa336-a841-59eb-8003-94a80b4dbef3" 00:05:23.844 ], 00:05:23.844 "product_name": "passthru", 00:05:23.844 "block_size": 512, 00:05:23.844 "num_blocks": 16384, 00:05:23.844 "uuid": "c31aa336-a841-59eb-8003-94a80b4dbef3", 00:05:23.844 "assigned_rate_limits": { 00:05:23.844 "rw_ios_per_sec": 0, 00:05:23.844 "rw_mbytes_per_sec": 0, 00:05:23.844 "r_mbytes_per_sec": 0, 00:05:23.844 "w_mbytes_per_sec": 0 00:05:23.844 }, 00:05:23.844 "claimed": false, 00:05:23.844 "zoned": false, 00:05:23.844 "supported_io_types": { 00:05:23.844 "read": true, 00:05:23.844 "write": true, 00:05:23.844 "unmap": true, 00:05:23.844 "write_zeroes": true, 00:05:23.844 "flush": true, 00:05:23.844 "reset": true, 00:05:23.844 "compare": false, 00:05:23.844 "compare_and_write": false, 00:05:23.844 "abort": true, 00:05:23.844 "nvme_admin": false, 00:05:23.844 "nvme_io": false 00:05:23.844 }, 00:05:23.844 "memory_domains": [ 00:05:23.844 { 00:05:23.844 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:23.844 "dma_device_type": 2 00:05:23.844 } 00:05:23.844 ], 00:05:23.844 "driver_specific": { 00:05:23.844 "passthru": { 00:05:23.844 "name": "Passthru0", 00:05:23.844 "base_bdev_name": "Malloc2" 00:05:23.844 } 00:05:23.844 } 00:05:23.844 } 00:05:23.844 ]' 00:05:23.844 15:49:13 -- rpc/rpc.sh@21 -- # jq length 00:05:23.844 15:49:13 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:23.844 15:49:13 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:23.844 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.844 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.844 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.844 15:49:13 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:23.844 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.844 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.844 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.844 15:49:13 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:23.844 15:49:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:23.844 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.844 15:49:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:23.844 15:49:13 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:23.844 15:49:13 -- rpc/rpc.sh@26 -- # jq length 00:05:23.844 15:49:13 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:23.844 00:05:23.844 real 0m0.205s 00:05:23.844 user 0m0.132s 00:05:23.844 sys 0m0.018s 00:05:23.844 15:49:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:23.844 15:49:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.844 ************************************ 00:05:23.844 END TEST rpc_daemon_integrity 00:05:23.844 ************************************ 00:05:23.844 15:49:13 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:23.844 15:49:13 -- rpc/rpc.sh@84 -- # killprocess 2293217 00:05:23.844 15:49:13 -- common/autotest_common.sh@926 -- # '[' -z 2293217 ']' 00:05:23.844 15:49:13 -- common/autotest_common.sh@930 -- # kill -0 2293217 00:05:23.844 15:49:13 -- common/autotest_common.sh@931 -- # uname 00:05:23.844 15:49:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:23.844 15:49:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2293217 00:05:24.103 15:49:13 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:24.103 15:49:13 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:24.103 15:49:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2293217' 00:05:24.103 killing process with pid 2293217 00:05:24.103 15:49:13 -- common/autotest_common.sh@945 -- # kill 2293217 00:05:24.103 15:49:13 -- common/autotest_common.sh@950 -- # wait 2293217 00:05:24.362 00:05:24.362 real 0m2.279s 00:05:24.362 user 0m2.926s 00:05:24.362 sys 0m0.547s 00:05:24.362 15:49:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:24.362 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:05:24.362 ************************************ 00:05:24.362 END TEST rpc 00:05:24.362 ************************************ 00:05:24.362 15:49:14 -- spdk/autotest.sh@177 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:24.362 15:49:14 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:24.362 15:49:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:24.362 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:05:24.362 ************************************ 00:05:24.362 START TEST rpc_client 00:05:24.362 ************************************ 00:05:24.362 15:49:14 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:24.362 * Looking for test storage... 00:05:24.362 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:24.362 15:49:14 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:24.362 OK 00:05:24.362 15:49:14 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:24.362 00:05:24.362 real 0m0.068s 00:05:24.362 user 0m0.030s 00:05:24.362 sys 0m0.044s 00:05:24.362 15:49:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:24.362 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:05:24.362 ************************************ 00:05:24.362 END TEST rpc_client 00:05:24.362 ************************************ 00:05:24.622 15:49:14 -- spdk/autotest.sh@178 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:24.622 15:49:14 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:24.622 15:49:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:24.622 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:05:24.622 ************************************ 00:05:24.622 START TEST json_config 00:05:24.622 ************************************ 00:05:24.622 15:49:14 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:24.622 15:49:14 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:24.622 15:49:14 -- nvmf/common.sh@7 -- # uname -s 00:05:24.622 15:49:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:24.622 15:49:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:24.622 15:49:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:24.622 15:49:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:24.622 15:49:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:24.622 15:49:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:24.622 15:49:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:24.622 15:49:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:24.622 15:49:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:24.622 15:49:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:24.622 15:49:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:24.622 15:49:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:24.622 15:49:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:24.622 15:49:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:24.622 15:49:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:24.622 15:49:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:24.622 15:49:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:24.622 15:49:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:24.622 15:49:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:24.622 15:49:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:24.622 15:49:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:24.622 15:49:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:24.622 15:49:14 -- paths/export.sh@5 -- # export PATH 00:05:24.622 15:49:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:24.622 15:49:14 -- nvmf/common.sh@46 -- # : 0 00:05:24.622 15:49:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:24.622 15:49:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:24.622 15:49:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:24.622 15:49:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:24.622 15:49:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:24.622 15:49:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:24.622 15:49:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:24.622 15:49:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:24.622 15:49:14 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:24.622 15:49:14 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:24.622 15:49:14 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:24.622 15:49:14 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:24.622 15:49:14 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:24.622 15:49:14 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:24.622 15:49:14 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:24.622 15:49:14 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:24.622 15:49:14 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:24.622 15:49:14 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:24.622 15:49:14 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:24.622 15:49:14 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:24.622 15:49:14 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:24.622 15:49:14 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:24.622 15:49:14 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:24.622 INFO: JSON configuration test init 00:05:24.622 15:49:14 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:24.622 15:49:14 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:24.622 15:49:14 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:24.622 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:05:24.622 15:49:14 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:24.622 15:49:14 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:24.622 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:05:24.622 15:49:14 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:24.622 15:49:14 -- json_config/json_config.sh@98 -- # local app=target 00:05:24.622 15:49:14 -- json_config/json_config.sh@99 -- # shift 00:05:24.622 15:49:14 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:24.622 15:49:14 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:24.622 15:49:14 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:24.622 15:49:14 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:24.622 15:49:14 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:24.622 15:49:14 -- json_config/json_config.sh@111 -- # app_pid[$app]=2293706 00:05:24.622 15:49:14 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:24.622 15:49:14 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:24.622 Waiting for target to run... 00:05:24.622 15:49:14 -- json_config/json_config.sh@114 -- # waitforlisten 2293706 /var/tmp/spdk_tgt.sock 00:05:24.623 15:49:14 -- common/autotest_common.sh@819 -- # '[' -z 2293706 ']' 00:05:24.623 15:49:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:24.623 15:49:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:24.623 15:49:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:24.623 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:24.623 15:49:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:24.623 15:49:14 -- common/autotest_common.sh@10 -- # set +x 00:05:24.623 [2024-10-30 15:49:14.357577] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:24.623 [2024-10-30 15:49:14.357660] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2293706 ] 00:05:24.623 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.881 [2024-10-30 15:49:14.686566] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.881 [2024-10-30 15:49:14.742331] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:24.881 [2024-10-30 15:49:14.742489] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.448 15:49:15 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:25.448 15:49:15 -- common/autotest_common.sh@852 -- # return 0 00:05:25.448 15:49:15 -- json_config/json_config.sh@115 -- # echo '' 00:05:25.448 00:05:25.448 15:49:15 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:25.448 15:49:15 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:25.448 15:49:15 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:25.448 15:49:15 -- common/autotest_common.sh@10 -- # set +x 00:05:25.448 15:49:15 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:25.448 15:49:15 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:25.448 15:49:15 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:25.448 15:49:15 -- common/autotest_common.sh@10 -- # set +x 00:05:25.706 15:49:15 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:25.706 15:49:15 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:25.706 15:49:15 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:28.994 15:49:18 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:28.994 15:49:18 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:28.994 15:49:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:28.994 15:49:18 -- common/autotest_common.sh@10 -- # set +x 00:05:28.994 15:49:18 -- json_config/json_config.sh@48 -- # local ret=0 00:05:28.994 15:49:18 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:28.994 15:49:18 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:28.994 15:49:18 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:28.994 15:49:18 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:28.994 15:49:18 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:28.994 15:49:18 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:28.994 15:49:18 -- json_config/json_config.sh@51 -- # local get_types 00:05:28.994 15:49:18 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:28.994 15:49:18 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:28.994 15:49:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:28.994 15:49:18 -- common/autotest_common.sh@10 -- # set +x 00:05:28.994 15:49:18 -- json_config/json_config.sh@58 -- # return 0 00:05:28.994 15:49:18 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:28.994 15:49:18 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:28.994 15:49:18 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:28.994 15:49:18 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:28.994 15:49:18 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:28.994 15:49:18 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:28.994 15:49:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:28.994 15:49:18 -- common/autotest_common.sh@10 -- # set +x 00:05:28.994 15:49:18 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:28.995 15:49:18 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:28.995 15:49:18 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:28.995 15:49:18 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:28.995 15:49:18 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:29.253 MallocForNvmf0 00:05:29.253 15:49:18 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:29.253 15:49:18 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:29.510 MallocForNvmf1 00:05:29.510 15:49:19 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:29.510 15:49:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:29.769 [2024-10-30 15:49:19.487776] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:29.769 15:49:19 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:29.769 15:49:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:30.026 15:49:19 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:30.026 15:49:19 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:30.283 15:49:20 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:30.283 15:49:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:30.541 15:49:20 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:30.541 15:49:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:30.799 [2024-10-30 15:49:20.494941] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:30.799 15:49:20 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:30.799 15:49:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:30.799 15:49:20 -- common/autotest_common.sh@10 -- # set +x 00:05:30.799 15:49:20 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:30.799 15:49:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:30.799 15:49:20 -- common/autotest_common.sh@10 -- # set +x 00:05:30.799 15:49:20 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:30.799 15:49:20 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:30.799 15:49:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:31.058 MallocBdevForConfigChangeCheck 00:05:31.058 15:49:20 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:31.058 15:49:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:31.058 15:49:20 -- common/autotest_common.sh@10 -- # set +x 00:05:31.058 15:49:20 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:31.058 15:49:20 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:31.625 15:49:21 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:31.625 INFO: shutting down applications... 00:05:31.625 15:49:21 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:31.625 15:49:21 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:31.625 15:49:21 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:31.625 15:49:21 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:33.000 Calling clear_iscsi_subsystem 00:05:33.000 Calling clear_nvmf_subsystem 00:05:33.000 Calling clear_nbd_subsystem 00:05:33.000 Calling clear_ublk_subsystem 00:05:33.000 Calling clear_vhost_blk_subsystem 00:05:33.000 Calling clear_vhost_scsi_subsystem 00:05:33.000 Calling clear_scheduler_subsystem 00:05:33.000 Calling clear_bdev_subsystem 00:05:33.000 Calling clear_accel_subsystem 00:05:33.000 Calling clear_vmd_subsystem 00:05:33.000 Calling clear_sock_subsystem 00:05:33.000 Calling clear_iobuf_subsystem 00:05:33.000 15:49:22 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:33.000 15:49:22 -- json_config/json_config.sh@396 -- # count=100 00:05:33.000 15:49:22 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:33.000 15:49:22 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:33.000 15:49:22 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:33.000 15:49:22 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:33.567 15:49:23 -- json_config/json_config.sh@398 -- # break 00:05:33.567 15:49:23 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:33.567 15:49:23 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:33.567 15:49:23 -- json_config/json_config.sh@120 -- # local app=target 00:05:33.567 15:49:23 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:33.567 15:49:23 -- json_config/json_config.sh@124 -- # [[ -n 2293706 ]] 00:05:33.567 15:49:23 -- json_config/json_config.sh@127 -- # kill -SIGINT 2293706 00:05:33.567 15:49:23 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:33.567 15:49:23 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:33.567 15:49:23 -- json_config/json_config.sh@130 -- # kill -0 2293706 00:05:33.567 15:49:23 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:34.136 15:49:23 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:34.136 15:49:23 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:34.136 15:49:23 -- json_config/json_config.sh@130 -- # kill -0 2293706 00:05:34.136 15:49:23 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:34.136 15:49:23 -- json_config/json_config.sh@132 -- # break 00:05:34.136 15:49:23 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:34.136 15:49:23 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:34.136 SPDK target shutdown done 00:05:34.136 15:49:23 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:34.136 INFO: relaunching applications... 00:05:34.136 15:49:23 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:34.136 15:49:23 -- json_config/json_config.sh@98 -- # local app=target 00:05:34.136 15:49:23 -- json_config/json_config.sh@99 -- # shift 00:05:34.136 15:49:23 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:34.136 15:49:23 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:34.136 15:49:23 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:34.136 15:49:23 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:34.136 15:49:23 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:34.136 15:49:23 -- json_config/json_config.sh@111 -- # app_pid[$app]=2294931 00:05:34.136 15:49:23 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:34.136 15:49:23 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:34.136 Waiting for target to run... 00:05:34.136 15:49:23 -- json_config/json_config.sh@114 -- # waitforlisten 2294931 /var/tmp/spdk_tgt.sock 00:05:34.136 15:49:23 -- common/autotest_common.sh@819 -- # '[' -z 2294931 ']' 00:05:34.136 15:49:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:34.136 15:49:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:34.136 15:49:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:34.136 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:34.136 15:49:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:34.136 15:49:23 -- common/autotest_common.sh@10 -- # set +x 00:05:34.136 [2024-10-30 15:49:23.770318] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:34.136 [2024-10-30 15:49:23.770424] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2294931 ] 00:05:34.136 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.704 [2024-10-30 15:49:24.333193] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.704 [2024-10-30 15:49:24.404767] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:34.704 [2024-10-30 15:49:24.404942] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.988 [2024-10-30 15:49:27.427985] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:37.988 [2024-10-30 15:49:27.460462] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:37.988 15:49:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:37.988 15:49:27 -- common/autotest_common.sh@852 -- # return 0 00:05:37.988 15:49:27 -- json_config/json_config.sh@115 -- # echo '' 00:05:37.988 00:05:37.988 15:49:27 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:37.988 15:49:27 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:37.988 INFO: Checking if target configuration is the same... 00:05:37.988 15:49:27 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:37.988 15:49:27 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:37.988 15:49:27 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:37.988 + '[' 2 -ne 2 ']' 00:05:37.988 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:37.988 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:37.988 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:37.988 +++ basename /dev/fd/62 00:05:37.988 ++ mktemp /tmp/62.XXX 00:05:37.988 + tmp_file_1=/tmp/62.bSV 00:05:37.988 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:37.988 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:37.988 + tmp_file_2=/tmp/spdk_tgt_config.json.qIV 00:05:37.988 + ret=0 00:05:37.988 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:38.246 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:38.246 + diff -u /tmp/62.bSV /tmp/spdk_tgt_config.json.qIV 00:05:38.246 + echo 'INFO: JSON config files are the same' 00:05:38.246 INFO: JSON config files are the same 00:05:38.246 + rm /tmp/62.bSV /tmp/spdk_tgt_config.json.qIV 00:05:38.503 + exit 0 00:05:38.503 15:49:28 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:38.503 15:49:28 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:38.503 INFO: changing configuration and checking if this can be detected... 00:05:38.503 15:49:28 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:38.503 15:49:28 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:38.503 15:49:28 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:38.503 15:49:28 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:38.503 15:49:28 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:38.503 + '[' 2 -ne 2 ']' 00:05:38.503 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:38.503 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:38.503 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:38.503 +++ basename /dev/fd/62 00:05:38.503 ++ mktemp /tmp/62.XXX 00:05:38.761 + tmp_file_1=/tmp/62.nFk 00:05:38.761 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:38.761 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:38.761 + tmp_file_2=/tmp/spdk_tgt_config.json.QnB 00:05:38.761 + ret=0 00:05:38.761 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:39.019 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:39.019 + diff -u /tmp/62.nFk /tmp/spdk_tgt_config.json.QnB 00:05:39.019 + ret=1 00:05:39.019 + echo '=== Start of file: /tmp/62.nFk ===' 00:05:39.019 + cat /tmp/62.nFk 00:05:39.019 + echo '=== End of file: /tmp/62.nFk ===' 00:05:39.019 + echo '' 00:05:39.019 + echo '=== Start of file: /tmp/spdk_tgt_config.json.QnB ===' 00:05:39.019 + cat /tmp/spdk_tgt_config.json.QnB 00:05:39.019 + echo '=== End of file: /tmp/spdk_tgt_config.json.QnB ===' 00:05:39.019 + echo '' 00:05:39.019 + rm /tmp/62.nFk /tmp/spdk_tgt_config.json.QnB 00:05:39.019 + exit 1 00:05:39.019 15:49:28 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:39.019 INFO: configuration change detected. 00:05:39.019 15:49:28 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:39.019 15:49:28 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:39.019 15:49:28 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:39.019 15:49:28 -- common/autotest_common.sh@10 -- # set +x 00:05:39.019 15:49:28 -- json_config/json_config.sh@360 -- # local ret=0 00:05:39.019 15:49:28 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:39.019 15:49:28 -- json_config/json_config.sh@370 -- # [[ -n 2294931 ]] 00:05:39.019 15:49:28 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:39.019 15:49:28 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:39.019 15:49:28 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:39.019 15:49:28 -- common/autotest_common.sh@10 -- # set +x 00:05:39.019 15:49:28 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:39.019 15:49:28 -- json_config/json_config.sh@246 -- # uname -s 00:05:39.019 15:49:28 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:39.019 15:49:28 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:39.019 15:49:28 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:39.019 15:49:28 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:39.019 15:49:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:39.019 15:49:28 -- common/autotest_common.sh@10 -- # set +x 00:05:39.019 15:49:28 -- json_config/json_config.sh@376 -- # killprocess 2294931 00:05:39.019 15:49:28 -- common/autotest_common.sh@926 -- # '[' -z 2294931 ']' 00:05:39.019 15:49:28 -- common/autotest_common.sh@930 -- # kill -0 2294931 00:05:39.019 15:49:28 -- common/autotest_common.sh@931 -- # uname 00:05:39.019 15:49:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:39.019 15:49:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2294931 00:05:39.019 15:49:28 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:39.019 15:49:28 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:39.019 15:49:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2294931' 00:05:39.019 killing process with pid 2294931 00:05:39.019 15:49:28 -- common/autotest_common.sh@945 -- # kill 2294931 00:05:39.019 15:49:28 -- common/autotest_common.sh@950 -- # wait 2294931 00:05:40.917 15:49:30 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:40.917 15:49:30 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:40.917 15:49:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:40.917 15:49:30 -- common/autotest_common.sh@10 -- # set +x 00:05:40.917 15:49:30 -- json_config/json_config.sh@381 -- # return 0 00:05:40.917 15:49:30 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:40.917 INFO: Success 00:05:40.917 00:05:40.917 real 0m16.234s 00:05:40.917 user 0m18.668s 00:05:40.917 sys 0m2.114s 00:05:40.917 15:49:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:40.917 15:49:30 -- common/autotest_common.sh@10 -- # set +x 00:05:40.917 ************************************ 00:05:40.917 END TEST json_config 00:05:40.917 ************************************ 00:05:40.917 15:49:30 -- spdk/autotest.sh@179 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:40.917 15:49:30 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:40.917 15:49:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:40.917 15:49:30 -- common/autotest_common.sh@10 -- # set +x 00:05:40.917 ************************************ 00:05:40.917 START TEST json_config_extra_key 00:05:40.917 ************************************ 00:05:40.917 15:49:30 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:40.917 15:49:30 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:40.917 15:49:30 -- nvmf/common.sh@7 -- # uname -s 00:05:40.917 15:49:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:40.917 15:49:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:40.917 15:49:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:40.917 15:49:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:40.917 15:49:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:40.917 15:49:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:40.917 15:49:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:40.917 15:49:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:40.917 15:49:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:40.917 15:49:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:40.918 15:49:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:40.918 15:49:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:40.918 15:49:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:40.918 15:49:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:40.918 15:49:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:40.918 15:49:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:40.918 15:49:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:40.918 15:49:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:40.918 15:49:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:40.918 15:49:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:40.918 15:49:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:40.918 15:49:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:40.918 15:49:30 -- paths/export.sh@5 -- # export PATH 00:05:40.918 15:49:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:40.918 15:49:30 -- nvmf/common.sh@46 -- # : 0 00:05:40.918 15:49:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:40.918 15:49:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:40.918 15:49:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:40.918 15:49:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:40.918 15:49:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:40.918 15:49:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:40.918 15:49:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:40.918 15:49:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:40.918 INFO: launching applications... 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=2295873 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:40.918 Waiting for target to run... 00:05:40.918 15:49:30 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 2295873 /var/tmp/spdk_tgt.sock 00:05:40.918 15:49:30 -- common/autotest_common.sh@819 -- # '[' -z 2295873 ']' 00:05:40.918 15:49:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:40.918 15:49:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:40.918 15:49:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:40.918 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:40.918 15:49:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:40.918 15:49:30 -- common/autotest_common.sh@10 -- # set +x 00:05:40.918 [2024-10-30 15:49:30.621316] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:40.918 [2024-10-30 15:49:30.621409] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2295873 ] 00:05:40.918 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.487 [2024-10-30 15:49:31.124990] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.487 [2024-10-30 15:49:31.198442] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:41.487 [2024-10-30 15:49:31.198597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.745 15:49:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:41.745 15:49:31 -- common/autotest_common.sh@852 -- # return 0 00:05:41.745 15:49:31 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:41.745 00:05:41.745 15:49:31 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:41.745 INFO: shutting down applications... 00:05:41.745 15:49:31 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:41.745 15:49:31 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:41.745 15:49:31 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:41.745 15:49:31 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 2295873 ]] 00:05:41.745 15:49:31 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 2295873 00:05:41.745 15:49:31 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:41.745 15:49:31 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:41.745 15:49:31 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2295873 00:05:41.745 15:49:31 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:05:42.311 15:49:32 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:05:42.311 15:49:32 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:42.311 15:49:32 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2295873 00:05:42.311 15:49:32 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:05:42.311 15:49:32 -- json_config/json_config_extra_key.sh@52 -- # break 00:05:42.311 15:49:32 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:05:42.311 15:49:32 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:05:42.311 SPDK target shutdown done 00:05:42.311 15:49:32 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:05:42.311 Success 00:05:42.311 00:05:42.311 real 0m1.555s 00:05:42.311 user 0m1.350s 00:05:42.311 sys 0m0.591s 00:05:42.311 15:49:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:42.311 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:05:42.311 ************************************ 00:05:42.311 END TEST json_config_extra_key 00:05:42.311 ************************************ 00:05:42.311 15:49:32 -- spdk/autotest.sh@180 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:42.311 15:49:32 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:42.311 15:49:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:42.311 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:05:42.311 ************************************ 00:05:42.311 START TEST alias_rpc 00:05:42.311 ************************************ 00:05:42.311 15:49:32 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:42.311 * Looking for test storage... 00:05:42.311 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:05:42.311 15:49:32 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:42.311 15:49:32 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=2296174 00:05:42.311 15:49:32 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 2296174 00:05:42.311 15:49:32 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:42.311 15:49:32 -- common/autotest_common.sh@819 -- # '[' -z 2296174 ']' 00:05:42.311 15:49:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:42.311 15:49:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:42.311 15:49:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:42.311 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:42.311 15:49:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:42.311 15:49:32 -- common/autotest_common.sh@10 -- # set +x 00:05:42.570 [2024-10-30 15:49:32.203046] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:42.570 [2024-10-30 15:49:32.203121] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2296174 ] 00:05:42.570 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.570 [2024-10-30 15:49:32.261697] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.570 [2024-10-30 15:49:32.344979] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:42.570 [2024-10-30 15:49:32.345131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.506 15:49:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:43.506 15:49:33 -- common/autotest_common.sh@852 -- # return 0 00:05:43.506 15:49:33 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:43.765 15:49:33 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 2296174 00:05:43.765 15:49:33 -- common/autotest_common.sh@926 -- # '[' -z 2296174 ']' 00:05:43.765 15:49:33 -- common/autotest_common.sh@930 -- # kill -0 2296174 00:05:43.765 15:49:33 -- common/autotest_common.sh@931 -- # uname 00:05:43.765 15:49:33 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:43.765 15:49:33 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2296174 00:05:43.765 15:49:33 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:43.765 15:49:33 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:43.765 15:49:33 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2296174' 00:05:43.765 killing process with pid 2296174 00:05:43.765 15:49:33 -- common/autotest_common.sh@945 -- # kill 2296174 00:05:43.765 15:49:33 -- common/autotest_common.sh@950 -- # wait 2296174 00:05:44.024 00:05:44.024 real 0m1.759s 00:05:44.024 user 0m2.084s 00:05:44.024 sys 0m0.446s 00:05:44.024 15:49:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:44.024 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:05:44.024 ************************************ 00:05:44.024 END TEST alias_rpc 00:05:44.024 ************************************ 00:05:44.024 15:49:33 -- spdk/autotest.sh@182 -- # [[ 0 -eq 0 ]] 00:05:44.024 15:49:33 -- spdk/autotest.sh@183 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:44.024 15:49:33 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:44.024 15:49:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:44.024 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:05:44.024 ************************************ 00:05:44.024 START TEST spdkcli_tcp 00:05:44.024 ************************************ 00:05:44.024 15:49:33 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:44.282 * Looking for test storage... 00:05:44.282 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:05:44.282 15:49:33 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:05:44.282 15:49:33 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:44.282 15:49:33 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:05:44.282 15:49:33 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:44.282 15:49:33 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:44.282 15:49:33 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:44.282 15:49:33 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:44.282 15:49:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:05:44.282 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:05:44.282 15:49:33 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=2296380 00:05:44.283 15:49:33 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:44.283 15:49:33 -- spdkcli/tcp.sh@27 -- # waitforlisten 2296380 00:05:44.283 15:49:33 -- common/autotest_common.sh@819 -- # '[' -z 2296380 ']' 00:05:44.283 15:49:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:44.283 15:49:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:44.283 15:49:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:44.283 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:44.283 15:49:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:44.283 15:49:33 -- common/autotest_common.sh@10 -- # set +x 00:05:44.283 [2024-10-30 15:49:33.991906] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:44.283 [2024-10-30 15:49:33.992006] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2296380 ] 00:05:44.283 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.283 [2024-10-30 15:49:34.049933] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:44.283 [2024-10-30 15:49:34.132667] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:44.283 [2024-10-30 15:49:34.132870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.283 [2024-10-30 15:49:34.132870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:45.250 15:49:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:45.250 15:49:34 -- common/autotest_common.sh@852 -- # return 0 00:05:45.250 15:49:34 -- spdkcli/tcp.sh@31 -- # socat_pid=2296521 00:05:45.250 15:49:34 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:45.250 15:49:34 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:45.509 [ 00:05:45.509 "bdev_malloc_delete", 00:05:45.509 "bdev_malloc_create", 00:05:45.509 "bdev_null_resize", 00:05:45.509 "bdev_null_delete", 00:05:45.509 "bdev_null_create", 00:05:45.509 "bdev_nvme_cuse_unregister", 00:05:45.509 "bdev_nvme_cuse_register", 00:05:45.509 "bdev_opal_new_user", 00:05:45.509 "bdev_opal_set_lock_state", 00:05:45.509 "bdev_opal_delete", 00:05:45.509 "bdev_opal_get_info", 00:05:45.509 "bdev_opal_create", 00:05:45.509 "bdev_nvme_opal_revert", 00:05:45.509 "bdev_nvme_opal_init", 00:05:45.509 "bdev_nvme_send_cmd", 00:05:45.509 "bdev_nvme_get_path_iostat", 00:05:45.509 "bdev_nvme_get_mdns_discovery_info", 00:05:45.509 "bdev_nvme_stop_mdns_discovery", 00:05:45.509 "bdev_nvme_start_mdns_discovery", 00:05:45.509 "bdev_nvme_set_multipath_policy", 00:05:45.509 "bdev_nvme_set_preferred_path", 00:05:45.509 "bdev_nvme_get_io_paths", 00:05:45.509 "bdev_nvme_remove_error_injection", 00:05:45.509 "bdev_nvme_add_error_injection", 00:05:45.509 "bdev_nvme_get_discovery_info", 00:05:45.509 "bdev_nvme_stop_discovery", 00:05:45.509 "bdev_nvme_start_discovery", 00:05:45.509 "bdev_nvme_get_controller_health_info", 00:05:45.509 "bdev_nvme_disable_controller", 00:05:45.509 "bdev_nvme_enable_controller", 00:05:45.509 "bdev_nvme_reset_controller", 00:05:45.509 "bdev_nvme_get_transport_statistics", 00:05:45.509 "bdev_nvme_apply_firmware", 00:05:45.509 "bdev_nvme_detach_controller", 00:05:45.509 "bdev_nvme_get_controllers", 00:05:45.509 "bdev_nvme_attach_controller", 00:05:45.509 "bdev_nvme_set_hotplug", 00:05:45.509 "bdev_nvme_set_options", 00:05:45.509 "bdev_passthru_delete", 00:05:45.509 "bdev_passthru_create", 00:05:45.509 "bdev_lvol_grow_lvstore", 00:05:45.509 "bdev_lvol_get_lvols", 00:05:45.509 "bdev_lvol_get_lvstores", 00:05:45.509 "bdev_lvol_delete", 00:05:45.509 "bdev_lvol_set_read_only", 00:05:45.509 "bdev_lvol_resize", 00:05:45.509 "bdev_lvol_decouple_parent", 00:05:45.509 "bdev_lvol_inflate", 00:05:45.509 "bdev_lvol_rename", 00:05:45.509 "bdev_lvol_clone_bdev", 00:05:45.509 "bdev_lvol_clone", 00:05:45.509 "bdev_lvol_snapshot", 00:05:45.509 "bdev_lvol_create", 00:05:45.509 "bdev_lvol_delete_lvstore", 00:05:45.509 "bdev_lvol_rename_lvstore", 00:05:45.509 "bdev_lvol_create_lvstore", 00:05:45.509 "bdev_raid_set_options", 00:05:45.509 "bdev_raid_remove_base_bdev", 00:05:45.509 "bdev_raid_add_base_bdev", 00:05:45.509 "bdev_raid_delete", 00:05:45.509 "bdev_raid_create", 00:05:45.509 "bdev_raid_get_bdevs", 00:05:45.509 "bdev_error_inject_error", 00:05:45.509 "bdev_error_delete", 00:05:45.509 "bdev_error_create", 00:05:45.509 "bdev_split_delete", 00:05:45.509 "bdev_split_create", 00:05:45.509 "bdev_delay_delete", 00:05:45.509 "bdev_delay_create", 00:05:45.509 "bdev_delay_update_latency", 00:05:45.509 "bdev_zone_block_delete", 00:05:45.509 "bdev_zone_block_create", 00:05:45.509 "blobfs_create", 00:05:45.509 "blobfs_detect", 00:05:45.509 "blobfs_set_cache_size", 00:05:45.509 "bdev_aio_delete", 00:05:45.509 "bdev_aio_rescan", 00:05:45.509 "bdev_aio_create", 00:05:45.509 "bdev_ftl_set_property", 00:05:45.509 "bdev_ftl_get_properties", 00:05:45.509 "bdev_ftl_get_stats", 00:05:45.509 "bdev_ftl_unmap", 00:05:45.509 "bdev_ftl_unload", 00:05:45.509 "bdev_ftl_delete", 00:05:45.509 "bdev_ftl_load", 00:05:45.509 "bdev_ftl_create", 00:05:45.509 "bdev_virtio_attach_controller", 00:05:45.509 "bdev_virtio_scsi_get_devices", 00:05:45.509 "bdev_virtio_detach_controller", 00:05:45.509 "bdev_virtio_blk_set_hotplug", 00:05:45.509 "bdev_iscsi_delete", 00:05:45.509 "bdev_iscsi_create", 00:05:45.509 "bdev_iscsi_set_options", 00:05:45.509 "accel_error_inject_error", 00:05:45.509 "ioat_scan_accel_module", 00:05:45.509 "dsa_scan_accel_module", 00:05:45.509 "iaa_scan_accel_module", 00:05:45.509 "vfu_virtio_create_scsi_endpoint", 00:05:45.509 "vfu_virtio_scsi_remove_target", 00:05:45.509 "vfu_virtio_scsi_add_target", 00:05:45.509 "vfu_virtio_create_blk_endpoint", 00:05:45.509 "vfu_virtio_delete_endpoint", 00:05:45.509 "iscsi_set_options", 00:05:45.509 "iscsi_get_auth_groups", 00:05:45.509 "iscsi_auth_group_remove_secret", 00:05:45.509 "iscsi_auth_group_add_secret", 00:05:45.509 "iscsi_delete_auth_group", 00:05:45.509 "iscsi_create_auth_group", 00:05:45.509 "iscsi_set_discovery_auth", 00:05:45.509 "iscsi_get_options", 00:05:45.509 "iscsi_target_node_request_logout", 00:05:45.509 "iscsi_target_node_set_redirect", 00:05:45.509 "iscsi_target_node_set_auth", 00:05:45.509 "iscsi_target_node_add_lun", 00:05:45.509 "iscsi_get_connections", 00:05:45.509 "iscsi_portal_group_set_auth", 00:05:45.509 "iscsi_start_portal_group", 00:05:45.509 "iscsi_delete_portal_group", 00:05:45.509 "iscsi_create_portal_group", 00:05:45.509 "iscsi_get_portal_groups", 00:05:45.509 "iscsi_delete_target_node", 00:05:45.509 "iscsi_target_node_remove_pg_ig_maps", 00:05:45.509 "iscsi_target_node_add_pg_ig_maps", 00:05:45.509 "iscsi_create_target_node", 00:05:45.509 "iscsi_get_target_nodes", 00:05:45.509 "iscsi_delete_initiator_group", 00:05:45.509 "iscsi_initiator_group_remove_initiators", 00:05:45.509 "iscsi_initiator_group_add_initiators", 00:05:45.509 "iscsi_create_initiator_group", 00:05:45.509 "iscsi_get_initiator_groups", 00:05:45.509 "nvmf_set_crdt", 00:05:45.509 "nvmf_set_config", 00:05:45.509 "nvmf_set_max_subsystems", 00:05:45.509 "nvmf_subsystem_get_listeners", 00:05:45.509 "nvmf_subsystem_get_qpairs", 00:05:45.509 "nvmf_subsystem_get_controllers", 00:05:45.509 "nvmf_get_stats", 00:05:45.509 "nvmf_get_transports", 00:05:45.509 "nvmf_create_transport", 00:05:45.509 "nvmf_get_targets", 00:05:45.509 "nvmf_delete_target", 00:05:45.509 "nvmf_create_target", 00:05:45.509 "nvmf_subsystem_allow_any_host", 00:05:45.509 "nvmf_subsystem_remove_host", 00:05:45.509 "nvmf_subsystem_add_host", 00:05:45.509 "nvmf_subsystem_remove_ns", 00:05:45.509 "nvmf_subsystem_add_ns", 00:05:45.509 "nvmf_subsystem_listener_set_ana_state", 00:05:45.509 "nvmf_discovery_get_referrals", 00:05:45.509 "nvmf_discovery_remove_referral", 00:05:45.509 "nvmf_discovery_add_referral", 00:05:45.509 "nvmf_subsystem_remove_listener", 00:05:45.509 "nvmf_subsystem_add_listener", 00:05:45.509 "nvmf_delete_subsystem", 00:05:45.510 "nvmf_create_subsystem", 00:05:45.510 "nvmf_get_subsystems", 00:05:45.510 "env_dpdk_get_mem_stats", 00:05:45.510 "nbd_get_disks", 00:05:45.510 "nbd_stop_disk", 00:05:45.510 "nbd_start_disk", 00:05:45.510 "ublk_recover_disk", 00:05:45.510 "ublk_get_disks", 00:05:45.510 "ublk_stop_disk", 00:05:45.510 "ublk_start_disk", 00:05:45.510 "ublk_destroy_target", 00:05:45.510 "ublk_create_target", 00:05:45.510 "virtio_blk_create_transport", 00:05:45.510 "virtio_blk_get_transports", 00:05:45.510 "vhost_controller_set_coalescing", 00:05:45.510 "vhost_get_controllers", 00:05:45.510 "vhost_delete_controller", 00:05:45.510 "vhost_create_blk_controller", 00:05:45.510 "vhost_scsi_controller_remove_target", 00:05:45.510 "vhost_scsi_controller_add_target", 00:05:45.510 "vhost_start_scsi_controller", 00:05:45.510 "vhost_create_scsi_controller", 00:05:45.510 "thread_set_cpumask", 00:05:45.510 "framework_get_scheduler", 00:05:45.510 "framework_set_scheduler", 00:05:45.510 "framework_get_reactors", 00:05:45.510 "thread_get_io_channels", 00:05:45.510 "thread_get_pollers", 00:05:45.510 "thread_get_stats", 00:05:45.510 "framework_monitor_context_switch", 00:05:45.510 "spdk_kill_instance", 00:05:45.510 "log_enable_timestamps", 00:05:45.510 "log_get_flags", 00:05:45.510 "log_clear_flag", 00:05:45.510 "log_set_flag", 00:05:45.510 "log_get_level", 00:05:45.510 "log_set_level", 00:05:45.510 "log_get_print_level", 00:05:45.510 "log_set_print_level", 00:05:45.510 "framework_enable_cpumask_locks", 00:05:45.510 "framework_disable_cpumask_locks", 00:05:45.510 "framework_wait_init", 00:05:45.510 "framework_start_init", 00:05:45.510 "scsi_get_devices", 00:05:45.510 "bdev_get_histogram", 00:05:45.510 "bdev_enable_histogram", 00:05:45.510 "bdev_set_qos_limit", 00:05:45.510 "bdev_set_qd_sampling_period", 00:05:45.510 "bdev_get_bdevs", 00:05:45.510 "bdev_reset_iostat", 00:05:45.510 "bdev_get_iostat", 00:05:45.510 "bdev_examine", 00:05:45.510 "bdev_wait_for_examine", 00:05:45.510 "bdev_set_options", 00:05:45.510 "notify_get_notifications", 00:05:45.510 "notify_get_types", 00:05:45.510 "accel_get_stats", 00:05:45.510 "accel_set_options", 00:05:45.510 "accel_set_driver", 00:05:45.510 "accel_crypto_key_destroy", 00:05:45.510 "accel_crypto_keys_get", 00:05:45.510 "accel_crypto_key_create", 00:05:45.510 "accel_assign_opc", 00:05:45.510 "accel_get_module_info", 00:05:45.510 "accel_get_opc_assignments", 00:05:45.510 "vmd_rescan", 00:05:45.510 "vmd_remove_device", 00:05:45.510 "vmd_enable", 00:05:45.510 "sock_set_default_impl", 00:05:45.510 "sock_impl_set_options", 00:05:45.510 "sock_impl_get_options", 00:05:45.510 "iobuf_get_stats", 00:05:45.510 "iobuf_set_options", 00:05:45.510 "framework_get_pci_devices", 00:05:45.510 "framework_get_config", 00:05:45.510 "framework_get_subsystems", 00:05:45.510 "vfu_tgt_set_base_path", 00:05:45.510 "trace_get_info", 00:05:45.510 "trace_get_tpoint_group_mask", 00:05:45.510 "trace_disable_tpoint_group", 00:05:45.510 "trace_enable_tpoint_group", 00:05:45.510 "trace_clear_tpoint_mask", 00:05:45.510 "trace_set_tpoint_mask", 00:05:45.510 "spdk_get_version", 00:05:45.510 "rpc_get_methods" 00:05:45.510 ] 00:05:45.510 15:49:35 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:45.510 15:49:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:05:45.510 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:05:45.510 15:49:35 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:45.510 15:49:35 -- spdkcli/tcp.sh@38 -- # killprocess 2296380 00:05:45.510 15:49:35 -- common/autotest_common.sh@926 -- # '[' -z 2296380 ']' 00:05:45.510 15:49:35 -- common/autotest_common.sh@930 -- # kill -0 2296380 00:05:45.510 15:49:35 -- common/autotest_common.sh@931 -- # uname 00:05:45.510 15:49:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:45.510 15:49:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2296380 00:05:45.510 15:49:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:45.510 15:49:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:45.510 15:49:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2296380' 00:05:45.510 killing process with pid 2296380 00:05:45.510 15:49:35 -- common/autotest_common.sh@945 -- # kill 2296380 00:05:45.510 15:49:35 -- common/autotest_common.sh@950 -- # wait 2296380 00:05:45.768 00:05:45.768 real 0m1.745s 00:05:45.768 user 0m3.459s 00:05:45.768 sys 0m0.468s 00:05:45.768 15:49:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:45.768 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:05:45.768 ************************************ 00:05:45.768 END TEST spdkcli_tcp 00:05:45.768 ************************************ 00:05:46.027 15:49:35 -- spdk/autotest.sh@186 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:46.027 15:49:35 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:46.027 15:49:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:46.027 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:05:46.027 ************************************ 00:05:46.027 START TEST dpdk_mem_utility 00:05:46.027 ************************************ 00:05:46.027 15:49:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:46.027 * Looking for test storage... 00:05:46.027 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:05:46.027 15:49:35 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:46.027 15:49:35 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=2296712 00:05:46.027 15:49:35 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:46.027 15:49:35 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 2296712 00:05:46.027 15:49:35 -- common/autotest_common.sh@819 -- # '[' -z 2296712 ']' 00:05:46.027 15:49:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:46.027 15:49:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:46.027 15:49:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:46.027 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:46.027 15:49:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:46.027 15:49:35 -- common/autotest_common.sh@10 -- # set +x 00:05:46.027 [2024-10-30 15:49:35.755728] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:46.027 [2024-10-30 15:49:35.755836] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2296712 ] 00:05:46.027 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.027 [2024-10-30 15:49:35.814766] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.027 [2024-10-30 15:49:35.897173] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:46.027 [2024-10-30 15:49:35.897369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:46.964 15:49:36 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:46.964 15:49:36 -- common/autotest_common.sh@852 -- # return 0 00:05:46.964 15:49:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:46.964 15:49:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:46.964 15:49:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:46.964 15:49:36 -- common/autotest_common.sh@10 -- # set +x 00:05:46.964 { 00:05:46.964 "filename": "/tmp/spdk_mem_dump.txt" 00:05:46.964 } 00:05:46.964 15:49:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:46.964 15:49:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:46.964 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:46.964 1 heaps totaling size 814.000000 MiB 00:05:46.964 size: 814.000000 MiB heap id: 0 00:05:46.964 end heaps---------- 00:05:46.964 8 mempools totaling size 598.116089 MiB 00:05:46.964 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:46.964 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:46.964 size: 84.521057 MiB name: bdev_io_2296712 00:05:46.964 size: 51.011292 MiB name: evtpool_2296712 00:05:46.964 size: 50.003479 MiB name: msgpool_2296712 00:05:46.964 size: 21.763794 MiB name: PDU_Pool 00:05:46.964 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:46.964 size: 0.026123 MiB name: Session_Pool 00:05:46.964 end mempools------- 00:05:46.964 6 memzones totaling size 4.142822 MiB 00:05:46.964 size: 1.000366 MiB name: RG_ring_0_2296712 00:05:46.964 size: 1.000366 MiB name: RG_ring_1_2296712 00:05:46.964 size: 1.000366 MiB name: RG_ring_4_2296712 00:05:46.964 size: 1.000366 MiB name: RG_ring_5_2296712 00:05:46.964 size: 0.125366 MiB name: RG_ring_2_2296712 00:05:46.964 size: 0.015991 MiB name: RG_ring_3_2296712 00:05:46.964 end memzones------- 00:05:46.964 15:49:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:46.964 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:46.964 list of free elements. size: 12.519348 MiB 00:05:46.964 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:46.964 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:46.964 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:46.964 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:46.964 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:46.964 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:46.964 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:46.965 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:46.965 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:46.965 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:46.965 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:46.965 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:46.965 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:46.965 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:46.965 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:46.965 list of standard malloc elements. size: 199.218079 MiB 00:05:46.965 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:46.965 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:46.965 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:46.965 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:46.965 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:46.965 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:46.965 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:46.965 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:46.965 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:46.965 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:46.965 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:46.965 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:46.965 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:46.965 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:46.965 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:46.965 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:46.965 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:46.965 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:46.965 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:46.965 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:46.965 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:46.965 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:46.965 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:46.965 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:46.965 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:46.965 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:46.965 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:46.965 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:46.965 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:46.965 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:46.965 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:46.965 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:46.965 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:46.965 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:46.965 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:46.965 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:46.965 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:46.965 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:46.965 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:46.965 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:46.965 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:46.965 list of memzone associated elements. size: 602.262573 MiB 00:05:46.965 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:46.965 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:46.965 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:46.965 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:46.965 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:46.965 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_2296712_0 00:05:46.965 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:46.965 associated memzone info: size: 48.002930 MiB name: MP_evtpool_2296712_0 00:05:46.965 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:46.965 associated memzone info: size: 48.002930 MiB name: MP_msgpool_2296712_0 00:05:46.965 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:46.965 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:46.965 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:46.965 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:46.965 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:46.965 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_2296712 00:05:46.965 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:46.965 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_2296712 00:05:46.965 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:46.965 associated memzone info: size: 1.007996 MiB name: MP_evtpool_2296712 00:05:46.965 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:46.965 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:46.965 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:46.965 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:46.965 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:46.965 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:46.965 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:46.965 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:46.965 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:46.965 associated memzone info: size: 1.000366 MiB name: RG_ring_0_2296712 00:05:46.965 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:46.965 associated memzone info: size: 1.000366 MiB name: RG_ring_1_2296712 00:05:46.965 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:46.965 associated memzone info: size: 1.000366 MiB name: RG_ring_4_2296712 00:05:46.965 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:46.965 associated memzone info: size: 1.000366 MiB name: RG_ring_5_2296712 00:05:46.965 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:46.965 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_2296712 00:05:46.965 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:46.965 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:46.965 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:46.965 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:46.965 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:46.965 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:46.965 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:46.965 associated memzone info: size: 0.125366 MiB name: RG_ring_2_2296712 00:05:46.965 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:46.965 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:46.965 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:46.965 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:46.965 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:46.965 associated memzone info: size: 0.015991 MiB name: RG_ring_3_2296712 00:05:46.965 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:46.965 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:46.965 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:46.965 associated memzone info: size: 0.000183 MiB name: MP_msgpool_2296712 00:05:46.965 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:46.965 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_2296712 00:05:46.965 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:46.965 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:46.965 15:49:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:46.965 15:49:36 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 2296712 00:05:46.965 15:49:36 -- common/autotest_common.sh@926 -- # '[' -z 2296712 ']' 00:05:46.965 15:49:36 -- common/autotest_common.sh@930 -- # kill -0 2296712 00:05:46.965 15:49:36 -- common/autotest_common.sh@931 -- # uname 00:05:46.965 15:49:36 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:46.965 15:49:36 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2296712 00:05:47.224 15:49:36 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:47.224 15:49:36 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:47.224 15:49:36 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2296712' 00:05:47.224 killing process with pid 2296712 00:05:47.224 15:49:36 -- common/autotest_common.sh@945 -- # kill 2296712 00:05:47.224 15:49:36 -- common/autotest_common.sh@950 -- # wait 2296712 00:05:47.483 00:05:47.483 real 0m1.571s 00:05:47.483 user 0m1.763s 00:05:47.483 sys 0m0.424s 00:05:47.483 15:49:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:47.483 15:49:37 -- common/autotest_common.sh@10 -- # set +x 00:05:47.483 ************************************ 00:05:47.483 END TEST dpdk_mem_utility 00:05:47.483 ************************************ 00:05:47.483 15:49:37 -- spdk/autotest.sh@187 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:47.483 15:49:37 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:47.483 15:49:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:47.483 15:49:37 -- common/autotest_common.sh@10 -- # set +x 00:05:47.483 ************************************ 00:05:47.483 START TEST event 00:05:47.483 ************************************ 00:05:47.483 15:49:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:47.483 * Looking for test storage... 00:05:47.483 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:47.483 15:49:37 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:47.483 15:49:37 -- bdev/nbd_common.sh@6 -- # set -e 00:05:47.483 15:49:37 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:47.483 15:49:37 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:47.483 15:49:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:47.483 15:49:37 -- common/autotest_common.sh@10 -- # set +x 00:05:47.483 ************************************ 00:05:47.483 START TEST event_perf 00:05:47.483 ************************************ 00:05:47.483 15:49:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:47.483 Running I/O for 1 seconds...[2024-10-30 15:49:37.331429] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:47.483 [2024-10-30 15:49:37.331515] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2296915 ] 00:05:47.483 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.741 [2024-10-30 15:49:37.391792] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:47.741 [2024-10-30 15:49:37.483433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:47.741 [2024-10-30 15:49:37.483491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:47.741 [2024-10-30 15:49:37.483553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:47.741 [2024-10-30 15:49:37.483556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.114 Running I/O for 1 seconds... 00:05:49.114 lcore 0: 229086 00:05:49.114 lcore 1: 229083 00:05:49.114 lcore 2: 229084 00:05:49.114 lcore 3: 229085 00:05:49.114 done. 00:05:49.114 00:05:49.114 real 0m1.245s 00:05:49.114 user 0m4.153s 00:05:49.114 sys 0m0.088s 00:05:49.114 15:49:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:49.114 15:49:38 -- common/autotest_common.sh@10 -- # set +x 00:05:49.114 ************************************ 00:05:49.114 END TEST event_perf 00:05:49.114 ************************************ 00:05:49.114 15:49:38 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:49.114 15:49:38 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:05:49.114 15:49:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:49.114 15:49:38 -- common/autotest_common.sh@10 -- # set +x 00:05:49.114 ************************************ 00:05:49.114 START TEST event_reactor 00:05:49.114 ************************************ 00:05:49.114 15:49:38 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:49.114 [2024-10-30 15:49:38.603620] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:49.114 [2024-10-30 15:49:38.603707] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2297072 ] 00:05:49.114 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.114 [2024-10-30 15:49:38.662134] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.114 [2024-10-30 15:49:38.741981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.052 test_start 00:05:50.052 oneshot 00:05:50.052 tick 100 00:05:50.052 tick 100 00:05:50.052 tick 250 00:05:50.052 tick 100 00:05:50.052 tick 100 00:05:50.052 tick 100 00:05:50.052 tick 250 00:05:50.052 tick 500 00:05:50.052 tick 100 00:05:50.052 tick 100 00:05:50.052 tick 250 00:05:50.052 tick 100 00:05:50.052 tick 100 00:05:50.052 test_end 00:05:50.052 00:05:50.052 real 0m1.227s 00:05:50.052 user 0m1.147s 00:05:50.052 sys 0m0.075s 00:05:50.052 15:49:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:50.052 15:49:39 -- common/autotest_common.sh@10 -- # set +x 00:05:50.052 ************************************ 00:05:50.052 END TEST event_reactor 00:05:50.052 ************************************ 00:05:50.052 15:49:39 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:50.052 15:49:39 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:05:50.052 15:49:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:50.052 15:49:39 -- common/autotest_common.sh@10 -- # set +x 00:05:50.052 ************************************ 00:05:50.052 START TEST event_reactor_perf 00:05:50.052 ************************************ 00:05:50.052 15:49:39 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:50.052 [2024-10-30 15:49:39.859185] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:50.052 [2024-10-30 15:49:39.859288] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2297261 ] 00:05:50.052 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.052 [2024-10-30 15:49:39.915952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.342 [2024-10-30 15:49:40.000589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.301 test_start 00:05:51.301 test_end 00:05:51.301 Performance: 431725 events per second 00:05:51.301 00:05:51.301 real 0m1.228s 00:05:51.301 user 0m1.142s 00:05:51.301 sys 0m0.081s 00:05:51.301 15:49:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:51.301 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.301 ************************************ 00:05:51.301 END TEST event_reactor_perf 00:05:51.301 ************************************ 00:05:51.301 15:49:41 -- event/event.sh@49 -- # uname -s 00:05:51.301 15:49:41 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:05:51.301 15:49:41 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:51.301 15:49:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:51.301 15:49:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:51.301 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.301 ************************************ 00:05:51.301 START TEST event_scheduler 00:05:51.301 ************************************ 00:05:51.301 15:49:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:51.301 * Looking for test storage... 00:05:51.301 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:05:51.301 15:49:41 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:05:51.301 15:49:41 -- scheduler/scheduler.sh@35 -- # scheduler_pid=2297529 00:05:51.301 15:49:41 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:05:51.301 15:49:41 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:05:51.301 15:49:41 -- scheduler/scheduler.sh@37 -- # waitforlisten 2297529 00:05:51.301 15:49:41 -- common/autotest_common.sh@819 -- # '[' -z 2297529 ']' 00:05:51.301 15:49:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:51.301 15:49:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:51.301 15:49:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:51.301 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:51.301 15:49:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:51.301 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.559 [2024-10-30 15:49:41.200818] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:51.559 [2024-10-30 15:49:41.200891] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2297529 ] 00:05:51.559 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.559 [2024-10-30 15:49:41.261677] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:51.559 [2024-10-30 15:49:41.350930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.559 [2024-10-30 15:49:41.350990] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:51.559 [2024-10-30 15:49:41.351047] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:51.559 [2024-10-30 15:49:41.351050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:51.559 15:49:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:51.559 15:49:41 -- common/autotest_common.sh@852 -- # return 0 00:05:51.559 15:49:41 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:05:51.559 15:49:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:51.559 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.559 POWER: Env isn't set yet! 00:05:51.559 POWER: Attempting to initialise ACPI cpufreq power management... 00:05:51.818 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:05:51.818 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:05:51.818 POWER: Cannot get available frequencies of lcore 0 00:05:51.818 POWER: Attempting to initialise PSTAT power management... 00:05:51.818 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:05:51.818 POWER: Initialized successfully for lcore 0 power management 00:05:51.818 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:05:51.818 POWER: Initialized successfully for lcore 1 power management 00:05:51.818 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:05:51.818 POWER: Initialized successfully for lcore 2 power management 00:05:51.818 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:05:51.818 POWER: Initialized successfully for lcore 3 power management 00:05:51.818 [2024-10-30 15:49:41.470482] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:05:51.818 [2024-10-30 15:49:41.470508] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:05:51.818 [2024-10-30 15:49:41.470527] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:05:51.818 15:49:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:51.818 15:49:41 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:05:51.818 15:49:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:51.818 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.818 [2024-10-30 15:49:41.569755] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:05:51.818 15:49:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:51.818 15:49:41 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:05:51.818 15:49:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:51.818 15:49:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:51.818 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.818 ************************************ 00:05:51.818 START TEST scheduler_create_thread 00:05:51.818 ************************************ 00:05:51.818 15:49:41 -- common/autotest_common.sh@1104 -- # scheduler_create_thread 00:05:51.818 15:49:41 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:05:51.818 15:49:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:51.818 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.818 2 00:05:51.818 15:49:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:51.818 15:49:41 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:05:51.818 15:49:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:51.818 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.818 3 00:05:51.818 15:49:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:51.818 15:49:41 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:05:51.818 15:49:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:51.818 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.818 4 00:05:51.818 15:49:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:51.818 15:49:41 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:05:51.818 15:49:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:51.818 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.818 5 00:05:51.818 15:49:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:51.818 15:49:41 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:05:51.818 15:49:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:51.818 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.818 6 00:05:51.818 15:49:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:51.818 15:49:41 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:05:51.818 15:49:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:51.818 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.818 7 00:05:51.818 15:49:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:51.818 15:49:41 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:05:51.818 15:49:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:51.818 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.818 8 00:05:51.818 15:49:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:51.818 15:49:41 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:05:51.818 15:49:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:51.818 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.818 9 00:05:51.818 15:49:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:51.818 15:49:41 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:05:51.818 15:49:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:51.818 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.818 10 00:05:51.818 15:49:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:51.818 15:49:41 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:05:51.818 15:49:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:51.818 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.818 15:49:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:51.818 15:49:41 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:05:51.818 15:49:41 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:05:51.818 15:49:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:51.818 15:49:41 -- common/autotest_common.sh@10 -- # set +x 00:05:52.385 15:49:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:52.385 15:49:42 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:05:52.385 15:49:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:52.385 15:49:42 -- common/autotest_common.sh@10 -- # set +x 00:05:53.758 15:49:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:53.758 15:49:43 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:05:53.758 15:49:43 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:05:53.758 15:49:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:53.758 15:49:43 -- common/autotest_common.sh@10 -- # set +x 00:05:55.133 15:49:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:55.133 00:05:55.133 real 0m3.099s 00:05:55.133 user 0m0.011s 00:05:55.133 sys 0m0.003s 00:05:55.133 15:49:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:55.133 15:49:44 -- common/autotest_common.sh@10 -- # set +x 00:05:55.133 ************************************ 00:05:55.133 END TEST scheduler_create_thread 00:05:55.133 ************************************ 00:05:55.133 15:49:44 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:55.133 15:49:44 -- scheduler/scheduler.sh@46 -- # killprocess 2297529 00:05:55.133 15:49:44 -- common/autotest_common.sh@926 -- # '[' -z 2297529 ']' 00:05:55.133 15:49:44 -- common/autotest_common.sh@930 -- # kill -0 2297529 00:05:55.133 15:49:44 -- common/autotest_common.sh@931 -- # uname 00:05:55.133 15:49:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:55.133 15:49:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2297529 00:05:55.133 15:49:44 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:05:55.133 15:49:44 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:05:55.133 15:49:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2297529' 00:05:55.133 killing process with pid 2297529 00:05:55.133 15:49:44 -- common/autotest_common.sh@945 -- # kill 2297529 00:05:55.133 15:49:44 -- common/autotest_common.sh@950 -- # wait 2297529 00:05:55.391 [2024-10-30 15:49:45.053868] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:05:55.391 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:05:55.391 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:05:55.391 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:05:55.391 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:05:55.391 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:05:55.391 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:05:55.391 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:05:55.391 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:05:55.649 00:05:55.649 real 0m4.199s 00:05:55.649 user 0m6.944s 00:05:55.649 sys 0m0.301s 00:05:55.649 15:49:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:55.649 15:49:45 -- common/autotest_common.sh@10 -- # set +x 00:05:55.649 ************************************ 00:05:55.649 END TEST event_scheduler 00:05:55.649 ************************************ 00:05:55.649 15:49:45 -- event/event.sh@51 -- # modprobe -n nbd 00:05:55.649 15:49:45 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:05:55.649 15:49:45 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:55.649 15:49:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:55.649 15:49:45 -- common/autotest_common.sh@10 -- # set +x 00:05:55.649 ************************************ 00:05:55.649 START TEST app_repeat 00:05:55.649 ************************************ 00:05:55.649 15:49:45 -- common/autotest_common.sh@1104 -- # app_repeat_test 00:05:55.649 15:49:45 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:55.649 15:49:45 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:55.649 15:49:45 -- event/event.sh@13 -- # local nbd_list 00:05:55.649 15:49:45 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:55.649 15:49:45 -- event/event.sh@14 -- # local bdev_list 00:05:55.649 15:49:45 -- event/event.sh@15 -- # local repeat_times=4 00:05:55.649 15:49:45 -- event/event.sh@17 -- # modprobe nbd 00:05:55.649 15:49:45 -- event/event.sh@19 -- # repeat_pid=2298000 00:05:55.650 15:49:45 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:05:55.650 15:49:45 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:05:55.650 15:49:45 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 2298000' 00:05:55.650 Process app_repeat pid: 2298000 00:05:55.650 15:49:45 -- event/event.sh@23 -- # for i in {0..2} 00:05:55.650 15:49:45 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:05:55.650 spdk_app_start Round 0 00:05:55.650 15:49:45 -- event/event.sh@25 -- # waitforlisten 2298000 /var/tmp/spdk-nbd.sock 00:05:55.650 15:49:45 -- common/autotest_common.sh@819 -- # '[' -z 2298000 ']' 00:05:55.650 15:49:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:55.650 15:49:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:55.650 15:49:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:55.650 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:55.650 15:49:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:55.650 15:49:45 -- common/autotest_common.sh@10 -- # set +x 00:05:55.650 [2024-10-30 15:49:45.366249] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:05:55.650 [2024-10-30 15:49:45.366478] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2298000 ] 00:05:55.650 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.650 [2024-10-30 15:49:45.431121] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:55.650 [2024-10-30 15:49:45.519876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:55.650 [2024-10-30 15:49:45.519882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.584 15:49:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:56.584 15:49:46 -- common/autotest_common.sh@852 -- # return 0 00:05:56.584 15:49:46 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:56.842 Malloc0 00:05:56.842 15:49:46 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:57.100 Malloc1 00:05:57.100 15:49:46 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@12 -- # local i 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:57.100 15:49:46 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:57.358 /dev/nbd0 00:05:57.358 15:49:47 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:57.358 15:49:47 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:57.358 15:49:47 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:05:57.358 15:49:47 -- common/autotest_common.sh@857 -- # local i 00:05:57.358 15:49:47 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:57.358 15:49:47 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:57.358 15:49:47 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:05:57.358 15:49:47 -- common/autotest_common.sh@861 -- # break 00:05:57.358 15:49:47 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:57.358 15:49:47 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:57.358 15:49:47 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:57.358 1+0 records in 00:05:57.358 1+0 records out 00:05:57.358 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000194229 s, 21.1 MB/s 00:05:57.358 15:49:47 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:57.358 15:49:47 -- common/autotest_common.sh@874 -- # size=4096 00:05:57.358 15:49:47 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:57.358 15:49:47 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:57.358 15:49:47 -- common/autotest_common.sh@877 -- # return 0 00:05:57.358 15:49:47 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:57.358 15:49:47 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:57.358 15:49:47 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:57.615 /dev/nbd1 00:05:57.615 15:49:47 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:57.615 15:49:47 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:57.615 15:49:47 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:05:57.615 15:49:47 -- common/autotest_common.sh@857 -- # local i 00:05:57.615 15:49:47 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:05:57.615 15:49:47 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:05:57.615 15:49:47 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:05:57.615 15:49:47 -- common/autotest_common.sh@861 -- # break 00:05:57.615 15:49:47 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:05:57.615 15:49:47 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:05:57.615 15:49:47 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:57.615 1+0 records in 00:05:57.615 1+0 records out 00:05:57.615 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000218998 s, 18.7 MB/s 00:05:57.615 15:49:47 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:57.615 15:49:47 -- common/autotest_common.sh@874 -- # size=4096 00:05:57.615 15:49:47 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:57.615 15:49:47 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:05:57.615 15:49:47 -- common/autotest_common.sh@877 -- # return 0 00:05:57.615 15:49:47 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:57.615 15:49:47 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:57.615 15:49:47 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:57.615 15:49:47 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:57.615 15:49:47 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:57.873 15:49:47 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:57.874 { 00:05:57.874 "nbd_device": "/dev/nbd0", 00:05:57.874 "bdev_name": "Malloc0" 00:05:57.874 }, 00:05:57.874 { 00:05:57.874 "nbd_device": "/dev/nbd1", 00:05:57.874 "bdev_name": "Malloc1" 00:05:57.874 } 00:05:57.874 ]' 00:05:57.874 15:49:47 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:57.874 { 00:05:57.874 "nbd_device": "/dev/nbd0", 00:05:57.874 "bdev_name": "Malloc0" 00:05:57.874 }, 00:05:57.874 { 00:05:57.874 "nbd_device": "/dev/nbd1", 00:05:57.874 "bdev_name": "Malloc1" 00:05:57.874 } 00:05:57.874 ]' 00:05:57.874 15:49:47 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:58.131 /dev/nbd1' 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:58.131 /dev/nbd1' 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@65 -- # count=2 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@95 -- # count=2 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:58.131 256+0 records in 00:05:58.131 256+0 records out 00:05:58.131 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00412698 s, 254 MB/s 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:58.131 256+0 records in 00:05:58.131 256+0 records out 00:05:58.131 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227376 s, 46.1 MB/s 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:58.131 256+0 records in 00:05:58.131 256+0 records out 00:05:58.131 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244673 s, 42.9 MB/s 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@51 -- # local i 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:58.131 15:49:47 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:58.389 15:49:48 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:58.389 15:49:48 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:58.389 15:49:48 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:58.389 15:49:48 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:58.389 15:49:48 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:58.389 15:49:48 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:58.389 15:49:48 -- bdev/nbd_common.sh@41 -- # break 00:05:58.389 15:49:48 -- bdev/nbd_common.sh@45 -- # return 0 00:05:58.389 15:49:48 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:58.389 15:49:48 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:58.647 15:49:48 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:58.647 15:49:48 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:58.647 15:49:48 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:58.647 15:49:48 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:58.647 15:49:48 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:58.647 15:49:48 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:58.647 15:49:48 -- bdev/nbd_common.sh@41 -- # break 00:05:58.647 15:49:48 -- bdev/nbd_common.sh@45 -- # return 0 00:05:58.647 15:49:48 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:58.647 15:49:48 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:58.647 15:49:48 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:58.905 15:49:48 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:58.905 15:49:48 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:58.905 15:49:48 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:58.905 15:49:48 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:58.905 15:49:48 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:58.905 15:49:48 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:58.905 15:49:48 -- bdev/nbd_common.sh@65 -- # true 00:05:58.905 15:49:48 -- bdev/nbd_common.sh@65 -- # count=0 00:05:58.905 15:49:48 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:58.905 15:49:48 -- bdev/nbd_common.sh@104 -- # count=0 00:05:58.905 15:49:48 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:58.905 15:49:48 -- bdev/nbd_common.sh@109 -- # return 0 00:05:58.905 15:49:48 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:59.163 15:49:48 -- event/event.sh@35 -- # sleep 3 00:05:59.421 [2024-10-30 15:49:49.201596] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:59.421 [2024-10-30 15:49:49.289629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.421 [2024-10-30 15:49:49.289629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:59.678 [2024-10-30 15:49:49.351618] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:59.678 [2024-10-30 15:49:49.351696] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:02.205 15:49:51 -- event/event.sh@23 -- # for i in {0..2} 00:06:02.205 15:49:51 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:02.205 spdk_app_start Round 1 00:06:02.205 15:49:51 -- event/event.sh@25 -- # waitforlisten 2298000 /var/tmp/spdk-nbd.sock 00:06:02.205 15:49:51 -- common/autotest_common.sh@819 -- # '[' -z 2298000 ']' 00:06:02.205 15:49:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:02.205 15:49:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:02.205 15:49:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:02.205 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:02.205 15:49:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:02.205 15:49:51 -- common/autotest_common.sh@10 -- # set +x 00:06:02.462 15:49:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:02.462 15:49:52 -- common/autotest_common.sh@852 -- # return 0 00:06:02.462 15:49:52 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:02.720 Malloc0 00:06:02.720 15:49:52 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:02.979 Malloc1 00:06:02.979 15:49:52 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@12 -- # local i 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:02.979 15:49:52 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:03.236 /dev/nbd0 00:06:03.237 15:49:53 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:03.237 15:49:53 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:03.237 15:49:53 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:06:03.237 15:49:53 -- common/autotest_common.sh@857 -- # local i 00:06:03.237 15:49:53 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:06:03.237 15:49:53 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:06:03.237 15:49:53 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:06:03.237 15:49:53 -- common/autotest_common.sh@861 -- # break 00:06:03.237 15:49:53 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:06:03.237 15:49:53 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:06:03.237 15:49:53 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:03.237 1+0 records in 00:06:03.237 1+0 records out 00:06:03.237 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000196382 s, 20.9 MB/s 00:06:03.237 15:49:53 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:03.237 15:49:53 -- common/autotest_common.sh@874 -- # size=4096 00:06:03.237 15:49:53 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:03.237 15:49:53 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:06:03.237 15:49:53 -- common/autotest_common.sh@877 -- # return 0 00:06:03.237 15:49:53 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:03.237 15:49:53 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:03.237 15:49:53 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:03.494 /dev/nbd1 00:06:03.494 15:49:53 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:03.494 15:49:53 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:03.494 15:49:53 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:06:03.494 15:49:53 -- common/autotest_common.sh@857 -- # local i 00:06:03.494 15:49:53 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:06:03.494 15:49:53 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:06:03.494 15:49:53 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:06:03.494 15:49:53 -- common/autotest_common.sh@861 -- # break 00:06:03.494 15:49:53 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:06:03.494 15:49:53 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:06:03.494 15:49:53 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:03.494 1+0 records in 00:06:03.494 1+0 records out 00:06:03.494 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000223846 s, 18.3 MB/s 00:06:03.494 15:49:53 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:03.494 15:49:53 -- common/autotest_common.sh@874 -- # size=4096 00:06:03.494 15:49:53 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:03.494 15:49:53 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:06:03.494 15:49:53 -- common/autotest_common.sh@877 -- # return 0 00:06:03.494 15:49:53 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:03.494 15:49:53 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:03.494 15:49:53 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:03.494 15:49:53 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:03.494 15:49:53 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:03.752 15:49:53 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:03.752 { 00:06:03.752 "nbd_device": "/dev/nbd0", 00:06:03.752 "bdev_name": "Malloc0" 00:06:03.752 }, 00:06:03.752 { 00:06:03.752 "nbd_device": "/dev/nbd1", 00:06:03.752 "bdev_name": "Malloc1" 00:06:03.752 } 00:06:03.752 ]' 00:06:03.752 15:49:53 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:03.752 { 00:06:03.752 "nbd_device": "/dev/nbd0", 00:06:03.752 "bdev_name": "Malloc0" 00:06:03.752 }, 00:06:03.752 { 00:06:03.752 "nbd_device": "/dev/nbd1", 00:06:03.752 "bdev_name": "Malloc1" 00:06:03.752 } 00:06:03.752 ]' 00:06:03.752 15:49:53 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:04.010 /dev/nbd1' 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:04.010 /dev/nbd1' 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@65 -- # count=2 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@95 -- # count=2 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:04.010 256+0 records in 00:06:04.010 256+0 records out 00:06:04.010 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00503931 s, 208 MB/s 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:04.010 256+0 records in 00:06:04.010 256+0 records out 00:06:04.010 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223279 s, 47.0 MB/s 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:04.010 256+0 records in 00:06:04.010 256+0 records out 00:06:04.010 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243383 s, 43.1 MB/s 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@51 -- # local i 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:04.010 15:49:53 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:04.269 15:49:53 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:04.269 15:49:53 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:04.269 15:49:53 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:04.269 15:49:53 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:04.269 15:49:53 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:04.269 15:49:53 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:04.269 15:49:53 -- bdev/nbd_common.sh@41 -- # break 00:06:04.269 15:49:53 -- bdev/nbd_common.sh@45 -- # return 0 00:06:04.269 15:49:53 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:04.269 15:49:53 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:04.527 15:49:54 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:04.527 15:49:54 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:04.527 15:49:54 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:04.527 15:49:54 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:04.527 15:49:54 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:04.527 15:49:54 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:04.527 15:49:54 -- bdev/nbd_common.sh@41 -- # break 00:06:04.527 15:49:54 -- bdev/nbd_common.sh@45 -- # return 0 00:06:04.527 15:49:54 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:04.527 15:49:54 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:04.527 15:49:54 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:04.785 15:49:54 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:04.785 15:49:54 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:04.785 15:49:54 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:04.785 15:49:54 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:04.785 15:49:54 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:04.785 15:49:54 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:04.785 15:49:54 -- bdev/nbd_common.sh@65 -- # true 00:06:04.785 15:49:54 -- bdev/nbd_common.sh@65 -- # count=0 00:06:04.785 15:49:54 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:04.785 15:49:54 -- bdev/nbd_common.sh@104 -- # count=0 00:06:04.785 15:49:54 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:04.785 15:49:54 -- bdev/nbd_common.sh@109 -- # return 0 00:06:04.785 15:49:54 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:05.043 15:49:54 -- event/event.sh@35 -- # sleep 3 00:06:05.302 [2024-10-30 15:49:55.081712] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:05.302 [2024-10-30 15:49:55.170068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:05.302 [2024-10-30 15:49:55.170072] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.561 [2024-10-30 15:49:55.231924] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:05.561 [2024-10-30 15:49:55.232009] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:08.089 15:49:57 -- event/event.sh@23 -- # for i in {0..2} 00:06:08.089 15:49:57 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:08.089 spdk_app_start Round 2 00:06:08.089 15:49:57 -- event/event.sh@25 -- # waitforlisten 2298000 /var/tmp/spdk-nbd.sock 00:06:08.089 15:49:57 -- common/autotest_common.sh@819 -- # '[' -z 2298000 ']' 00:06:08.089 15:49:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:08.089 15:49:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:08.089 15:49:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:08.089 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:08.089 15:49:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:08.089 15:49:57 -- common/autotest_common.sh@10 -- # set +x 00:06:08.347 15:49:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:08.347 15:49:58 -- common/autotest_common.sh@852 -- # return 0 00:06:08.347 15:49:58 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:08.604 Malloc0 00:06:08.604 15:49:58 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:08.862 Malloc1 00:06:08.862 15:49:58 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@12 -- # local i 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:08.862 15:49:58 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:09.121 /dev/nbd0 00:06:09.121 15:49:58 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:09.121 15:49:58 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:09.121 15:49:58 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:06:09.121 15:49:58 -- common/autotest_common.sh@857 -- # local i 00:06:09.121 15:49:58 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:06:09.121 15:49:58 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:06:09.121 15:49:58 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:06:09.121 15:49:58 -- common/autotest_common.sh@861 -- # break 00:06:09.121 15:49:58 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:06:09.121 15:49:58 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:06:09.121 15:49:58 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:09.121 1+0 records in 00:06:09.121 1+0 records out 00:06:09.121 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000188068 s, 21.8 MB/s 00:06:09.121 15:49:58 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:09.121 15:49:58 -- common/autotest_common.sh@874 -- # size=4096 00:06:09.121 15:49:58 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:09.121 15:49:58 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:06:09.121 15:49:58 -- common/autotest_common.sh@877 -- # return 0 00:06:09.121 15:49:58 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:09.121 15:49:58 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:09.121 15:49:58 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:09.379 /dev/nbd1 00:06:09.379 15:49:59 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:09.379 15:49:59 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:09.379 15:49:59 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:06:09.379 15:49:59 -- common/autotest_common.sh@857 -- # local i 00:06:09.379 15:49:59 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:06:09.379 15:49:59 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:06:09.379 15:49:59 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:06:09.379 15:49:59 -- common/autotest_common.sh@861 -- # break 00:06:09.379 15:49:59 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:06:09.379 15:49:59 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:06:09.379 15:49:59 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:09.379 1+0 records in 00:06:09.379 1+0 records out 00:06:09.379 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000187296 s, 21.9 MB/s 00:06:09.379 15:49:59 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:09.379 15:49:59 -- common/autotest_common.sh@874 -- # size=4096 00:06:09.379 15:49:59 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:09.379 15:49:59 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:06:09.379 15:49:59 -- common/autotest_common.sh@877 -- # return 0 00:06:09.379 15:49:59 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:09.379 15:49:59 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:09.380 15:49:59 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:09.380 15:49:59 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:09.380 15:49:59 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:09.638 15:49:59 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:09.638 { 00:06:09.638 "nbd_device": "/dev/nbd0", 00:06:09.638 "bdev_name": "Malloc0" 00:06:09.638 }, 00:06:09.638 { 00:06:09.638 "nbd_device": "/dev/nbd1", 00:06:09.638 "bdev_name": "Malloc1" 00:06:09.638 } 00:06:09.638 ]' 00:06:09.638 15:49:59 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:09.638 { 00:06:09.638 "nbd_device": "/dev/nbd0", 00:06:09.638 "bdev_name": "Malloc0" 00:06:09.638 }, 00:06:09.638 { 00:06:09.638 "nbd_device": "/dev/nbd1", 00:06:09.638 "bdev_name": "Malloc1" 00:06:09.638 } 00:06:09.638 ]' 00:06:09.638 15:49:59 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:09.897 /dev/nbd1' 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:09.897 /dev/nbd1' 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@65 -- # count=2 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@95 -- # count=2 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:09.897 256+0 records in 00:06:09.897 256+0 records out 00:06:09.897 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0047136 s, 222 MB/s 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:09.897 256+0 records in 00:06:09.897 256+0 records out 00:06:09.897 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214091 s, 49.0 MB/s 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:09.897 256+0 records in 00:06:09.897 256+0 records out 00:06:09.897 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023479 s, 44.7 MB/s 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@51 -- # local i 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:09.897 15:49:59 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:10.156 15:49:59 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:10.156 15:49:59 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:10.156 15:49:59 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:10.156 15:49:59 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:10.156 15:49:59 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:10.156 15:49:59 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:10.156 15:49:59 -- bdev/nbd_common.sh@41 -- # break 00:06:10.156 15:49:59 -- bdev/nbd_common.sh@45 -- # return 0 00:06:10.156 15:49:59 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:10.156 15:49:59 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:10.414 15:50:00 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:10.414 15:50:00 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:10.414 15:50:00 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:10.414 15:50:00 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:10.414 15:50:00 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:10.414 15:50:00 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:10.414 15:50:00 -- bdev/nbd_common.sh@41 -- # break 00:06:10.414 15:50:00 -- bdev/nbd_common.sh@45 -- # return 0 00:06:10.414 15:50:00 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:10.414 15:50:00 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:10.414 15:50:00 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:10.671 15:50:00 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:10.671 15:50:00 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:10.671 15:50:00 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:10.671 15:50:00 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:10.671 15:50:00 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:10.671 15:50:00 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:10.671 15:50:00 -- bdev/nbd_common.sh@65 -- # true 00:06:10.671 15:50:00 -- bdev/nbd_common.sh@65 -- # count=0 00:06:10.671 15:50:00 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:10.671 15:50:00 -- bdev/nbd_common.sh@104 -- # count=0 00:06:10.671 15:50:00 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:10.671 15:50:00 -- bdev/nbd_common.sh@109 -- # return 0 00:06:10.671 15:50:00 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:10.929 15:50:00 -- event/event.sh@35 -- # sleep 3 00:06:11.187 [2024-10-30 15:50:00.981872] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:11.445 [2024-10-30 15:50:01.071397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:11.445 [2024-10-30 15:50:01.071402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.445 [2024-10-30 15:50:01.129367] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:11.445 [2024-10-30 15:50:01.129434] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:13.971 15:50:03 -- event/event.sh@38 -- # waitforlisten 2298000 /var/tmp/spdk-nbd.sock 00:06:13.971 15:50:03 -- common/autotest_common.sh@819 -- # '[' -z 2298000 ']' 00:06:13.971 15:50:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:13.971 15:50:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:13.971 15:50:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:13.971 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:13.971 15:50:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:13.971 15:50:03 -- common/autotest_common.sh@10 -- # set +x 00:06:14.231 15:50:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:14.231 15:50:03 -- common/autotest_common.sh@852 -- # return 0 00:06:14.231 15:50:03 -- event/event.sh@39 -- # killprocess 2298000 00:06:14.231 15:50:04 -- common/autotest_common.sh@926 -- # '[' -z 2298000 ']' 00:06:14.231 15:50:04 -- common/autotest_common.sh@930 -- # kill -0 2298000 00:06:14.231 15:50:04 -- common/autotest_common.sh@931 -- # uname 00:06:14.231 15:50:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:14.231 15:50:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2298000 00:06:14.231 15:50:04 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:14.231 15:50:04 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:14.231 15:50:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2298000' 00:06:14.231 killing process with pid 2298000 00:06:14.231 15:50:04 -- common/autotest_common.sh@945 -- # kill 2298000 00:06:14.231 15:50:04 -- common/autotest_common.sh@950 -- # wait 2298000 00:06:14.490 spdk_app_start is called in Round 0. 00:06:14.490 Shutdown signal received, stop current app iteration 00:06:14.490 Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 reinitialization... 00:06:14.490 spdk_app_start is called in Round 1. 00:06:14.490 Shutdown signal received, stop current app iteration 00:06:14.490 Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 reinitialization... 00:06:14.490 spdk_app_start is called in Round 2. 00:06:14.490 Shutdown signal received, stop current app iteration 00:06:14.490 Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 reinitialization... 00:06:14.490 spdk_app_start is called in Round 3. 00:06:14.490 Shutdown signal received, stop current app iteration 00:06:14.490 15:50:04 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:14.490 15:50:04 -- event/event.sh@42 -- # return 0 00:06:14.490 00:06:14.490 real 0m18.908s 00:06:14.490 user 0m41.517s 00:06:14.490 sys 0m3.139s 00:06:14.490 15:50:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:14.490 15:50:04 -- common/autotest_common.sh@10 -- # set +x 00:06:14.490 ************************************ 00:06:14.490 END TEST app_repeat 00:06:14.490 ************************************ 00:06:14.490 15:50:04 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:14.490 15:50:04 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:14.490 15:50:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:14.490 15:50:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:14.490 15:50:04 -- common/autotest_common.sh@10 -- # set +x 00:06:14.490 ************************************ 00:06:14.490 START TEST cpu_locks 00:06:14.490 ************************************ 00:06:14.490 15:50:04 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:14.490 * Looking for test storage... 00:06:14.490 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:14.490 15:50:04 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:14.490 15:50:04 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:14.490 15:50:04 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:14.490 15:50:04 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:14.490 15:50:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:14.490 15:50:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:14.490 15:50:04 -- common/autotest_common.sh@10 -- # set +x 00:06:14.490 ************************************ 00:06:14.490 START TEST default_locks 00:06:14.490 ************************************ 00:06:14.490 15:50:04 -- common/autotest_common.sh@1104 -- # default_locks 00:06:14.490 15:50:04 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=2300545 00:06:14.490 15:50:04 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:14.490 15:50:04 -- event/cpu_locks.sh@47 -- # waitforlisten 2300545 00:06:14.490 15:50:04 -- common/autotest_common.sh@819 -- # '[' -z 2300545 ']' 00:06:14.490 15:50:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:14.490 15:50:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:14.490 15:50:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:14.490 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:14.490 15:50:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:14.490 15:50:04 -- common/autotest_common.sh@10 -- # set +x 00:06:14.748 [2024-10-30 15:50:04.389023] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:14.748 [2024-10-30 15:50:04.389114] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2300545 ] 00:06:14.748 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.748 [2024-10-30 15:50:04.447526] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.748 [2024-10-30 15:50:04.530105] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:14.748 [2024-10-30 15:50:04.530292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.682 15:50:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:15.682 15:50:05 -- common/autotest_common.sh@852 -- # return 0 00:06:15.682 15:50:05 -- event/cpu_locks.sh@49 -- # locks_exist 2300545 00:06:15.682 15:50:05 -- event/cpu_locks.sh@22 -- # lslocks -p 2300545 00:06:15.682 15:50:05 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:15.939 lslocks: write error 00:06:15.939 15:50:05 -- event/cpu_locks.sh@50 -- # killprocess 2300545 00:06:15.939 15:50:05 -- common/autotest_common.sh@926 -- # '[' -z 2300545 ']' 00:06:15.939 15:50:05 -- common/autotest_common.sh@930 -- # kill -0 2300545 00:06:15.939 15:50:05 -- common/autotest_common.sh@931 -- # uname 00:06:15.939 15:50:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:15.939 15:50:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2300545 00:06:15.939 15:50:05 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:15.939 15:50:05 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:15.939 15:50:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2300545' 00:06:15.939 killing process with pid 2300545 00:06:15.939 15:50:05 -- common/autotest_common.sh@945 -- # kill 2300545 00:06:15.939 15:50:05 -- common/autotest_common.sh@950 -- # wait 2300545 00:06:16.505 15:50:06 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 2300545 00:06:16.505 15:50:06 -- common/autotest_common.sh@640 -- # local es=0 00:06:16.505 15:50:06 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 2300545 00:06:16.505 15:50:06 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:06:16.505 15:50:06 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:16.505 15:50:06 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:06:16.505 15:50:06 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:16.505 15:50:06 -- common/autotest_common.sh@643 -- # waitforlisten 2300545 00:06:16.505 15:50:06 -- common/autotest_common.sh@819 -- # '[' -z 2300545 ']' 00:06:16.505 15:50:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:16.505 15:50:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:16.505 15:50:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:16.505 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:16.505 15:50:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:16.505 15:50:06 -- common/autotest_common.sh@10 -- # set +x 00:06:16.505 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (2300545) - No such process 00:06:16.505 ERROR: process (pid: 2300545) is no longer running 00:06:16.505 15:50:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:16.505 15:50:06 -- common/autotest_common.sh@852 -- # return 1 00:06:16.505 15:50:06 -- common/autotest_common.sh@643 -- # es=1 00:06:16.505 15:50:06 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:16.505 15:50:06 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:16.505 15:50:06 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:16.505 15:50:06 -- event/cpu_locks.sh@54 -- # no_locks 00:06:16.505 15:50:06 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:16.505 15:50:06 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:16.505 15:50:06 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:16.505 00:06:16.506 real 0m1.749s 00:06:16.506 user 0m1.909s 00:06:16.506 sys 0m0.536s 00:06:16.506 15:50:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:16.506 15:50:06 -- common/autotest_common.sh@10 -- # set +x 00:06:16.506 ************************************ 00:06:16.506 END TEST default_locks 00:06:16.506 ************************************ 00:06:16.506 15:50:06 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:16.506 15:50:06 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:16.506 15:50:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:16.506 15:50:06 -- common/autotest_common.sh@10 -- # set +x 00:06:16.506 ************************************ 00:06:16.506 START TEST default_locks_via_rpc 00:06:16.506 ************************************ 00:06:16.506 15:50:06 -- common/autotest_common.sh@1104 -- # default_locks_via_rpc 00:06:16.506 15:50:06 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=2300845 00:06:16.506 15:50:06 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:16.506 15:50:06 -- event/cpu_locks.sh@63 -- # waitforlisten 2300845 00:06:16.506 15:50:06 -- common/autotest_common.sh@819 -- # '[' -z 2300845 ']' 00:06:16.506 15:50:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:16.506 15:50:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:16.506 15:50:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:16.506 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:16.506 15:50:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:16.506 15:50:06 -- common/autotest_common.sh@10 -- # set +x 00:06:16.506 [2024-10-30 15:50:06.165016] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:16.506 [2024-10-30 15:50:06.165110] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2300845 ] 00:06:16.506 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.506 [2024-10-30 15:50:06.227500] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.506 [2024-10-30 15:50:06.313949] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:16.506 [2024-10-30 15:50:06.314122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.439 15:50:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:17.439 15:50:07 -- common/autotest_common.sh@852 -- # return 0 00:06:17.439 15:50:07 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:17.439 15:50:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:17.439 15:50:07 -- common/autotest_common.sh@10 -- # set +x 00:06:17.439 15:50:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:17.439 15:50:07 -- event/cpu_locks.sh@67 -- # no_locks 00:06:17.439 15:50:07 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:17.439 15:50:07 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:17.439 15:50:07 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:17.439 15:50:07 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:17.439 15:50:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:17.439 15:50:07 -- common/autotest_common.sh@10 -- # set +x 00:06:17.439 15:50:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:17.439 15:50:07 -- event/cpu_locks.sh@71 -- # locks_exist 2300845 00:06:17.439 15:50:07 -- event/cpu_locks.sh@22 -- # lslocks -p 2300845 00:06:17.439 15:50:07 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:17.697 15:50:07 -- event/cpu_locks.sh@73 -- # killprocess 2300845 00:06:17.697 15:50:07 -- common/autotest_common.sh@926 -- # '[' -z 2300845 ']' 00:06:17.697 15:50:07 -- common/autotest_common.sh@930 -- # kill -0 2300845 00:06:17.697 15:50:07 -- common/autotest_common.sh@931 -- # uname 00:06:17.697 15:50:07 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:17.697 15:50:07 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2300845 00:06:17.697 15:50:07 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:17.697 15:50:07 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:17.697 15:50:07 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2300845' 00:06:17.697 killing process with pid 2300845 00:06:17.697 15:50:07 -- common/autotest_common.sh@945 -- # kill 2300845 00:06:17.697 15:50:07 -- common/autotest_common.sh@950 -- # wait 2300845 00:06:18.265 00:06:18.265 real 0m1.733s 00:06:18.265 user 0m1.914s 00:06:18.265 sys 0m0.545s 00:06:18.265 15:50:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:18.265 15:50:07 -- common/autotest_common.sh@10 -- # set +x 00:06:18.265 ************************************ 00:06:18.265 END TEST default_locks_via_rpc 00:06:18.265 ************************************ 00:06:18.265 15:50:07 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:18.265 15:50:07 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:18.265 15:50:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:18.265 15:50:07 -- common/autotest_common.sh@10 -- # set +x 00:06:18.265 ************************************ 00:06:18.265 START TEST non_locking_app_on_locked_coremask 00:06:18.265 ************************************ 00:06:18.265 15:50:07 -- common/autotest_common.sh@1104 -- # non_locking_app_on_locked_coremask 00:06:18.265 15:50:07 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=2301017 00:06:18.265 15:50:07 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:18.265 15:50:07 -- event/cpu_locks.sh@81 -- # waitforlisten 2301017 /var/tmp/spdk.sock 00:06:18.265 15:50:07 -- common/autotest_common.sh@819 -- # '[' -z 2301017 ']' 00:06:18.265 15:50:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:18.265 15:50:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:18.265 15:50:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:18.265 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:18.265 15:50:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:18.265 15:50:07 -- common/autotest_common.sh@10 -- # set +x 00:06:18.265 [2024-10-30 15:50:07.926352] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:18.265 [2024-10-30 15:50:07.926435] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2301017 ] 00:06:18.265 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.265 [2024-10-30 15:50:07.989353] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.265 [2024-10-30 15:50:08.085276] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:18.265 [2024-10-30 15:50:08.085455] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.200 15:50:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:19.200 15:50:08 -- common/autotest_common.sh@852 -- # return 0 00:06:19.200 15:50:08 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=2301157 00:06:19.200 15:50:08 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:19.200 15:50:08 -- event/cpu_locks.sh@85 -- # waitforlisten 2301157 /var/tmp/spdk2.sock 00:06:19.200 15:50:08 -- common/autotest_common.sh@819 -- # '[' -z 2301157 ']' 00:06:19.200 15:50:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:19.200 15:50:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:19.200 15:50:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:19.200 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:19.200 15:50:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:19.200 15:50:08 -- common/autotest_common.sh@10 -- # set +x 00:06:19.200 [2024-10-30 15:50:08.934849] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:19.200 [2024-10-30 15:50:08.934927] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2301157 ] 00:06:19.200 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.200 [2024-10-30 15:50:09.029970] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:19.200 [2024-10-30 15:50:09.030014] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.459 [2024-10-30 15:50:09.212281] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:19.459 [2024-10-30 15:50:09.212476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.024 15:50:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:20.024 15:50:09 -- common/autotest_common.sh@852 -- # return 0 00:06:20.024 15:50:09 -- event/cpu_locks.sh@87 -- # locks_exist 2301017 00:06:20.024 15:50:09 -- event/cpu_locks.sh@22 -- # lslocks -p 2301017 00:06:20.024 15:50:09 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:20.589 lslocks: write error 00:06:20.589 15:50:10 -- event/cpu_locks.sh@89 -- # killprocess 2301017 00:06:20.589 15:50:10 -- common/autotest_common.sh@926 -- # '[' -z 2301017 ']' 00:06:20.589 15:50:10 -- common/autotest_common.sh@930 -- # kill -0 2301017 00:06:20.589 15:50:10 -- common/autotest_common.sh@931 -- # uname 00:06:20.589 15:50:10 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:20.589 15:50:10 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2301017 00:06:20.589 15:50:10 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:20.589 15:50:10 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:20.589 15:50:10 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2301017' 00:06:20.589 killing process with pid 2301017 00:06:20.589 15:50:10 -- common/autotest_common.sh@945 -- # kill 2301017 00:06:20.589 15:50:10 -- common/autotest_common.sh@950 -- # wait 2301017 00:06:21.523 15:50:11 -- event/cpu_locks.sh@90 -- # killprocess 2301157 00:06:21.523 15:50:11 -- common/autotest_common.sh@926 -- # '[' -z 2301157 ']' 00:06:21.523 15:50:11 -- common/autotest_common.sh@930 -- # kill -0 2301157 00:06:21.523 15:50:11 -- common/autotest_common.sh@931 -- # uname 00:06:21.523 15:50:11 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:21.523 15:50:11 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2301157 00:06:21.523 15:50:11 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:21.523 15:50:11 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:21.523 15:50:11 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2301157' 00:06:21.523 killing process with pid 2301157 00:06:21.523 15:50:11 -- common/autotest_common.sh@945 -- # kill 2301157 00:06:21.523 15:50:11 -- common/autotest_common.sh@950 -- # wait 2301157 00:06:22.090 00:06:22.090 real 0m3.812s 00:06:22.090 user 0m4.196s 00:06:22.090 sys 0m1.094s 00:06:22.090 15:50:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:22.090 15:50:11 -- common/autotest_common.sh@10 -- # set +x 00:06:22.090 ************************************ 00:06:22.090 END TEST non_locking_app_on_locked_coremask 00:06:22.090 ************************************ 00:06:22.090 15:50:11 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:22.090 15:50:11 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:22.090 15:50:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:22.090 15:50:11 -- common/autotest_common.sh@10 -- # set +x 00:06:22.090 ************************************ 00:06:22.090 START TEST locking_app_on_unlocked_coremask 00:06:22.090 ************************************ 00:06:22.090 15:50:11 -- common/autotest_common.sh@1104 -- # locking_app_on_unlocked_coremask 00:06:22.090 15:50:11 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=2301598 00:06:22.090 15:50:11 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:22.090 15:50:11 -- event/cpu_locks.sh@99 -- # waitforlisten 2301598 /var/tmp/spdk.sock 00:06:22.090 15:50:11 -- common/autotest_common.sh@819 -- # '[' -z 2301598 ']' 00:06:22.090 15:50:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:22.090 15:50:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:22.091 15:50:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:22.091 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:22.091 15:50:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:22.091 15:50:11 -- common/autotest_common.sh@10 -- # set +x 00:06:22.091 [2024-10-30 15:50:11.763360] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:22.091 [2024-10-30 15:50:11.763450] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2301598 ] 00:06:22.091 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.091 [2024-10-30 15:50:11.821089] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:22.091 [2024-10-30 15:50:11.821128] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:22.091 [2024-10-30 15:50:11.910698] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:22.091 [2024-10-30 15:50:11.910876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.026 15:50:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:23.026 15:50:12 -- common/autotest_common.sh@852 -- # return 0 00:06:23.026 15:50:12 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=2301739 00:06:23.026 15:50:12 -- event/cpu_locks.sh@103 -- # waitforlisten 2301739 /var/tmp/spdk2.sock 00:06:23.026 15:50:12 -- common/autotest_common.sh@819 -- # '[' -z 2301739 ']' 00:06:23.026 15:50:12 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:23.026 15:50:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:23.026 15:50:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:23.026 15:50:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:23.026 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:23.026 15:50:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:23.026 15:50:12 -- common/autotest_common.sh@10 -- # set +x 00:06:23.026 [2024-10-30 15:50:12.785095] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:23.026 [2024-10-30 15:50:12.785172] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2301739 ] 00:06:23.026 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.026 [2024-10-30 15:50:12.880116] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.284 [2024-10-30 15:50:13.057734] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:23.284 [2024-10-30 15:50:13.057941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.219 15:50:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:24.219 15:50:13 -- common/autotest_common.sh@852 -- # return 0 00:06:24.219 15:50:13 -- event/cpu_locks.sh@105 -- # locks_exist 2301739 00:06:24.219 15:50:13 -- event/cpu_locks.sh@22 -- # lslocks -p 2301739 00:06:24.219 15:50:13 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:24.219 lslocks: write error 00:06:24.219 15:50:14 -- event/cpu_locks.sh@107 -- # killprocess 2301598 00:06:24.219 15:50:14 -- common/autotest_common.sh@926 -- # '[' -z 2301598 ']' 00:06:24.219 15:50:14 -- common/autotest_common.sh@930 -- # kill -0 2301598 00:06:24.219 15:50:14 -- common/autotest_common.sh@931 -- # uname 00:06:24.219 15:50:14 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:24.219 15:50:14 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2301598 00:06:24.478 15:50:14 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:24.478 15:50:14 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:24.478 15:50:14 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2301598' 00:06:24.478 killing process with pid 2301598 00:06:24.478 15:50:14 -- common/autotest_common.sh@945 -- # kill 2301598 00:06:24.478 15:50:14 -- common/autotest_common.sh@950 -- # wait 2301598 00:06:25.503 15:50:14 -- event/cpu_locks.sh@108 -- # killprocess 2301739 00:06:25.503 15:50:14 -- common/autotest_common.sh@926 -- # '[' -z 2301739 ']' 00:06:25.503 15:50:14 -- common/autotest_common.sh@930 -- # kill -0 2301739 00:06:25.503 15:50:14 -- common/autotest_common.sh@931 -- # uname 00:06:25.503 15:50:14 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:25.503 15:50:14 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2301739 00:06:25.503 15:50:14 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:25.503 15:50:14 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:25.503 15:50:14 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2301739' 00:06:25.503 killing process with pid 2301739 00:06:25.503 15:50:14 -- common/autotest_common.sh@945 -- # kill 2301739 00:06:25.503 15:50:14 -- common/autotest_common.sh@950 -- # wait 2301739 00:06:25.792 00:06:25.792 real 0m3.661s 00:06:25.792 user 0m4.060s 00:06:25.792 sys 0m1.032s 00:06:25.792 15:50:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:25.792 15:50:15 -- common/autotest_common.sh@10 -- # set +x 00:06:25.792 ************************************ 00:06:25.792 END TEST locking_app_on_unlocked_coremask 00:06:25.793 ************************************ 00:06:25.793 15:50:15 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:25.793 15:50:15 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:25.793 15:50:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:25.793 15:50:15 -- common/autotest_common.sh@10 -- # set +x 00:06:25.793 ************************************ 00:06:25.793 START TEST locking_app_on_locked_coremask 00:06:25.793 ************************************ 00:06:25.793 15:50:15 -- common/autotest_common.sh@1104 -- # locking_app_on_locked_coremask 00:06:25.793 15:50:15 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=2302048 00:06:25.793 15:50:15 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:25.793 15:50:15 -- event/cpu_locks.sh@116 -- # waitforlisten 2302048 /var/tmp/spdk.sock 00:06:25.793 15:50:15 -- common/autotest_common.sh@819 -- # '[' -z 2302048 ']' 00:06:25.793 15:50:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:25.793 15:50:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:25.793 15:50:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:25.793 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:25.793 15:50:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:25.793 15:50:15 -- common/autotest_common.sh@10 -- # set +x 00:06:25.793 [2024-10-30 15:50:15.454532] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:25.793 [2024-10-30 15:50:15.454629] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2302048 ] 00:06:25.793 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.793 [2024-10-30 15:50:15.517607] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.793 [2024-10-30 15:50:15.604842] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:25.793 [2024-10-30 15:50:15.605003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.726 15:50:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:26.726 15:50:16 -- common/autotest_common.sh@852 -- # return 0 00:06:26.726 15:50:16 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=2302190 00:06:26.726 15:50:16 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:26.726 15:50:16 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 2302190 /var/tmp/spdk2.sock 00:06:26.726 15:50:16 -- common/autotest_common.sh@640 -- # local es=0 00:06:26.727 15:50:16 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 2302190 /var/tmp/spdk2.sock 00:06:26.727 15:50:16 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:06:26.727 15:50:16 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:26.727 15:50:16 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:06:26.727 15:50:16 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:26.727 15:50:16 -- common/autotest_common.sh@643 -- # waitforlisten 2302190 /var/tmp/spdk2.sock 00:06:26.727 15:50:16 -- common/autotest_common.sh@819 -- # '[' -z 2302190 ']' 00:06:26.727 15:50:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:26.727 15:50:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:26.727 15:50:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:26.727 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:26.727 15:50:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:26.727 15:50:16 -- common/autotest_common.sh@10 -- # set +x 00:06:26.727 [2024-10-30 15:50:16.433370] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:26.727 [2024-10-30 15:50:16.433449] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2302190 ] 00:06:26.727 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.727 [2024-10-30 15:50:16.527297] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 2302048 has claimed it. 00:06:26.727 [2024-10-30 15:50:16.527357] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:27.292 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (2302190) - No such process 00:06:27.292 ERROR: process (pid: 2302190) is no longer running 00:06:27.292 15:50:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:27.292 15:50:17 -- common/autotest_common.sh@852 -- # return 1 00:06:27.292 15:50:17 -- common/autotest_common.sh@643 -- # es=1 00:06:27.292 15:50:17 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:27.292 15:50:17 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:27.292 15:50:17 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:27.292 15:50:17 -- event/cpu_locks.sh@122 -- # locks_exist 2302048 00:06:27.292 15:50:17 -- event/cpu_locks.sh@22 -- # lslocks -p 2302048 00:06:27.292 15:50:17 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:27.550 lslocks: write error 00:06:27.550 15:50:17 -- event/cpu_locks.sh@124 -- # killprocess 2302048 00:06:27.550 15:50:17 -- common/autotest_common.sh@926 -- # '[' -z 2302048 ']' 00:06:27.550 15:50:17 -- common/autotest_common.sh@930 -- # kill -0 2302048 00:06:27.550 15:50:17 -- common/autotest_common.sh@931 -- # uname 00:06:27.550 15:50:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:27.550 15:50:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2302048 00:06:27.550 15:50:17 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:27.550 15:50:17 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:27.550 15:50:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2302048' 00:06:27.550 killing process with pid 2302048 00:06:27.550 15:50:17 -- common/autotest_common.sh@945 -- # kill 2302048 00:06:27.550 15:50:17 -- common/autotest_common.sh@950 -- # wait 2302048 00:06:28.116 00:06:28.116 real 0m2.397s 00:06:28.116 user 0m2.736s 00:06:28.116 sys 0m0.640s 00:06:28.116 15:50:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:28.116 15:50:17 -- common/autotest_common.sh@10 -- # set +x 00:06:28.116 ************************************ 00:06:28.116 END TEST locking_app_on_locked_coremask 00:06:28.116 ************************************ 00:06:28.116 15:50:17 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:28.116 15:50:17 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:28.116 15:50:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:28.116 15:50:17 -- common/autotest_common.sh@10 -- # set +x 00:06:28.116 ************************************ 00:06:28.116 START TEST locking_overlapped_coremask 00:06:28.116 ************************************ 00:06:28.116 15:50:17 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask 00:06:28.116 15:50:17 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=2302360 00:06:28.116 15:50:17 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:28.116 15:50:17 -- event/cpu_locks.sh@133 -- # waitforlisten 2302360 /var/tmp/spdk.sock 00:06:28.116 15:50:17 -- common/autotest_common.sh@819 -- # '[' -z 2302360 ']' 00:06:28.116 15:50:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:28.116 15:50:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:28.116 15:50:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:28.116 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:28.116 15:50:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:28.116 15:50:17 -- common/autotest_common.sh@10 -- # set +x 00:06:28.116 [2024-10-30 15:50:17.877625] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:28.116 [2024-10-30 15:50:17.877719] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2302360 ] 00:06:28.116 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.116 [2024-10-30 15:50:17.940572] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:28.374 [2024-10-30 15:50:18.027719] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:28.374 [2024-10-30 15:50:18.027953] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:28.374 [2024-10-30 15:50:18.028006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:28.374 [2024-10-30 15:50:18.028009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.939 15:50:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:28.939 15:50:18 -- common/autotest_common.sh@852 -- # return 0 00:06:28.939 15:50:18 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=2302504 00:06:28.939 15:50:18 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 2302504 /var/tmp/spdk2.sock 00:06:28.939 15:50:18 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:28.939 15:50:18 -- common/autotest_common.sh@640 -- # local es=0 00:06:28.939 15:50:18 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 2302504 /var/tmp/spdk2.sock 00:06:28.939 15:50:18 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:06:28.939 15:50:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:28.939 15:50:18 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:06:28.939 15:50:18 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:28.939 15:50:18 -- common/autotest_common.sh@643 -- # waitforlisten 2302504 /var/tmp/spdk2.sock 00:06:28.939 15:50:18 -- common/autotest_common.sh@819 -- # '[' -z 2302504 ']' 00:06:28.939 15:50:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:28.939 15:50:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:28.939 15:50:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:28.939 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:28.939 15:50:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:28.939 15:50:18 -- common/autotest_common.sh@10 -- # set +x 00:06:29.196 [2024-10-30 15:50:18.862945] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:29.196 [2024-10-30 15:50:18.863021] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2302504 ] 00:06:29.196 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.196 [2024-10-30 15:50:18.950473] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2302360 has claimed it. 00:06:29.196 [2024-10-30 15:50:18.950532] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:29.762 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (2302504) - No such process 00:06:29.762 ERROR: process (pid: 2302504) is no longer running 00:06:29.762 15:50:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:29.762 15:50:19 -- common/autotest_common.sh@852 -- # return 1 00:06:29.762 15:50:19 -- common/autotest_common.sh@643 -- # es=1 00:06:29.762 15:50:19 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:29.762 15:50:19 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:29.762 15:50:19 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:29.762 15:50:19 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:29.762 15:50:19 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:29.762 15:50:19 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:29.762 15:50:19 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:29.762 15:50:19 -- event/cpu_locks.sh@141 -- # killprocess 2302360 00:06:29.762 15:50:19 -- common/autotest_common.sh@926 -- # '[' -z 2302360 ']' 00:06:29.762 15:50:19 -- common/autotest_common.sh@930 -- # kill -0 2302360 00:06:29.762 15:50:19 -- common/autotest_common.sh@931 -- # uname 00:06:29.762 15:50:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:29.762 15:50:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2302360 00:06:29.762 15:50:19 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:29.762 15:50:19 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:29.762 15:50:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2302360' 00:06:29.762 killing process with pid 2302360 00:06:29.762 15:50:19 -- common/autotest_common.sh@945 -- # kill 2302360 00:06:29.762 15:50:19 -- common/autotest_common.sh@950 -- # wait 2302360 00:06:30.325 00:06:30.325 real 0m2.174s 00:06:30.325 user 0m6.266s 00:06:30.325 sys 0m0.463s 00:06:30.325 15:50:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:30.325 15:50:20 -- common/autotest_common.sh@10 -- # set +x 00:06:30.325 ************************************ 00:06:30.325 END TEST locking_overlapped_coremask 00:06:30.326 ************************************ 00:06:30.326 15:50:20 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:30.326 15:50:20 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:30.326 15:50:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:30.326 15:50:20 -- common/autotest_common.sh@10 -- # set +x 00:06:30.326 ************************************ 00:06:30.326 START TEST locking_overlapped_coremask_via_rpc 00:06:30.326 ************************************ 00:06:30.326 15:50:20 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask_via_rpc 00:06:30.326 15:50:20 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=2302682 00:06:30.326 15:50:20 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:30.326 15:50:20 -- event/cpu_locks.sh@149 -- # waitforlisten 2302682 /var/tmp/spdk.sock 00:06:30.326 15:50:20 -- common/autotest_common.sh@819 -- # '[' -z 2302682 ']' 00:06:30.326 15:50:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:30.326 15:50:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:30.326 15:50:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:30.326 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:30.326 15:50:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:30.326 15:50:20 -- common/autotest_common.sh@10 -- # set +x 00:06:30.326 [2024-10-30 15:50:20.078459] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:30.326 [2024-10-30 15:50:20.078539] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2302682 ] 00:06:30.326 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.326 [2024-10-30 15:50:20.138793] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:30.326 [2024-10-30 15:50:20.138826] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:30.583 [2024-10-30 15:50:20.229132] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:30.583 [2024-10-30 15:50:20.229345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:30.583 [2024-10-30 15:50:20.229398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:30.583 [2024-10-30 15:50:20.229401] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.517 15:50:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:31.517 15:50:21 -- common/autotest_common.sh@852 -- # return 0 00:06:31.517 15:50:21 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=2302825 00:06:31.517 15:50:21 -- event/cpu_locks.sh@153 -- # waitforlisten 2302825 /var/tmp/spdk2.sock 00:06:31.517 15:50:21 -- common/autotest_common.sh@819 -- # '[' -z 2302825 ']' 00:06:31.517 15:50:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:31.517 15:50:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:31.517 15:50:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:31.517 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:31.517 15:50:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:31.517 15:50:21 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:31.517 15:50:21 -- common/autotest_common.sh@10 -- # set +x 00:06:31.517 [2024-10-30 15:50:21.086799] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:31.517 [2024-10-30 15:50:21.086876] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2302825 ] 00:06:31.517 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.517 [2024-10-30 15:50:21.171099] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:31.517 [2024-10-30 15:50:21.171131] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:31.517 [2024-10-30 15:50:21.344271] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:31.517 [2024-10-30 15:50:21.344495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:31.517 [2024-10-30 15:50:21.344559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:31.517 [2024-10-30 15:50:21.344563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:32.452 15:50:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:32.452 15:50:22 -- common/autotest_common.sh@852 -- # return 0 00:06:32.452 15:50:22 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:32.452 15:50:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:32.452 15:50:22 -- common/autotest_common.sh@10 -- # set +x 00:06:32.452 15:50:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:32.452 15:50:22 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:32.452 15:50:22 -- common/autotest_common.sh@640 -- # local es=0 00:06:32.452 15:50:22 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:32.452 15:50:22 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:06:32.452 15:50:22 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:32.452 15:50:22 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:06:32.452 15:50:22 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:32.452 15:50:22 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:32.452 15:50:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:32.452 15:50:22 -- common/autotest_common.sh@10 -- # set +x 00:06:32.452 [2024-10-30 15:50:22.044363] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2302682 has claimed it. 00:06:32.452 request: 00:06:32.452 { 00:06:32.452 "method": "framework_enable_cpumask_locks", 00:06:32.452 "req_id": 1 00:06:32.452 } 00:06:32.452 Got JSON-RPC error response 00:06:32.452 response: 00:06:32.452 { 00:06:32.452 "code": -32603, 00:06:32.452 "message": "Failed to claim CPU core: 2" 00:06:32.452 } 00:06:32.452 15:50:22 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:06:32.452 15:50:22 -- common/autotest_common.sh@643 -- # es=1 00:06:32.452 15:50:22 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:32.452 15:50:22 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:32.452 15:50:22 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:32.452 15:50:22 -- event/cpu_locks.sh@158 -- # waitforlisten 2302682 /var/tmp/spdk.sock 00:06:32.452 15:50:22 -- common/autotest_common.sh@819 -- # '[' -z 2302682 ']' 00:06:32.452 15:50:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:32.452 15:50:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:32.452 15:50:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:32.452 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:32.452 15:50:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:32.452 15:50:22 -- common/autotest_common.sh@10 -- # set +x 00:06:32.452 15:50:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:32.452 15:50:22 -- common/autotest_common.sh@852 -- # return 0 00:06:32.452 15:50:22 -- event/cpu_locks.sh@159 -- # waitforlisten 2302825 /var/tmp/spdk2.sock 00:06:32.452 15:50:22 -- common/autotest_common.sh@819 -- # '[' -z 2302825 ']' 00:06:32.452 15:50:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:32.452 15:50:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:32.452 15:50:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:32.452 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:32.452 15:50:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:32.452 15:50:22 -- common/autotest_common.sh@10 -- # set +x 00:06:32.710 15:50:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:32.710 15:50:22 -- common/autotest_common.sh@852 -- # return 0 00:06:32.710 15:50:22 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:32.710 15:50:22 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:32.710 15:50:22 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:32.710 15:50:22 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:32.710 00:06:32.710 real 0m2.513s 00:06:32.710 user 0m1.235s 00:06:32.710 sys 0m0.205s 00:06:32.710 15:50:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:32.710 15:50:22 -- common/autotest_common.sh@10 -- # set +x 00:06:32.710 ************************************ 00:06:32.710 END TEST locking_overlapped_coremask_via_rpc 00:06:32.710 ************************************ 00:06:32.710 15:50:22 -- event/cpu_locks.sh@174 -- # cleanup 00:06:32.710 15:50:22 -- event/cpu_locks.sh@15 -- # [[ -z 2302682 ]] 00:06:32.710 15:50:22 -- event/cpu_locks.sh@15 -- # killprocess 2302682 00:06:32.710 15:50:22 -- common/autotest_common.sh@926 -- # '[' -z 2302682 ']' 00:06:32.710 15:50:22 -- common/autotest_common.sh@930 -- # kill -0 2302682 00:06:32.710 15:50:22 -- common/autotest_common.sh@931 -- # uname 00:06:32.710 15:50:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:32.710 15:50:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2302682 00:06:32.968 15:50:22 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:32.968 15:50:22 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:32.968 15:50:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2302682' 00:06:32.968 killing process with pid 2302682 00:06:32.968 15:50:22 -- common/autotest_common.sh@945 -- # kill 2302682 00:06:32.968 15:50:22 -- common/autotest_common.sh@950 -- # wait 2302682 00:06:33.227 15:50:22 -- event/cpu_locks.sh@16 -- # [[ -z 2302825 ]] 00:06:33.227 15:50:22 -- event/cpu_locks.sh@16 -- # killprocess 2302825 00:06:33.227 15:50:22 -- common/autotest_common.sh@926 -- # '[' -z 2302825 ']' 00:06:33.227 15:50:22 -- common/autotest_common.sh@930 -- # kill -0 2302825 00:06:33.227 15:50:22 -- common/autotest_common.sh@931 -- # uname 00:06:33.227 15:50:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:33.227 15:50:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2302825 00:06:33.227 15:50:23 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:06:33.227 15:50:23 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:06:33.227 15:50:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2302825' 00:06:33.227 killing process with pid 2302825 00:06:33.227 15:50:23 -- common/autotest_common.sh@945 -- # kill 2302825 00:06:33.227 15:50:23 -- common/autotest_common.sh@950 -- # wait 2302825 00:06:33.792 15:50:23 -- event/cpu_locks.sh@18 -- # rm -f 00:06:33.792 15:50:23 -- event/cpu_locks.sh@1 -- # cleanup 00:06:33.792 15:50:23 -- event/cpu_locks.sh@15 -- # [[ -z 2302682 ]] 00:06:33.792 15:50:23 -- event/cpu_locks.sh@15 -- # killprocess 2302682 00:06:33.792 15:50:23 -- common/autotest_common.sh@926 -- # '[' -z 2302682 ']' 00:06:33.792 15:50:23 -- common/autotest_common.sh@930 -- # kill -0 2302682 00:06:33.792 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2302682) - No such process 00:06:33.792 15:50:23 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2302682 is not found' 00:06:33.792 Process with pid 2302682 is not found 00:06:33.792 15:50:23 -- event/cpu_locks.sh@16 -- # [[ -z 2302825 ]] 00:06:33.792 15:50:23 -- event/cpu_locks.sh@16 -- # killprocess 2302825 00:06:33.792 15:50:23 -- common/autotest_common.sh@926 -- # '[' -z 2302825 ']' 00:06:33.792 15:50:23 -- common/autotest_common.sh@930 -- # kill -0 2302825 00:06:33.792 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2302825) - No such process 00:06:33.792 15:50:23 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2302825 is not found' 00:06:33.792 Process with pid 2302825 is not found 00:06:33.792 15:50:23 -- event/cpu_locks.sh@18 -- # rm -f 00:06:33.792 00:06:33.792 real 0m19.161s 00:06:33.792 user 0m34.708s 00:06:33.792 sys 0m5.329s 00:06:33.792 15:50:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:33.792 15:50:23 -- common/autotest_common.sh@10 -- # set +x 00:06:33.792 ************************************ 00:06:33.792 END TEST cpu_locks 00:06:33.792 ************************************ 00:06:33.792 00:06:33.792 real 0m46.206s 00:06:33.792 user 1m29.694s 00:06:33.792 sys 0m9.199s 00:06:33.792 15:50:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:33.792 15:50:23 -- common/autotest_common.sh@10 -- # set +x 00:06:33.792 ************************************ 00:06:33.792 END TEST event 00:06:33.792 ************************************ 00:06:33.792 15:50:23 -- spdk/autotest.sh@188 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:33.792 15:50:23 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:33.792 15:50:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:33.792 15:50:23 -- common/autotest_common.sh@10 -- # set +x 00:06:33.792 ************************************ 00:06:33.792 START TEST thread 00:06:33.792 ************************************ 00:06:33.792 15:50:23 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:33.792 * Looking for test storage... 00:06:33.792 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:33.792 15:50:23 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:33.792 15:50:23 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:06:33.792 15:50:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:33.792 15:50:23 -- common/autotest_common.sh@10 -- # set +x 00:06:33.792 ************************************ 00:06:33.792 START TEST thread_poller_perf 00:06:33.792 ************************************ 00:06:33.792 15:50:23 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:33.792 [2024-10-30 15:50:23.561001] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:33.792 [2024-10-30 15:50:23.561082] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2303191 ] 00:06:33.792 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.792 [2024-10-30 15:50:23.620922] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.051 [2024-10-30 15:50:23.708959] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.051 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:34.985 [2024-10-30T14:50:24.861Z] ====================================== 00:06:34.985 [2024-10-30T14:50:24.861Z] busy:2711857095 (cyc) 00:06:34.985 [2024-10-30T14:50:24.861Z] total_run_count: 279000 00:06:34.985 [2024-10-30T14:50:24.861Z] tsc_hz: 2700000000 (cyc) 00:06:34.985 [2024-10-30T14:50:24.861Z] ====================================== 00:06:34.985 [2024-10-30T14:50:24.861Z] poller_cost: 9719 (cyc), 3599 (nsec) 00:06:34.985 00:06:34.985 real 0m1.253s 00:06:34.985 user 0m1.166s 00:06:34.985 sys 0m0.081s 00:06:34.985 15:50:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:34.985 15:50:24 -- common/autotest_common.sh@10 -- # set +x 00:06:34.985 ************************************ 00:06:34.985 END TEST thread_poller_perf 00:06:34.985 ************************************ 00:06:34.985 15:50:24 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:34.985 15:50:24 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:06:34.985 15:50:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:34.985 15:50:24 -- common/autotest_common.sh@10 -- # set +x 00:06:34.985 ************************************ 00:06:34.985 START TEST thread_poller_perf 00:06:34.985 ************************************ 00:06:34.985 15:50:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:34.985 [2024-10-30 15:50:24.844880] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:34.985 [2024-10-30 15:50:24.844972] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2303347 ] 00:06:35.245 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.245 [2024-10-30 15:50:24.910507] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:35.245 [2024-10-30 15:50:24.998421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.245 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:36.620 [2024-10-30T14:50:26.496Z] ====================================== 00:06:36.620 [2024-10-30T14:50:26.496Z] busy:2703746470 (cyc) 00:06:36.620 [2024-10-30T14:50:26.496Z] total_run_count: 3872000 00:06:36.620 [2024-10-30T14:50:26.496Z] tsc_hz: 2700000000 (cyc) 00:06:36.620 [2024-10-30T14:50:26.496Z] ====================================== 00:06:36.620 [2024-10-30T14:50:26.496Z] poller_cost: 698 (cyc), 258 (nsec) 00:06:36.620 00:06:36.620 real 0m1.250s 00:06:36.620 user 0m1.161s 00:06:36.620 sys 0m0.082s 00:06:36.620 15:50:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:36.620 15:50:26 -- common/autotest_common.sh@10 -- # set +x 00:06:36.620 ************************************ 00:06:36.620 END TEST thread_poller_perf 00:06:36.620 ************************************ 00:06:36.620 15:50:26 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:36.620 00:06:36.620 real 0m2.613s 00:06:36.620 user 0m2.369s 00:06:36.620 sys 0m0.246s 00:06:36.620 15:50:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:36.620 15:50:26 -- common/autotest_common.sh@10 -- # set +x 00:06:36.620 ************************************ 00:06:36.620 END TEST thread 00:06:36.620 ************************************ 00:06:36.620 15:50:26 -- spdk/autotest.sh@189 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:36.620 15:50:26 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:36.620 15:50:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:36.620 15:50:26 -- common/autotest_common.sh@10 -- # set +x 00:06:36.620 ************************************ 00:06:36.620 START TEST accel 00:06:36.620 ************************************ 00:06:36.620 15:50:26 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:36.620 * Looking for test storage... 00:06:36.620 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:36.620 15:50:26 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:36.620 15:50:26 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:36.620 15:50:26 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:36.620 15:50:26 -- accel/accel.sh@59 -- # spdk_tgt_pid=2303636 00:06:36.620 15:50:26 -- accel/accel.sh@60 -- # waitforlisten 2303636 00:06:36.620 15:50:26 -- common/autotest_common.sh@819 -- # '[' -z 2303636 ']' 00:06:36.620 15:50:26 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:36.620 15:50:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:36.620 15:50:26 -- accel/accel.sh@58 -- # build_accel_config 00:06:36.620 15:50:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:36.620 15:50:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.620 15:50:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:36.620 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:36.620 15:50:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.620 15:50:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:36.620 15:50:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.620 15:50:26 -- common/autotest_common.sh@10 -- # set +x 00:06:36.620 15:50:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.620 15:50:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.620 15:50:26 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.620 15:50:26 -- accel/accel.sh@42 -- # jq -r . 00:06:36.620 [2024-10-30 15:50:26.228975] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:36.620 [2024-10-30 15:50:26.229057] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2303636 ] 00:06:36.620 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.620 [2024-10-30 15:50:26.293001] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.620 [2024-10-30 15:50:26.388048] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:36.620 [2024-10-30 15:50:26.388225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.555 15:50:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:37.555 15:50:27 -- common/autotest_common.sh@852 -- # return 0 00:06:37.555 15:50:27 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:37.555 15:50:27 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:37.555 15:50:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:37.555 15:50:27 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:37.555 15:50:27 -- common/autotest_common.sh@10 -- # set +x 00:06:37.555 15:50:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:37.555 15:50:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.555 15:50:27 -- accel/accel.sh@64 -- # IFS== 00:06:37.555 15:50:27 -- accel/accel.sh@64 -- # read -r opc module 00:06:37.555 15:50:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:37.555 15:50:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.555 15:50:27 -- accel/accel.sh@64 -- # IFS== 00:06:37.555 15:50:27 -- accel/accel.sh@64 -- # read -r opc module 00:06:37.555 15:50:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:37.555 15:50:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.555 15:50:27 -- accel/accel.sh@64 -- # IFS== 00:06:37.555 15:50:27 -- accel/accel.sh@64 -- # read -r opc module 00:06:37.555 15:50:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:37.555 15:50:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.555 15:50:27 -- accel/accel.sh@64 -- # IFS== 00:06:37.555 15:50:27 -- accel/accel.sh@64 -- # read -r opc module 00:06:37.555 15:50:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:37.555 15:50:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.555 15:50:27 -- accel/accel.sh@64 -- # IFS== 00:06:37.555 15:50:27 -- accel/accel.sh@64 -- # read -r opc module 00:06:37.555 15:50:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:37.555 15:50:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.555 15:50:27 -- accel/accel.sh@64 -- # IFS== 00:06:37.555 15:50:27 -- accel/accel.sh@64 -- # read -r opc module 00:06:37.556 15:50:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:37.556 15:50:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # IFS== 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # read -r opc module 00:06:37.556 15:50:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:37.556 15:50:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # IFS== 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # read -r opc module 00:06:37.556 15:50:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:37.556 15:50:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # IFS== 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # read -r opc module 00:06:37.556 15:50:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:37.556 15:50:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # IFS== 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # read -r opc module 00:06:37.556 15:50:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:37.556 15:50:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # IFS== 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # read -r opc module 00:06:37.556 15:50:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:37.556 15:50:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # IFS== 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # read -r opc module 00:06:37.556 15:50:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:37.556 15:50:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # IFS== 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # read -r opc module 00:06:37.556 15:50:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:37.556 15:50:27 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # IFS== 00:06:37.556 15:50:27 -- accel/accel.sh@64 -- # read -r opc module 00:06:37.556 15:50:27 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:37.556 15:50:27 -- accel/accel.sh@67 -- # killprocess 2303636 00:06:37.556 15:50:27 -- common/autotest_common.sh@926 -- # '[' -z 2303636 ']' 00:06:37.556 15:50:27 -- common/autotest_common.sh@930 -- # kill -0 2303636 00:06:37.556 15:50:27 -- common/autotest_common.sh@931 -- # uname 00:06:37.556 15:50:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:37.556 15:50:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2303636 00:06:37.556 15:50:27 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:37.556 15:50:27 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:37.556 15:50:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2303636' 00:06:37.556 killing process with pid 2303636 00:06:37.556 15:50:27 -- common/autotest_common.sh@945 -- # kill 2303636 00:06:37.556 15:50:27 -- common/autotest_common.sh@950 -- # wait 2303636 00:06:37.814 15:50:27 -- accel/accel.sh@68 -- # trap - ERR 00:06:37.814 15:50:27 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:37.814 15:50:27 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:37.814 15:50:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:37.814 15:50:27 -- common/autotest_common.sh@10 -- # set +x 00:06:37.814 15:50:27 -- common/autotest_common.sh@1104 -- # accel_perf -h 00:06:37.814 15:50:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:37.814 15:50:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:37.814 15:50:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:37.814 15:50:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:37.814 15:50:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:37.814 15:50:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:37.814 15:50:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:37.814 15:50:27 -- accel/accel.sh@41 -- # local IFS=, 00:06:37.814 15:50:27 -- accel/accel.sh@42 -- # jq -r . 00:06:37.814 15:50:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:37.814 15:50:27 -- common/autotest_common.sh@10 -- # set +x 00:06:38.073 15:50:27 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:38.073 15:50:27 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:38.073 15:50:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:38.073 15:50:27 -- common/autotest_common.sh@10 -- # set +x 00:06:38.073 ************************************ 00:06:38.073 START TEST accel_missing_filename 00:06:38.073 ************************************ 00:06:38.073 15:50:27 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress 00:06:38.073 15:50:27 -- common/autotest_common.sh@640 -- # local es=0 00:06:38.073 15:50:27 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:38.073 15:50:27 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:06:38.073 15:50:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:38.073 15:50:27 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:06:38.073 15:50:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:38.073 15:50:27 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress 00:06:38.073 15:50:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:38.073 15:50:27 -- accel/accel.sh@12 -- # build_accel_config 00:06:38.073 15:50:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:38.073 15:50:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:38.073 15:50:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:38.073 15:50:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:38.073 15:50:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:38.073 15:50:27 -- accel/accel.sh@41 -- # local IFS=, 00:06:38.073 15:50:27 -- accel/accel.sh@42 -- # jq -r . 00:06:38.073 [2024-10-30 15:50:27.727070] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:38.073 [2024-10-30 15:50:27.727148] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2303846 ] 00:06:38.073 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.073 [2024-10-30 15:50:27.787633] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:38.073 [2024-10-30 15:50:27.878619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.073 [2024-10-30 15:50:27.939953] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:38.331 [2024-10-30 15:50:28.023650] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:38.331 A filename is required. 00:06:38.331 15:50:28 -- common/autotest_common.sh@643 -- # es=234 00:06:38.331 15:50:28 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:38.331 15:50:28 -- common/autotest_common.sh@652 -- # es=106 00:06:38.331 15:50:28 -- common/autotest_common.sh@653 -- # case "$es" in 00:06:38.331 15:50:28 -- common/autotest_common.sh@660 -- # es=1 00:06:38.331 15:50:28 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:38.331 00:06:38.331 real 0m0.397s 00:06:38.331 user 0m0.291s 00:06:38.331 sys 0m0.138s 00:06:38.331 15:50:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:38.331 15:50:28 -- common/autotest_common.sh@10 -- # set +x 00:06:38.331 ************************************ 00:06:38.331 END TEST accel_missing_filename 00:06:38.331 ************************************ 00:06:38.332 15:50:28 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:38.332 15:50:28 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:06:38.332 15:50:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:38.332 15:50:28 -- common/autotest_common.sh@10 -- # set +x 00:06:38.332 ************************************ 00:06:38.332 START TEST accel_compress_verify 00:06:38.332 ************************************ 00:06:38.332 15:50:28 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:38.332 15:50:28 -- common/autotest_common.sh@640 -- # local es=0 00:06:38.332 15:50:28 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:38.332 15:50:28 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:06:38.332 15:50:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:38.332 15:50:28 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:06:38.332 15:50:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:38.332 15:50:28 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:38.332 15:50:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:38.332 15:50:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:38.332 15:50:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:38.332 15:50:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:38.332 15:50:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:38.332 15:50:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:38.332 15:50:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:38.332 15:50:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:38.332 15:50:28 -- accel/accel.sh@42 -- # jq -r . 00:06:38.332 [2024-10-30 15:50:28.146494] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:38.332 [2024-10-30 15:50:28.146587] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2303871 ] 00:06:38.332 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.332 [2024-10-30 15:50:28.206643] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:38.590 [2024-10-30 15:50:28.297675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.590 [2024-10-30 15:50:28.358778] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:38.590 [2024-10-30 15:50:28.434908] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:38.849 00:06:38.849 Compression does not support the verify option, aborting. 00:06:38.849 15:50:28 -- common/autotest_common.sh@643 -- # es=161 00:06:38.849 15:50:28 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:38.849 15:50:28 -- common/autotest_common.sh@652 -- # es=33 00:06:38.849 15:50:28 -- common/autotest_common.sh@653 -- # case "$es" in 00:06:38.849 15:50:28 -- common/autotest_common.sh@660 -- # es=1 00:06:38.849 15:50:28 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:38.849 00:06:38.849 real 0m0.383s 00:06:38.849 user 0m0.271s 00:06:38.849 sys 0m0.142s 00:06:38.849 15:50:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:38.849 15:50:28 -- common/autotest_common.sh@10 -- # set +x 00:06:38.849 ************************************ 00:06:38.849 END TEST accel_compress_verify 00:06:38.849 ************************************ 00:06:38.849 15:50:28 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:38.849 15:50:28 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:38.849 15:50:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:38.849 15:50:28 -- common/autotest_common.sh@10 -- # set +x 00:06:38.849 ************************************ 00:06:38.849 START TEST accel_wrong_workload 00:06:38.849 ************************************ 00:06:38.849 15:50:28 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w foobar 00:06:38.849 15:50:28 -- common/autotest_common.sh@640 -- # local es=0 00:06:38.849 15:50:28 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:38.849 15:50:28 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:06:38.849 15:50:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:38.849 15:50:28 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:06:38.849 15:50:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:38.849 15:50:28 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w foobar 00:06:38.849 15:50:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:38.849 15:50:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:38.849 15:50:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:38.849 15:50:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:38.849 15:50:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:38.849 15:50:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:38.849 15:50:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:38.849 15:50:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:38.849 15:50:28 -- accel/accel.sh@42 -- # jq -r . 00:06:38.849 Unsupported workload type: foobar 00:06:38.849 [2024-10-30 15:50:28.555417] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:38.849 accel_perf options: 00:06:38.849 [-h help message] 00:06:38.849 [-q queue depth per core] 00:06:38.849 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:38.849 [-T number of threads per core 00:06:38.849 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:38.849 [-t time in seconds] 00:06:38.849 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:38.849 [ dif_verify, , dif_generate, dif_generate_copy 00:06:38.849 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:38.849 [-l for compress/decompress workloads, name of uncompressed input file 00:06:38.849 [-S for crc32c workload, use this seed value (default 0) 00:06:38.849 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:38.849 [-f for fill workload, use this BYTE value (default 255) 00:06:38.849 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:38.849 [-y verify result if this switch is on] 00:06:38.849 [-a tasks to allocate per core (default: same value as -q)] 00:06:38.849 Can be used to spread operations across a wider range of memory. 00:06:38.849 15:50:28 -- common/autotest_common.sh@643 -- # es=1 00:06:38.849 15:50:28 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:38.849 15:50:28 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:38.849 15:50:28 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:38.849 00:06:38.849 real 0m0.022s 00:06:38.849 user 0m0.010s 00:06:38.849 sys 0m0.013s 00:06:38.849 15:50:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:38.849 15:50:28 -- common/autotest_common.sh@10 -- # set +x 00:06:38.849 ************************************ 00:06:38.849 END TEST accel_wrong_workload 00:06:38.849 ************************************ 00:06:38.849 Error: writing output failed: Broken pipe 00:06:38.849 15:50:28 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:38.849 15:50:28 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:06:38.849 15:50:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:38.849 15:50:28 -- common/autotest_common.sh@10 -- # set +x 00:06:38.850 ************************************ 00:06:38.850 START TEST accel_negative_buffers 00:06:38.850 ************************************ 00:06:38.850 15:50:28 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:38.850 15:50:28 -- common/autotest_common.sh@640 -- # local es=0 00:06:38.850 15:50:28 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:38.850 15:50:28 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:06:38.850 15:50:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:38.850 15:50:28 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:06:38.850 15:50:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:38.850 15:50:28 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w xor -y -x -1 00:06:38.850 15:50:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:38.850 15:50:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:38.850 15:50:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:38.850 15:50:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:38.850 15:50:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:38.850 15:50:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:38.850 15:50:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:38.850 15:50:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:38.850 15:50:28 -- accel/accel.sh@42 -- # jq -r . 00:06:38.850 -x option must be non-negative. 00:06:38.850 [2024-10-30 15:50:28.600361] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:38.850 accel_perf options: 00:06:38.850 [-h help message] 00:06:38.850 [-q queue depth per core] 00:06:38.850 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:38.850 [-T number of threads per core 00:06:38.850 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:38.850 [-t time in seconds] 00:06:38.850 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:38.850 [ dif_verify, , dif_generate, dif_generate_copy 00:06:38.850 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:38.850 [-l for compress/decompress workloads, name of uncompressed input file 00:06:38.850 [-S for crc32c workload, use this seed value (default 0) 00:06:38.850 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:38.850 [-f for fill workload, use this BYTE value (default 255) 00:06:38.850 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:38.850 [-y verify result if this switch is on] 00:06:38.850 [-a tasks to allocate per core (default: same value as -q)] 00:06:38.850 Can be used to spread operations across a wider range of memory. 00:06:38.850 15:50:28 -- common/autotest_common.sh@643 -- # es=1 00:06:38.850 15:50:28 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:38.850 15:50:28 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:38.850 15:50:28 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:38.850 00:06:38.850 real 0m0.021s 00:06:38.850 user 0m0.011s 00:06:38.850 sys 0m0.010s 00:06:38.850 15:50:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:38.850 15:50:28 -- common/autotest_common.sh@10 -- # set +x 00:06:38.850 ************************************ 00:06:38.850 END TEST accel_negative_buffers 00:06:38.850 ************************************ 00:06:38.850 15:50:28 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:38.850 15:50:28 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:38.850 15:50:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:38.850 Error: writing output failed: Broken pipe 00:06:38.850 15:50:28 -- common/autotest_common.sh@10 -- # set +x 00:06:38.850 ************************************ 00:06:38.850 START TEST accel_crc32c 00:06:38.850 ************************************ 00:06:38.850 15:50:28 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:38.850 15:50:28 -- accel/accel.sh@16 -- # local accel_opc 00:06:38.850 15:50:28 -- accel/accel.sh@17 -- # local accel_module 00:06:38.850 15:50:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:38.850 15:50:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:38.850 15:50:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:38.850 15:50:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:38.850 15:50:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:38.850 15:50:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:38.850 15:50:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:38.850 15:50:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:38.850 15:50:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:38.850 15:50:28 -- accel/accel.sh@42 -- # jq -r . 00:06:38.850 [2024-10-30 15:50:28.642331] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:38.850 [2024-10-30 15:50:28.642388] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2304051 ] 00:06:38.850 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.850 [2024-10-30 15:50:28.704825] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.109 [2024-10-30 15:50:28.797116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.482 15:50:30 -- accel/accel.sh@18 -- # out=' 00:06:40.482 SPDK Configuration: 00:06:40.482 Core mask: 0x1 00:06:40.482 00:06:40.482 Accel Perf Configuration: 00:06:40.482 Workload Type: crc32c 00:06:40.482 CRC-32C seed: 32 00:06:40.482 Transfer size: 4096 bytes 00:06:40.482 Vector count 1 00:06:40.482 Module: software 00:06:40.482 Queue depth: 32 00:06:40.482 Allocate depth: 32 00:06:40.482 # threads/core: 1 00:06:40.482 Run time: 1 seconds 00:06:40.482 Verify: Yes 00:06:40.482 00:06:40.482 Running for 1 seconds... 00:06:40.482 00:06:40.482 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:40.482 ------------------------------------------------------------------------------------ 00:06:40.482 0,0 409024/s 1597 MiB/s 0 0 00:06:40.482 ==================================================================================== 00:06:40.482 Total 409024/s 1597 MiB/s 0 0' 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:40.482 15:50:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:40.482 15:50:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:40.482 15:50:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:40.482 15:50:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:40.482 15:50:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:40.482 15:50:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:40.482 15:50:30 -- accel/accel.sh@41 -- # local IFS=, 00:06:40.482 15:50:30 -- accel/accel.sh@42 -- # jq -r . 00:06:40.482 [2024-10-30 15:50:30.044945] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:40.482 [2024-10-30 15:50:30.045030] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2304198 ] 00:06:40.482 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.482 [2024-10-30 15:50:30.108585] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:40.482 [2024-10-30 15:50:30.199741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val= 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val= 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val=0x1 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val= 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val= 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val=crc32c 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val=32 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val= 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val=software 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@23 -- # accel_module=software 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val=32 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val=32 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val=1 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val=Yes 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val= 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:40.482 15:50:30 -- accel/accel.sh@21 -- # val= 00:06:40.482 15:50:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # IFS=: 00:06:40.482 15:50:30 -- accel/accel.sh@20 -- # read -r var val 00:06:41.857 15:50:31 -- accel/accel.sh@21 -- # val= 00:06:41.857 15:50:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.857 15:50:31 -- accel/accel.sh@20 -- # IFS=: 00:06:41.857 15:50:31 -- accel/accel.sh@20 -- # read -r var val 00:06:41.857 15:50:31 -- accel/accel.sh@21 -- # val= 00:06:41.857 15:50:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.857 15:50:31 -- accel/accel.sh@20 -- # IFS=: 00:06:41.857 15:50:31 -- accel/accel.sh@20 -- # read -r var val 00:06:41.857 15:50:31 -- accel/accel.sh@21 -- # val= 00:06:41.857 15:50:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.857 15:50:31 -- accel/accel.sh@20 -- # IFS=: 00:06:41.857 15:50:31 -- accel/accel.sh@20 -- # read -r var val 00:06:41.857 15:50:31 -- accel/accel.sh@21 -- # val= 00:06:41.857 15:50:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.857 15:50:31 -- accel/accel.sh@20 -- # IFS=: 00:06:41.857 15:50:31 -- accel/accel.sh@20 -- # read -r var val 00:06:41.857 15:50:31 -- accel/accel.sh@21 -- # val= 00:06:41.857 15:50:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.857 15:50:31 -- accel/accel.sh@20 -- # IFS=: 00:06:41.857 15:50:31 -- accel/accel.sh@20 -- # read -r var val 00:06:41.857 15:50:31 -- accel/accel.sh@21 -- # val= 00:06:41.857 15:50:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.857 15:50:31 -- accel/accel.sh@20 -- # IFS=: 00:06:41.857 15:50:31 -- accel/accel.sh@20 -- # read -r var val 00:06:41.857 15:50:31 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:41.857 15:50:31 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:41.857 15:50:31 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:41.857 00:06:41.857 real 0m2.809s 00:06:41.857 user 0m2.515s 00:06:41.857 sys 0m0.288s 00:06:41.857 15:50:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:41.857 15:50:31 -- common/autotest_common.sh@10 -- # set +x 00:06:41.857 ************************************ 00:06:41.857 END TEST accel_crc32c 00:06:41.857 ************************************ 00:06:41.857 15:50:31 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:41.857 15:50:31 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:41.857 15:50:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:41.857 15:50:31 -- common/autotest_common.sh@10 -- # set +x 00:06:41.857 ************************************ 00:06:41.857 START TEST accel_crc32c_C2 00:06:41.857 ************************************ 00:06:41.857 15:50:31 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:41.857 15:50:31 -- accel/accel.sh@16 -- # local accel_opc 00:06:41.857 15:50:31 -- accel/accel.sh@17 -- # local accel_module 00:06:41.857 15:50:31 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:41.857 15:50:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:41.857 15:50:31 -- accel/accel.sh@12 -- # build_accel_config 00:06:41.857 15:50:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:41.857 15:50:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:41.857 15:50:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:41.857 15:50:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:41.857 15:50:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:41.857 15:50:31 -- accel/accel.sh@41 -- # local IFS=, 00:06:41.857 15:50:31 -- accel/accel.sh@42 -- # jq -r . 00:06:41.857 [2024-10-30 15:50:31.479553] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:41.857 [2024-10-30 15:50:31.479634] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2304354 ] 00:06:41.857 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.857 [2024-10-30 15:50:31.540728] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:41.857 [2024-10-30 15:50:31.632374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.232 15:50:32 -- accel/accel.sh@18 -- # out=' 00:06:43.232 SPDK Configuration: 00:06:43.232 Core mask: 0x1 00:06:43.232 00:06:43.232 Accel Perf Configuration: 00:06:43.232 Workload Type: crc32c 00:06:43.232 CRC-32C seed: 0 00:06:43.232 Transfer size: 4096 bytes 00:06:43.232 Vector count 2 00:06:43.232 Module: software 00:06:43.232 Queue depth: 32 00:06:43.232 Allocate depth: 32 00:06:43.232 # threads/core: 1 00:06:43.232 Run time: 1 seconds 00:06:43.232 Verify: Yes 00:06:43.232 00:06:43.232 Running for 1 seconds... 00:06:43.232 00:06:43.232 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:43.232 ------------------------------------------------------------------------------------ 00:06:43.232 0,0 316416/s 2472 MiB/s 0 0 00:06:43.232 ==================================================================================== 00:06:43.232 Total 316416/s 1236 MiB/s 0 0' 00:06:43.232 15:50:32 -- accel/accel.sh@20 -- # IFS=: 00:06:43.232 15:50:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:43.232 15:50:32 -- accel/accel.sh@20 -- # read -r var val 00:06:43.232 15:50:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:43.232 15:50:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:43.232 15:50:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:43.232 15:50:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:43.232 15:50:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:43.232 15:50:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:43.232 15:50:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:43.232 15:50:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:43.232 15:50:32 -- accel/accel.sh@42 -- # jq -r . 00:06:43.232 [2024-10-30 15:50:32.884121] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:43.232 [2024-10-30 15:50:32.884209] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2304492 ] 00:06:43.232 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.232 [2024-10-30 15:50:32.946442] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:43.232 [2024-10-30 15:50:33.042247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.232 15:50:33 -- accel/accel.sh@21 -- # val= 00:06:43.232 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.232 15:50:33 -- accel/accel.sh@21 -- # val= 00:06:43.232 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.232 15:50:33 -- accel/accel.sh@21 -- # val=0x1 00:06:43.232 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.232 15:50:33 -- accel/accel.sh@21 -- # val= 00:06:43.232 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.232 15:50:33 -- accel/accel.sh@21 -- # val= 00:06:43.232 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.232 15:50:33 -- accel/accel.sh@21 -- # val=crc32c 00:06:43.232 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.232 15:50:33 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.232 15:50:33 -- accel/accel.sh@21 -- # val=0 00:06:43.232 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.232 15:50:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:43.232 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.232 15:50:33 -- accel/accel.sh@21 -- # val= 00:06:43.232 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.232 15:50:33 -- accel/accel.sh@21 -- # val=software 00:06:43.232 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.232 15:50:33 -- accel/accel.sh@23 -- # accel_module=software 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.232 15:50:33 -- accel/accel.sh@21 -- # val=32 00:06:43.232 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.232 15:50:33 -- accel/accel.sh@21 -- # val=32 00:06:43.232 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.232 15:50:33 -- accel/accel.sh@21 -- # val=1 00:06:43.232 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.232 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.232 15:50:33 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:43.232 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.233 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.233 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.233 15:50:33 -- accel/accel.sh@21 -- # val=Yes 00:06:43.233 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.233 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.233 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.233 15:50:33 -- accel/accel.sh@21 -- # val= 00:06:43.233 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.233 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.491 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:43.491 15:50:33 -- accel/accel.sh@21 -- # val= 00:06:43.491 15:50:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.491 15:50:33 -- accel/accel.sh@20 -- # IFS=: 00:06:43.491 15:50:33 -- accel/accel.sh@20 -- # read -r var val 00:06:44.424 15:50:34 -- accel/accel.sh@21 -- # val= 00:06:44.424 15:50:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.424 15:50:34 -- accel/accel.sh@20 -- # IFS=: 00:06:44.424 15:50:34 -- accel/accel.sh@20 -- # read -r var val 00:06:44.424 15:50:34 -- accel/accel.sh@21 -- # val= 00:06:44.424 15:50:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.424 15:50:34 -- accel/accel.sh@20 -- # IFS=: 00:06:44.424 15:50:34 -- accel/accel.sh@20 -- # read -r var val 00:06:44.424 15:50:34 -- accel/accel.sh@21 -- # val= 00:06:44.424 15:50:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.424 15:50:34 -- accel/accel.sh@20 -- # IFS=: 00:06:44.424 15:50:34 -- accel/accel.sh@20 -- # read -r var val 00:06:44.425 15:50:34 -- accel/accel.sh@21 -- # val= 00:06:44.425 15:50:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.425 15:50:34 -- accel/accel.sh@20 -- # IFS=: 00:06:44.425 15:50:34 -- accel/accel.sh@20 -- # read -r var val 00:06:44.425 15:50:34 -- accel/accel.sh@21 -- # val= 00:06:44.425 15:50:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.425 15:50:34 -- accel/accel.sh@20 -- # IFS=: 00:06:44.425 15:50:34 -- accel/accel.sh@20 -- # read -r var val 00:06:44.425 15:50:34 -- accel/accel.sh@21 -- # val= 00:06:44.425 15:50:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:44.425 15:50:34 -- accel/accel.sh@20 -- # IFS=: 00:06:44.425 15:50:34 -- accel/accel.sh@20 -- # read -r var val 00:06:44.425 15:50:34 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:44.425 15:50:34 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:44.425 15:50:34 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:44.425 00:06:44.425 real 0m2.803s 00:06:44.425 user 0m2.502s 00:06:44.425 sys 0m0.293s 00:06:44.425 15:50:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:44.425 15:50:34 -- common/autotest_common.sh@10 -- # set +x 00:06:44.425 ************************************ 00:06:44.425 END TEST accel_crc32c_C2 00:06:44.425 ************************************ 00:06:44.425 15:50:34 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:44.425 15:50:34 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:44.425 15:50:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:44.425 15:50:34 -- common/autotest_common.sh@10 -- # set +x 00:06:44.425 ************************************ 00:06:44.425 START TEST accel_copy 00:06:44.425 ************************************ 00:06:44.425 15:50:34 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy -y 00:06:44.425 15:50:34 -- accel/accel.sh@16 -- # local accel_opc 00:06:44.425 15:50:34 -- accel/accel.sh@17 -- # local accel_module 00:06:44.425 15:50:34 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:06:44.425 15:50:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:44.425 15:50:34 -- accel/accel.sh@12 -- # build_accel_config 00:06:44.425 15:50:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:44.425 15:50:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:44.425 15:50:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:44.425 15:50:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:44.425 15:50:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:44.425 15:50:34 -- accel/accel.sh@41 -- # local IFS=, 00:06:44.425 15:50:34 -- accel/accel.sh@42 -- # jq -r . 00:06:44.425 [2024-10-30 15:50:34.302050] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:44.425 [2024-10-30 15:50:34.302135] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2304780 ] 00:06:44.683 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.683 [2024-10-30 15:50:34.359868] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:44.683 [2024-10-30 15:50:34.450780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.056 15:50:35 -- accel/accel.sh@18 -- # out=' 00:06:46.056 SPDK Configuration: 00:06:46.056 Core mask: 0x1 00:06:46.056 00:06:46.056 Accel Perf Configuration: 00:06:46.056 Workload Type: copy 00:06:46.056 Transfer size: 4096 bytes 00:06:46.056 Vector count 1 00:06:46.056 Module: software 00:06:46.056 Queue depth: 32 00:06:46.056 Allocate depth: 32 00:06:46.056 # threads/core: 1 00:06:46.056 Run time: 1 seconds 00:06:46.056 Verify: Yes 00:06:46.056 00:06:46.056 Running for 1 seconds... 00:06:46.056 00:06:46.056 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:46.056 ------------------------------------------------------------------------------------ 00:06:46.056 0,0 278240/s 1086 MiB/s 0 0 00:06:46.056 ==================================================================================== 00:06:46.056 Total 278240/s 1086 MiB/s 0 0' 00:06:46.056 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.056 15:50:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:46.056 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.056 15:50:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:46.056 15:50:35 -- accel/accel.sh@12 -- # build_accel_config 00:06:46.056 15:50:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:46.056 15:50:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:46.056 15:50:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:46.056 15:50:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:46.056 15:50:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:46.056 15:50:35 -- accel/accel.sh@41 -- # local IFS=, 00:06:46.056 15:50:35 -- accel/accel.sh@42 -- # jq -r . 00:06:46.056 [2024-10-30 15:50:35.700614] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:46.056 [2024-10-30 15:50:35.700698] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2304920 ] 00:06:46.056 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.056 [2024-10-30 15:50:35.762737] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:46.056 [2024-10-30 15:50:35.852967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.056 15:50:35 -- accel/accel.sh@21 -- # val= 00:06:46.056 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.056 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.056 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.056 15:50:35 -- accel/accel.sh@21 -- # val= 00:06:46.056 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.056 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.056 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.057 15:50:35 -- accel/accel.sh@21 -- # val=0x1 00:06:46.057 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.057 15:50:35 -- accel/accel.sh@21 -- # val= 00:06:46.057 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.057 15:50:35 -- accel/accel.sh@21 -- # val= 00:06:46.057 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.057 15:50:35 -- accel/accel.sh@21 -- # val=copy 00:06:46.057 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.057 15:50:35 -- accel/accel.sh@24 -- # accel_opc=copy 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.057 15:50:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:46.057 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.057 15:50:35 -- accel/accel.sh@21 -- # val= 00:06:46.057 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.057 15:50:35 -- accel/accel.sh@21 -- # val=software 00:06:46.057 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.057 15:50:35 -- accel/accel.sh@23 -- # accel_module=software 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.057 15:50:35 -- accel/accel.sh@21 -- # val=32 00:06:46.057 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.057 15:50:35 -- accel/accel.sh@21 -- # val=32 00:06:46.057 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.057 15:50:35 -- accel/accel.sh@21 -- # val=1 00:06:46.057 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.057 15:50:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:46.057 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.057 15:50:35 -- accel/accel.sh@21 -- # val=Yes 00:06:46.057 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.057 15:50:35 -- accel/accel.sh@21 -- # val= 00:06:46.057 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:46.057 15:50:35 -- accel/accel.sh@21 -- # val= 00:06:46.057 15:50:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # IFS=: 00:06:46.057 15:50:35 -- accel/accel.sh@20 -- # read -r var val 00:06:47.430 15:50:37 -- accel/accel.sh@21 -- # val= 00:06:47.430 15:50:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.430 15:50:37 -- accel/accel.sh@20 -- # IFS=: 00:06:47.430 15:50:37 -- accel/accel.sh@20 -- # read -r var val 00:06:47.430 15:50:37 -- accel/accel.sh@21 -- # val= 00:06:47.430 15:50:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.430 15:50:37 -- accel/accel.sh@20 -- # IFS=: 00:06:47.430 15:50:37 -- accel/accel.sh@20 -- # read -r var val 00:06:47.430 15:50:37 -- accel/accel.sh@21 -- # val= 00:06:47.430 15:50:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.430 15:50:37 -- accel/accel.sh@20 -- # IFS=: 00:06:47.430 15:50:37 -- accel/accel.sh@20 -- # read -r var val 00:06:47.430 15:50:37 -- accel/accel.sh@21 -- # val= 00:06:47.430 15:50:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.430 15:50:37 -- accel/accel.sh@20 -- # IFS=: 00:06:47.430 15:50:37 -- accel/accel.sh@20 -- # read -r var val 00:06:47.430 15:50:37 -- accel/accel.sh@21 -- # val= 00:06:47.430 15:50:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.430 15:50:37 -- accel/accel.sh@20 -- # IFS=: 00:06:47.430 15:50:37 -- accel/accel.sh@20 -- # read -r var val 00:06:47.430 15:50:37 -- accel/accel.sh@21 -- # val= 00:06:47.430 15:50:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:47.430 15:50:37 -- accel/accel.sh@20 -- # IFS=: 00:06:47.430 15:50:37 -- accel/accel.sh@20 -- # read -r var val 00:06:47.430 15:50:37 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:47.430 15:50:37 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:06:47.430 15:50:37 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:47.430 00:06:47.430 real 0m2.799s 00:06:47.430 user 0m2.501s 00:06:47.430 sys 0m0.290s 00:06:47.430 15:50:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:47.430 15:50:37 -- common/autotest_common.sh@10 -- # set +x 00:06:47.430 ************************************ 00:06:47.430 END TEST accel_copy 00:06:47.430 ************************************ 00:06:47.430 15:50:37 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:47.430 15:50:37 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:06:47.430 15:50:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:47.430 15:50:37 -- common/autotest_common.sh@10 -- # set +x 00:06:47.430 ************************************ 00:06:47.430 START TEST accel_fill 00:06:47.430 ************************************ 00:06:47.430 15:50:37 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:47.430 15:50:37 -- accel/accel.sh@16 -- # local accel_opc 00:06:47.430 15:50:37 -- accel/accel.sh@17 -- # local accel_module 00:06:47.430 15:50:37 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:47.430 15:50:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:47.430 15:50:37 -- accel/accel.sh@12 -- # build_accel_config 00:06:47.430 15:50:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:47.430 15:50:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:47.430 15:50:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:47.430 15:50:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:47.430 15:50:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:47.430 15:50:37 -- accel/accel.sh@41 -- # local IFS=, 00:06:47.430 15:50:37 -- accel/accel.sh@42 -- # jq -r . 00:06:47.430 [2024-10-30 15:50:37.128397] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:47.430 [2024-10-30 15:50:37.128472] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2305081 ] 00:06:47.430 EAL: No free 2048 kB hugepages reported on node 1 00:06:47.430 [2024-10-30 15:50:37.191284] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:47.430 [2024-10-30 15:50:37.282466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:48.803 15:50:38 -- accel/accel.sh@18 -- # out=' 00:06:48.803 SPDK Configuration: 00:06:48.803 Core mask: 0x1 00:06:48.803 00:06:48.803 Accel Perf Configuration: 00:06:48.803 Workload Type: fill 00:06:48.803 Fill pattern: 0x80 00:06:48.803 Transfer size: 4096 bytes 00:06:48.803 Vector count 1 00:06:48.803 Module: software 00:06:48.803 Queue depth: 64 00:06:48.803 Allocate depth: 64 00:06:48.803 # threads/core: 1 00:06:48.803 Run time: 1 seconds 00:06:48.803 Verify: Yes 00:06:48.803 00:06:48.803 Running for 1 seconds... 00:06:48.803 00:06:48.803 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:48.803 ------------------------------------------------------------------------------------ 00:06:48.803 0,0 402816/s 1573 MiB/s 0 0 00:06:48.803 ==================================================================================== 00:06:48.803 Total 402816/s 1573 MiB/s 0 0' 00:06:48.803 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:48.803 15:50:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:48.803 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:48.803 15:50:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:48.803 15:50:38 -- accel/accel.sh@12 -- # build_accel_config 00:06:48.803 15:50:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:48.803 15:50:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.803 15:50:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.803 15:50:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:48.803 15:50:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:48.803 15:50:38 -- accel/accel.sh@41 -- # local IFS=, 00:06:48.803 15:50:38 -- accel/accel.sh@42 -- # jq -r . 00:06:48.803 [2024-10-30 15:50:38.535808] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:48.803 [2024-10-30 15:50:38.535888] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2305219 ] 00:06:48.803 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.803 [2024-10-30 15:50:38.600486] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.060 [2024-10-30 15:50:38.690585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val= 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val= 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val=0x1 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val= 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val= 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val=fill 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@24 -- # accel_opc=fill 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val=0x80 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val= 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val=software 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@23 -- # accel_module=software 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val=64 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val=64 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val=1 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val=Yes 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val= 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:49.060 15:50:38 -- accel/accel.sh@21 -- # val= 00:06:49.060 15:50:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # IFS=: 00:06:49.060 15:50:38 -- accel/accel.sh@20 -- # read -r var val 00:06:50.432 15:50:39 -- accel/accel.sh@21 -- # val= 00:06:50.432 15:50:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.432 15:50:39 -- accel/accel.sh@20 -- # IFS=: 00:06:50.432 15:50:39 -- accel/accel.sh@20 -- # read -r var val 00:06:50.432 15:50:39 -- accel/accel.sh@21 -- # val= 00:06:50.432 15:50:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.432 15:50:39 -- accel/accel.sh@20 -- # IFS=: 00:06:50.432 15:50:39 -- accel/accel.sh@20 -- # read -r var val 00:06:50.432 15:50:39 -- accel/accel.sh@21 -- # val= 00:06:50.432 15:50:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.432 15:50:39 -- accel/accel.sh@20 -- # IFS=: 00:06:50.432 15:50:39 -- accel/accel.sh@20 -- # read -r var val 00:06:50.432 15:50:39 -- accel/accel.sh@21 -- # val= 00:06:50.432 15:50:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.432 15:50:39 -- accel/accel.sh@20 -- # IFS=: 00:06:50.432 15:50:39 -- accel/accel.sh@20 -- # read -r var val 00:06:50.432 15:50:39 -- accel/accel.sh@21 -- # val= 00:06:50.432 15:50:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.432 15:50:39 -- accel/accel.sh@20 -- # IFS=: 00:06:50.432 15:50:39 -- accel/accel.sh@20 -- # read -r var val 00:06:50.432 15:50:39 -- accel/accel.sh@21 -- # val= 00:06:50.432 15:50:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.432 15:50:39 -- accel/accel.sh@20 -- # IFS=: 00:06:50.432 15:50:39 -- accel/accel.sh@20 -- # read -r var val 00:06:50.432 15:50:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:50.432 15:50:39 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:06:50.432 15:50:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:50.432 00:06:50.432 real 0m2.802s 00:06:50.432 user 0m2.501s 00:06:50.432 sys 0m0.293s 00:06:50.432 15:50:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:50.432 15:50:39 -- common/autotest_common.sh@10 -- # set +x 00:06:50.432 ************************************ 00:06:50.432 END TEST accel_fill 00:06:50.432 ************************************ 00:06:50.432 15:50:39 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:06:50.432 15:50:39 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:50.432 15:50:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:50.432 15:50:39 -- common/autotest_common.sh@10 -- # set +x 00:06:50.432 ************************************ 00:06:50.432 START TEST accel_copy_crc32c 00:06:50.432 ************************************ 00:06:50.432 15:50:39 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y 00:06:50.432 15:50:39 -- accel/accel.sh@16 -- # local accel_opc 00:06:50.432 15:50:39 -- accel/accel.sh@17 -- # local accel_module 00:06:50.433 15:50:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:50.433 15:50:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:50.433 15:50:39 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.433 15:50:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.433 15:50:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.433 15:50:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.433 15:50:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.433 15:50:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.433 15:50:39 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.433 15:50:39 -- accel/accel.sh@42 -- # jq -r . 00:06:50.433 [2024-10-30 15:50:39.956842] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:50.433 [2024-10-30 15:50:39.956926] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2305497 ] 00:06:50.433 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.433 [2024-10-30 15:50:40.015004] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.433 [2024-10-30 15:50:40.111456] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.803 15:50:41 -- accel/accel.sh@18 -- # out=' 00:06:51.803 SPDK Configuration: 00:06:51.803 Core mask: 0x1 00:06:51.803 00:06:51.804 Accel Perf Configuration: 00:06:51.804 Workload Type: copy_crc32c 00:06:51.804 CRC-32C seed: 0 00:06:51.804 Vector size: 4096 bytes 00:06:51.804 Transfer size: 4096 bytes 00:06:51.804 Vector count 1 00:06:51.804 Module: software 00:06:51.804 Queue depth: 32 00:06:51.804 Allocate depth: 32 00:06:51.804 # threads/core: 1 00:06:51.804 Run time: 1 seconds 00:06:51.804 Verify: Yes 00:06:51.804 00:06:51.804 Running for 1 seconds... 00:06:51.804 00:06:51.804 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:51.804 ------------------------------------------------------------------------------------ 00:06:51.804 0,0 221888/s 866 MiB/s 0 0 00:06:51.804 ==================================================================================== 00:06:51.804 Total 221888/s 866 MiB/s 0 0' 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:51.804 15:50:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:51.804 15:50:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:51.804 15:50:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:51.804 15:50:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:51.804 15:50:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:51.804 15:50:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:51.804 15:50:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:51.804 15:50:41 -- accel/accel.sh@42 -- # jq -r . 00:06:51.804 [2024-10-30 15:50:41.359196] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:51.804 [2024-10-30 15:50:41.359286] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2305647 ] 00:06:51.804 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.804 [2024-10-30 15:50:41.419866] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:51.804 [2024-10-30 15:50:41.510128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val= 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val= 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val=0x1 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val= 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val= 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val=0 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val= 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val=software 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@23 -- # accel_module=software 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val=32 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val=32 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val=1 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val=Yes 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val= 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:51.804 15:50:41 -- accel/accel.sh@21 -- # val= 00:06:51.804 15:50:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # IFS=: 00:06:51.804 15:50:41 -- accel/accel.sh@20 -- # read -r var val 00:06:53.175 15:50:42 -- accel/accel.sh@21 -- # val= 00:06:53.175 15:50:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.175 15:50:42 -- accel/accel.sh@20 -- # IFS=: 00:06:53.175 15:50:42 -- accel/accel.sh@20 -- # read -r var val 00:06:53.175 15:50:42 -- accel/accel.sh@21 -- # val= 00:06:53.175 15:50:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.175 15:50:42 -- accel/accel.sh@20 -- # IFS=: 00:06:53.175 15:50:42 -- accel/accel.sh@20 -- # read -r var val 00:06:53.175 15:50:42 -- accel/accel.sh@21 -- # val= 00:06:53.175 15:50:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.175 15:50:42 -- accel/accel.sh@20 -- # IFS=: 00:06:53.175 15:50:42 -- accel/accel.sh@20 -- # read -r var val 00:06:53.175 15:50:42 -- accel/accel.sh@21 -- # val= 00:06:53.175 15:50:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.175 15:50:42 -- accel/accel.sh@20 -- # IFS=: 00:06:53.175 15:50:42 -- accel/accel.sh@20 -- # read -r var val 00:06:53.175 15:50:42 -- accel/accel.sh@21 -- # val= 00:06:53.175 15:50:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.175 15:50:42 -- accel/accel.sh@20 -- # IFS=: 00:06:53.175 15:50:42 -- accel/accel.sh@20 -- # read -r var val 00:06:53.175 15:50:42 -- accel/accel.sh@21 -- # val= 00:06:53.175 15:50:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.175 15:50:42 -- accel/accel.sh@20 -- # IFS=: 00:06:53.175 15:50:42 -- accel/accel.sh@20 -- # read -r var val 00:06:53.175 15:50:42 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:53.175 15:50:42 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:53.175 15:50:42 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:53.175 00:06:53.175 real 0m2.803s 00:06:53.175 user 0m2.504s 00:06:53.175 sys 0m0.292s 00:06:53.175 15:50:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:53.175 15:50:42 -- common/autotest_common.sh@10 -- # set +x 00:06:53.175 ************************************ 00:06:53.175 END TEST accel_copy_crc32c 00:06:53.175 ************************************ 00:06:53.175 15:50:42 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:06:53.175 15:50:42 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:53.175 15:50:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:53.175 15:50:42 -- common/autotest_common.sh@10 -- # set +x 00:06:53.175 ************************************ 00:06:53.175 START TEST accel_copy_crc32c_C2 00:06:53.175 ************************************ 00:06:53.175 15:50:42 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:06:53.175 15:50:42 -- accel/accel.sh@16 -- # local accel_opc 00:06:53.175 15:50:42 -- accel/accel.sh@17 -- # local accel_module 00:06:53.175 15:50:42 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:53.175 15:50:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:53.175 15:50:42 -- accel/accel.sh@12 -- # build_accel_config 00:06:53.175 15:50:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:53.175 15:50:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.175 15:50:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.175 15:50:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:53.175 15:50:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:53.175 15:50:42 -- accel/accel.sh@41 -- # local IFS=, 00:06:53.175 15:50:42 -- accel/accel.sh@42 -- # jq -r . 00:06:53.175 [2024-10-30 15:50:42.787017] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:53.175 [2024-10-30 15:50:42.787101] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2305802 ] 00:06:53.175 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.175 [2024-10-30 15:50:42.847965] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.175 [2024-10-30 15:50:42.938816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.551 15:50:44 -- accel/accel.sh@18 -- # out=' 00:06:54.551 SPDK Configuration: 00:06:54.551 Core mask: 0x1 00:06:54.551 00:06:54.551 Accel Perf Configuration: 00:06:54.551 Workload Type: copy_crc32c 00:06:54.551 CRC-32C seed: 0 00:06:54.551 Vector size: 4096 bytes 00:06:54.551 Transfer size: 8192 bytes 00:06:54.551 Vector count 2 00:06:54.551 Module: software 00:06:54.551 Queue depth: 32 00:06:54.551 Allocate depth: 32 00:06:54.551 # threads/core: 1 00:06:54.551 Run time: 1 seconds 00:06:54.551 Verify: Yes 00:06:54.551 00:06:54.551 Running for 1 seconds... 00:06:54.551 00:06:54.551 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:54.551 ------------------------------------------------------------------------------------ 00:06:54.551 0,0 158944/s 1241 MiB/s 0 0 00:06:54.551 ==================================================================================== 00:06:54.551 Total 158944/s 620 MiB/s 0 0' 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:54.551 15:50:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:54.551 15:50:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:54.551 15:50:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:54.551 15:50:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:54.551 15:50:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:54.551 15:50:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:54.551 15:50:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:54.551 15:50:44 -- accel/accel.sh@42 -- # jq -r . 00:06:54.551 [2024-10-30 15:50:44.190566] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:54.551 [2024-10-30 15:50:44.190647] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2305946 ] 00:06:54.551 EAL: No free 2048 kB hugepages reported on node 1 00:06:54.551 [2024-10-30 15:50:44.250915] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:54.551 [2024-10-30 15:50:44.342267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val= 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val= 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val=0x1 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val= 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val= 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val=0 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val='8192 bytes' 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val= 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val=software 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@23 -- # accel_module=software 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val=32 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val=32 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val=1 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val=Yes 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val= 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:54.551 15:50:44 -- accel/accel.sh@21 -- # val= 00:06:54.551 15:50:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # IFS=: 00:06:54.551 15:50:44 -- accel/accel.sh@20 -- # read -r var val 00:06:55.927 15:50:45 -- accel/accel.sh@21 -- # val= 00:06:55.927 15:50:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.927 15:50:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.927 15:50:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.927 15:50:45 -- accel/accel.sh@21 -- # val= 00:06:55.927 15:50:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.927 15:50:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.927 15:50:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.927 15:50:45 -- accel/accel.sh@21 -- # val= 00:06:55.927 15:50:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.927 15:50:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.927 15:50:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.927 15:50:45 -- accel/accel.sh@21 -- # val= 00:06:55.927 15:50:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.927 15:50:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.927 15:50:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.927 15:50:45 -- accel/accel.sh@21 -- # val= 00:06:55.927 15:50:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.927 15:50:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.927 15:50:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.927 15:50:45 -- accel/accel.sh@21 -- # val= 00:06:55.927 15:50:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.927 15:50:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.927 15:50:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.927 15:50:45 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:55.927 15:50:45 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:55.927 15:50:45 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:55.927 00:06:55.927 real 0m2.794s 00:06:55.927 user 0m2.496s 00:06:55.927 sys 0m0.290s 00:06:55.927 15:50:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:55.927 15:50:45 -- common/autotest_common.sh@10 -- # set +x 00:06:55.927 ************************************ 00:06:55.927 END TEST accel_copy_crc32c_C2 00:06:55.927 ************************************ 00:06:55.927 15:50:45 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:06:55.927 15:50:45 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:55.927 15:50:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:55.927 15:50:45 -- common/autotest_common.sh@10 -- # set +x 00:06:55.927 ************************************ 00:06:55.927 START TEST accel_dualcast 00:06:55.927 ************************************ 00:06:55.927 15:50:45 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dualcast -y 00:06:55.927 15:50:45 -- accel/accel.sh@16 -- # local accel_opc 00:06:55.927 15:50:45 -- accel/accel.sh@17 -- # local accel_module 00:06:55.927 15:50:45 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:06:55.927 15:50:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:55.927 15:50:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.927 15:50:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.927 15:50:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.927 15:50:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.927 15:50:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.927 15:50:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.927 15:50:45 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.927 15:50:45 -- accel/accel.sh@42 -- # jq -r . 00:06:55.928 [2024-10-30 15:50:45.607738] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:55.928 [2024-10-30 15:50:45.607820] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2306218 ] 00:06:55.928 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.928 [2024-10-30 15:50:45.670099] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.928 [2024-10-30 15:50:45.763307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.303 15:50:46 -- accel/accel.sh@18 -- # out=' 00:06:57.303 SPDK Configuration: 00:06:57.303 Core mask: 0x1 00:06:57.303 00:06:57.303 Accel Perf Configuration: 00:06:57.303 Workload Type: dualcast 00:06:57.303 Transfer size: 4096 bytes 00:06:57.303 Vector count 1 00:06:57.303 Module: software 00:06:57.303 Queue depth: 32 00:06:57.303 Allocate depth: 32 00:06:57.303 # threads/core: 1 00:06:57.303 Run time: 1 seconds 00:06:57.303 Verify: Yes 00:06:57.303 00:06:57.303 Running for 1 seconds... 00:06:57.303 00:06:57.303 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:57.303 ------------------------------------------------------------------------------------ 00:06:57.303 0,0 299360/s 1169 MiB/s 0 0 00:06:57.303 ==================================================================================== 00:06:57.303 Total 299360/s 1169 MiB/s 0 0' 00:06:57.303 15:50:46 -- accel/accel.sh@20 -- # IFS=: 00:06:57.303 15:50:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:06:57.303 15:50:46 -- accel/accel.sh@20 -- # read -r var val 00:06:57.303 15:50:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:57.303 15:50:46 -- accel/accel.sh@12 -- # build_accel_config 00:06:57.303 15:50:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:57.303 15:50:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:57.303 15:50:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:57.303 15:50:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:57.303 15:50:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:57.303 15:50:46 -- accel/accel.sh@41 -- # local IFS=, 00:06:57.303 15:50:46 -- accel/accel.sh@42 -- # jq -r . 00:06:57.303 [2024-10-30 15:50:46.996126] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:57.303 [2024-10-30 15:50:46.996205] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2306368 ] 00:06:57.303 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.303 [2024-10-30 15:50:47.057345] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.303 [2024-10-30 15:50:47.147855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val= 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val= 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val=0x1 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val= 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val= 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val=dualcast 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val= 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val=software 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@23 -- # accel_module=software 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val=32 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val=32 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val=1 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val=Yes 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val= 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:57.581 15:50:47 -- accel/accel.sh@21 -- # val= 00:06:57.581 15:50:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # IFS=: 00:06:57.581 15:50:47 -- accel/accel.sh@20 -- # read -r var val 00:06:58.518 15:50:48 -- accel/accel.sh@21 -- # val= 00:06:58.518 15:50:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.518 15:50:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.518 15:50:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.518 15:50:48 -- accel/accel.sh@21 -- # val= 00:06:58.518 15:50:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.518 15:50:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.518 15:50:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.518 15:50:48 -- accel/accel.sh@21 -- # val= 00:06:58.518 15:50:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.518 15:50:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.518 15:50:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.518 15:50:48 -- accel/accel.sh@21 -- # val= 00:06:58.518 15:50:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.518 15:50:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.518 15:50:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.518 15:50:48 -- accel/accel.sh@21 -- # val= 00:06:58.518 15:50:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.518 15:50:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.518 15:50:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.518 15:50:48 -- accel/accel.sh@21 -- # val= 00:06:58.518 15:50:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.518 15:50:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.518 15:50:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.518 15:50:48 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:58.518 15:50:48 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:06:58.518 15:50:48 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:58.518 00:06:58.518 real 0m2.793s 00:06:58.518 user 0m2.493s 00:06:58.518 sys 0m0.292s 00:06:58.518 15:50:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:58.518 15:50:48 -- common/autotest_common.sh@10 -- # set +x 00:06:58.519 ************************************ 00:06:58.519 END TEST accel_dualcast 00:06:58.519 ************************************ 00:06:58.777 15:50:48 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:06:58.777 15:50:48 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:06:58.777 15:50:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:58.777 15:50:48 -- common/autotest_common.sh@10 -- # set +x 00:06:58.777 ************************************ 00:06:58.777 START TEST accel_compare 00:06:58.777 ************************************ 00:06:58.777 15:50:48 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compare -y 00:06:58.777 15:50:48 -- accel/accel.sh@16 -- # local accel_opc 00:06:58.777 15:50:48 -- accel/accel.sh@17 -- # local accel_module 00:06:58.777 15:50:48 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:06:58.777 15:50:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:58.777 15:50:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:58.777 15:50:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:58.777 15:50:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:58.777 15:50:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:58.777 15:50:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:58.777 15:50:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:58.777 15:50:48 -- accel/accel.sh@41 -- # local IFS=, 00:06:58.777 15:50:48 -- accel/accel.sh@42 -- # jq -r . 00:06:58.777 [2024-10-30 15:50:48.425151] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:06:58.777 [2024-10-30 15:50:48.425230] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2306530 ] 00:06:58.777 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.777 [2024-10-30 15:50:48.486312] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:58.777 [2024-10-30 15:50:48.577681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.151 15:50:49 -- accel/accel.sh@18 -- # out=' 00:07:00.151 SPDK Configuration: 00:07:00.151 Core mask: 0x1 00:07:00.151 00:07:00.151 Accel Perf Configuration: 00:07:00.151 Workload Type: compare 00:07:00.151 Transfer size: 4096 bytes 00:07:00.151 Vector count 1 00:07:00.151 Module: software 00:07:00.151 Queue depth: 32 00:07:00.151 Allocate depth: 32 00:07:00.151 # threads/core: 1 00:07:00.151 Run time: 1 seconds 00:07:00.151 Verify: Yes 00:07:00.151 00:07:00.151 Running for 1 seconds... 00:07:00.151 00:07:00.151 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:00.151 ------------------------------------------------------------------------------------ 00:07:00.151 0,0 407456/s 1591 MiB/s 0 0 00:07:00.151 ==================================================================================== 00:07:00.151 Total 407456/s 1591 MiB/s 0 0' 00:07:00.151 15:50:49 -- accel/accel.sh@20 -- # IFS=: 00:07:00.151 15:50:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:00.151 15:50:49 -- accel/accel.sh@20 -- # read -r var val 00:07:00.151 15:50:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:00.151 15:50:49 -- accel/accel.sh@12 -- # build_accel_config 00:07:00.151 15:50:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:00.151 15:50:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:00.151 15:50:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:00.151 15:50:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:00.151 15:50:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:00.151 15:50:49 -- accel/accel.sh@41 -- # local IFS=, 00:07:00.151 15:50:49 -- accel/accel.sh@42 -- # jq -r . 00:07:00.151 [2024-10-30 15:50:49.833804] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:00.151 [2024-10-30 15:50:49.833887] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2306671 ] 00:07:00.151 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.151 [2024-10-30 15:50:49.895399] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.151 [2024-10-30 15:50:49.985552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.408 15:50:50 -- accel/accel.sh@21 -- # val= 00:07:00.408 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.408 15:50:50 -- accel/accel.sh@21 -- # val= 00:07:00.408 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.408 15:50:50 -- accel/accel.sh@21 -- # val=0x1 00:07:00.408 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.408 15:50:50 -- accel/accel.sh@21 -- # val= 00:07:00.408 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.408 15:50:50 -- accel/accel.sh@21 -- # val= 00:07:00.408 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.408 15:50:50 -- accel/accel.sh@21 -- # val=compare 00:07:00.408 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.408 15:50:50 -- accel/accel.sh@24 -- # accel_opc=compare 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.408 15:50:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:00.408 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.408 15:50:50 -- accel/accel.sh@21 -- # val= 00:07:00.408 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.408 15:50:50 -- accel/accel.sh@21 -- # val=software 00:07:00.408 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.408 15:50:50 -- accel/accel.sh@23 -- # accel_module=software 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.408 15:50:50 -- accel/accel.sh@21 -- # val=32 00:07:00.408 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.408 15:50:50 -- accel/accel.sh@21 -- # val=32 00:07:00.408 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.408 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.409 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.409 15:50:50 -- accel/accel.sh@21 -- # val=1 00:07:00.409 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.409 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.409 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.409 15:50:50 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:00.409 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.409 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.409 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.409 15:50:50 -- accel/accel.sh@21 -- # val=Yes 00:07:00.409 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.409 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.409 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.409 15:50:50 -- accel/accel.sh@21 -- # val= 00:07:00.409 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.409 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.409 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:00.409 15:50:50 -- accel/accel.sh@21 -- # val= 00:07:00.409 15:50:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.409 15:50:50 -- accel/accel.sh@20 -- # IFS=: 00:07:00.409 15:50:50 -- accel/accel.sh@20 -- # read -r var val 00:07:01.342 15:50:51 -- accel/accel.sh@21 -- # val= 00:07:01.342 15:50:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.342 15:50:51 -- accel/accel.sh@20 -- # IFS=: 00:07:01.342 15:50:51 -- accel/accel.sh@20 -- # read -r var val 00:07:01.342 15:50:51 -- accel/accel.sh@21 -- # val= 00:07:01.342 15:50:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.342 15:50:51 -- accel/accel.sh@20 -- # IFS=: 00:07:01.342 15:50:51 -- accel/accel.sh@20 -- # read -r var val 00:07:01.342 15:50:51 -- accel/accel.sh@21 -- # val= 00:07:01.342 15:50:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.342 15:50:51 -- accel/accel.sh@20 -- # IFS=: 00:07:01.342 15:50:51 -- accel/accel.sh@20 -- # read -r var val 00:07:01.342 15:50:51 -- accel/accel.sh@21 -- # val= 00:07:01.342 15:50:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.342 15:50:51 -- accel/accel.sh@20 -- # IFS=: 00:07:01.342 15:50:51 -- accel/accel.sh@20 -- # read -r var val 00:07:01.342 15:50:51 -- accel/accel.sh@21 -- # val= 00:07:01.342 15:50:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.342 15:50:51 -- accel/accel.sh@20 -- # IFS=: 00:07:01.342 15:50:51 -- accel/accel.sh@20 -- # read -r var val 00:07:01.342 15:50:51 -- accel/accel.sh@21 -- # val= 00:07:01.342 15:50:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.342 15:50:51 -- accel/accel.sh@20 -- # IFS=: 00:07:01.342 15:50:51 -- accel/accel.sh@20 -- # read -r var val 00:07:01.342 15:50:51 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:01.342 15:50:51 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:07:01.342 15:50:51 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:01.342 00:07:01.342 real 0m2.808s 00:07:01.342 user 0m2.517s 00:07:01.342 sys 0m0.283s 00:07:01.342 15:50:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:01.342 15:50:51 -- common/autotest_common.sh@10 -- # set +x 00:07:01.342 ************************************ 00:07:01.342 END TEST accel_compare 00:07:01.342 ************************************ 00:07:01.630 15:50:51 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:01.630 15:50:51 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:07:01.630 15:50:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:01.630 15:50:51 -- common/autotest_common.sh@10 -- # set +x 00:07:01.630 ************************************ 00:07:01.630 START TEST accel_xor 00:07:01.630 ************************************ 00:07:01.630 15:50:51 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y 00:07:01.630 15:50:51 -- accel/accel.sh@16 -- # local accel_opc 00:07:01.630 15:50:51 -- accel/accel.sh@17 -- # local accel_module 00:07:01.630 15:50:51 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:07:01.630 15:50:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:01.630 15:50:51 -- accel/accel.sh@12 -- # build_accel_config 00:07:01.630 15:50:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:01.630 15:50:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:01.630 15:50:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:01.630 15:50:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:01.630 15:50:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:01.630 15:50:51 -- accel/accel.sh@41 -- # local IFS=, 00:07:01.630 15:50:51 -- accel/accel.sh@42 -- # jq -r . 00:07:01.630 [2024-10-30 15:50:51.260065] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:01.630 [2024-10-30 15:50:51.260159] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2306911 ] 00:07:01.630 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.630 [2024-10-30 15:50:51.323287] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.630 [2024-10-30 15:50:51.413961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.006 15:50:52 -- accel/accel.sh@18 -- # out=' 00:07:03.006 SPDK Configuration: 00:07:03.006 Core mask: 0x1 00:07:03.006 00:07:03.006 Accel Perf Configuration: 00:07:03.006 Workload Type: xor 00:07:03.006 Source buffers: 2 00:07:03.006 Transfer size: 4096 bytes 00:07:03.006 Vector count 1 00:07:03.006 Module: software 00:07:03.006 Queue depth: 32 00:07:03.006 Allocate depth: 32 00:07:03.006 # threads/core: 1 00:07:03.006 Run time: 1 seconds 00:07:03.006 Verify: Yes 00:07:03.006 00:07:03.006 Running for 1 seconds... 00:07:03.006 00:07:03.006 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:03.006 ------------------------------------------------------------------------------------ 00:07:03.006 0,0 193888/s 757 MiB/s 0 0 00:07:03.006 ==================================================================================== 00:07:03.006 Total 193888/s 757 MiB/s 0 0' 00:07:03.006 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.006 15:50:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:03.006 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.006 15:50:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:03.006 15:50:52 -- accel/accel.sh@12 -- # build_accel_config 00:07:03.006 15:50:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:03.006 15:50:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.006 15:50:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.006 15:50:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:03.006 15:50:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:03.006 15:50:52 -- accel/accel.sh@41 -- # local IFS=, 00:07:03.006 15:50:52 -- accel/accel.sh@42 -- # jq -r . 00:07:03.006 [2024-10-30 15:50:52.652745] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:03.006 [2024-10-30 15:50:52.652835] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2307098 ] 00:07:03.006 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.006 [2024-10-30 15:50:52.715925] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.006 [2024-10-30 15:50:52.807005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val= 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val= 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val=0x1 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val= 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val= 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val=xor 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val=2 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val= 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val=software 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@23 -- # accel_module=software 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val=32 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val=32 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val=1 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val=Yes 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val= 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:03.007 15:50:52 -- accel/accel.sh@21 -- # val= 00:07:03.007 15:50:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # IFS=: 00:07:03.007 15:50:52 -- accel/accel.sh@20 -- # read -r var val 00:07:04.382 15:50:54 -- accel/accel.sh@21 -- # val= 00:07:04.382 15:50:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.382 15:50:54 -- accel/accel.sh@20 -- # IFS=: 00:07:04.382 15:50:54 -- accel/accel.sh@20 -- # read -r var val 00:07:04.382 15:50:54 -- accel/accel.sh@21 -- # val= 00:07:04.382 15:50:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.382 15:50:54 -- accel/accel.sh@20 -- # IFS=: 00:07:04.382 15:50:54 -- accel/accel.sh@20 -- # read -r var val 00:07:04.382 15:50:54 -- accel/accel.sh@21 -- # val= 00:07:04.382 15:50:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.382 15:50:54 -- accel/accel.sh@20 -- # IFS=: 00:07:04.382 15:50:54 -- accel/accel.sh@20 -- # read -r var val 00:07:04.382 15:50:54 -- accel/accel.sh@21 -- # val= 00:07:04.382 15:50:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.382 15:50:54 -- accel/accel.sh@20 -- # IFS=: 00:07:04.382 15:50:54 -- accel/accel.sh@20 -- # read -r var val 00:07:04.382 15:50:54 -- accel/accel.sh@21 -- # val= 00:07:04.382 15:50:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.382 15:50:54 -- accel/accel.sh@20 -- # IFS=: 00:07:04.382 15:50:54 -- accel/accel.sh@20 -- # read -r var val 00:07:04.382 15:50:54 -- accel/accel.sh@21 -- # val= 00:07:04.382 15:50:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.382 15:50:54 -- accel/accel.sh@20 -- # IFS=: 00:07:04.382 15:50:54 -- accel/accel.sh@20 -- # read -r var val 00:07:04.382 15:50:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:04.382 15:50:54 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:04.382 15:50:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:04.382 00:07:04.382 real 0m2.802s 00:07:04.382 user 0m2.500s 00:07:04.382 sys 0m0.293s 00:07:04.382 15:50:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:04.382 15:50:54 -- common/autotest_common.sh@10 -- # set +x 00:07:04.382 ************************************ 00:07:04.382 END TEST accel_xor 00:07:04.382 ************************************ 00:07:04.382 15:50:54 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:04.382 15:50:54 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:07:04.382 15:50:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:04.382 15:50:54 -- common/autotest_common.sh@10 -- # set +x 00:07:04.382 ************************************ 00:07:04.382 START TEST accel_xor 00:07:04.382 ************************************ 00:07:04.382 15:50:54 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y -x 3 00:07:04.382 15:50:54 -- accel/accel.sh@16 -- # local accel_opc 00:07:04.382 15:50:54 -- accel/accel.sh@17 -- # local accel_module 00:07:04.382 15:50:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:07:04.382 15:50:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:04.382 15:50:54 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.382 15:50:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:04.382 15:50:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.382 15:50:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.382 15:50:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:04.382 15:50:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:04.382 15:50:54 -- accel/accel.sh@41 -- # local IFS=, 00:07:04.382 15:50:54 -- accel/accel.sh@42 -- # jq -r . 00:07:04.382 [2024-10-30 15:50:54.085634] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:04.382 [2024-10-30 15:50:54.085705] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2307252 ] 00:07:04.382 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.382 [2024-10-30 15:50:54.145774] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.382 [2024-10-30 15:50:54.236346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.757 15:50:55 -- accel/accel.sh@18 -- # out=' 00:07:05.757 SPDK Configuration: 00:07:05.757 Core mask: 0x1 00:07:05.757 00:07:05.757 Accel Perf Configuration: 00:07:05.757 Workload Type: xor 00:07:05.757 Source buffers: 3 00:07:05.757 Transfer size: 4096 bytes 00:07:05.757 Vector count 1 00:07:05.757 Module: software 00:07:05.757 Queue depth: 32 00:07:05.757 Allocate depth: 32 00:07:05.757 # threads/core: 1 00:07:05.757 Run time: 1 seconds 00:07:05.757 Verify: Yes 00:07:05.757 00:07:05.757 Running for 1 seconds... 00:07:05.757 00:07:05.757 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:05.757 ------------------------------------------------------------------------------------ 00:07:05.757 0,0 183488/s 716 MiB/s 0 0 00:07:05.757 ==================================================================================== 00:07:05.757 Total 183488/s 716 MiB/s 0 0' 00:07:05.757 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:05.757 15:50:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:05.757 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:05.757 15:50:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:05.757 15:50:55 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.757 15:50:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:05.757 15:50:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.757 15:50:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.757 15:50:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:05.757 15:50:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:05.757 15:50:55 -- accel/accel.sh@41 -- # local IFS=, 00:07:05.757 15:50:55 -- accel/accel.sh@42 -- # jq -r . 00:07:05.757 [2024-10-30 15:50:55.484659] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:05.757 [2024-10-30 15:50:55.484742] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2307398 ] 00:07:05.757 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.757 [2024-10-30 15:50:55.549890] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.015 [2024-10-30 15:50:55.641338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.015 15:50:55 -- accel/accel.sh@21 -- # val= 00:07:06.015 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.015 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.015 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.015 15:50:55 -- accel/accel.sh@21 -- # val= 00:07:06.015 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.015 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.015 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.015 15:50:55 -- accel/accel.sh@21 -- # val=0x1 00:07:06.015 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.015 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.015 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.015 15:50:55 -- accel/accel.sh@21 -- # val= 00:07:06.015 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.016 15:50:55 -- accel/accel.sh@21 -- # val= 00:07:06.016 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.016 15:50:55 -- accel/accel.sh@21 -- # val=xor 00:07:06.016 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.016 15:50:55 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.016 15:50:55 -- accel/accel.sh@21 -- # val=3 00:07:06.016 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.016 15:50:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:06.016 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.016 15:50:55 -- accel/accel.sh@21 -- # val= 00:07:06.016 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.016 15:50:55 -- accel/accel.sh@21 -- # val=software 00:07:06.016 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.016 15:50:55 -- accel/accel.sh@23 -- # accel_module=software 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.016 15:50:55 -- accel/accel.sh@21 -- # val=32 00:07:06.016 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.016 15:50:55 -- accel/accel.sh@21 -- # val=32 00:07:06.016 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.016 15:50:55 -- accel/accel.sh@21 -- # val=1 00:07:06.016 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.016 15:50:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:06.016 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.016 15:50:55 -- accel/accel.sh@21 -- # val=Yes 00:07:06.016 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.016 15:50:55 -- accel/accel.sh@21 -- # val= 00:07:06.016 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:06.016 15:50:55 -- accel/accel.sh@21 -- # val= 00:07:06.016 15:50:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # IFS=: 00:07:06.016 15:50:55 -- accel/accel.sh@20 -- # read -r var val 00:07:07.389 15:50:56 -- accel/accel.sh@21 -- # val= 00:07:07.389 15:50:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.389 15:50:56 -- accel/accel.sh@20 -- # IFS=: 00:07:07.389 15:50:56 -- accel/accel.sh@20 -- # read -r var val 00:07:07.389 15:50:56 -- accel/accel.sh@21 -- # val= 00:07:07.389 15:50:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.389 15:50:56 -- accel/accel.sh@20 -- # IFS=: 00:07:07.389 15:50:56 -- accel/accel.sh@20 -- # read -r var val 00:07:07.389 15:50:56 -- accel/accel.sh@21 -- # val= 00:07:07.389 15:50:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.389 15:50:56 -- accel/accel.sh@20 -- # IFS=: 00:07:07.389 15:50:56 -- accel/accel.sh@20 -- # read -r var val 00:07:07.389 15:50:56 -- accel/accel.sh@21 -- # val= 00:07:07.389 15:50:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.389 15:50:56 -- accel/accel.sh@20 -- # IFS=: 00:07:07.389 15:50:56 -- accel/accel.sh@20 -- # read -r var val 00:07:07.389 15:50:56 -- accel/accel.sh@21 -- # val= 00:07:07.389 15:50:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.389 15:50:56 -- accel/accel.sh@20 -- # IFS=: 00:07:07.389 15:50:56 -- accel/accel.sh@20 -- # read -r var val 00:07:07.389 15:50:56 -- accel/accel.sh@21 -- # val= 00:07:07.389 15:50:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.389 15:50:56 -- accel/accel.sh@20 -- # IFS=: 00:07:07.389 15:50:56 -- accel/accel.sh@20 -- # read -r var val 00:07:07.389 15:50:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:07.389 15:50:56 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:07.389 15:50:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:07.389 00:07:07.389 real 0m2.804s 00:07:07.389 user 0m2.502s 00:07:07.389 sys 0m0.295s 00:07:07.389 15:50:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:07.389 15:50:56 -- common/autotest_common.sh@10 -- # set +x 00:07:07.389 ************************************ 00:07:07.389 END TEST accel_xor 00:07:07.389 ************************************ 00:07:07.389 15:50:56 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:07.389 15:50:56 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:07:07.389 15:50:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:07.389 15:50:56 -- common/autotest_common.sh@10 -- # set +x 00:07:07.389 ************************************ 00:07:07.389 START TEST accel_dif_verify 00:07:07.389 ************************************ 00:07:07.389 15:50:56 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_verify 00:07:07.389 15:50:56 -- accel/accel.sh@16 -- # local accel_opc 00:07:07.389 15:50:56 -- accel/accel.sh@17 -- # local accel_module 00:07:07.389 15:50:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:07.389 15:50:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:07.389 15:50:56 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.389 15:50:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.389 15:50:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.389 15:50:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.389 15:50:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.389 15:50:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.389 15:50:56 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.389 15:50:56 -- accel/accel.sh@42 -- # jq -r . 00:07:07.389 [2024-10-30 15:50:56.912394] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:07.389 [2024-10-30 15:50:56.912469] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2307588 ] 00:07:07.389 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.389 [2024-10-30 15:50:56.972363] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.389 [2024-10-30 15:50:57.063120] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.762 15:50:58 -- accel/accel.sh@18 -- # out=' 00:07:08.762 SPDK Configuration: 00:07:08.762 Core mask: 0x1 00:07:08.762 00:07:08.762 Accel Perf Configuration: 00:07:08.762 Workload Type: dif_verify 00:07:08.762 Vector size: 4096 bytes 00:07:08.762 Transfer size: 4096 bytes 00:07:08.762 Block size: 512 bytes 00:07:08.762 Metadata size: 8 bytes 00:07:08.762 Vector count 1 00:07:08.762 Module: software 00:07:08.762 Queue depth: 32 00:07:08.762 Allocate depth: 32 00:07:08.762 # threads/core: 1 00:07:08.762 Run time: 1 seconds 00:07:08.762 Verify: No 00:07:08.762 00:07:08.762 Running for 1 seconds... 00:07:08.762 00:07:08.762 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:08.762 ------------------------------------------------------------------------------------ 00:07:08.762 0,0 83296/s 330 MiB/s 0 0 00:07:08.762 ==================================================================================== 00:07:08.762 Total 83296/s 325 MiB/s 0 0' 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.762 15:50:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:08.762 15:50:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:08.762 15:50:58 -- accel/accel.sh@12 -- # build_accel_config 00:07:08.762 15:50:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:08.762 15:50:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:08.762 15:50:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:08.762 15:50:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:08.762 15:50:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:08.762 15:50:58 -- accel/accel.sh@41 -- # local IFS=, 00:07:08.762 15:50:58 -- accel/accel.sh@42 -- # jq -r . 00:07:08.762 [2024-10-30 15:50:58.304340] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:08.762 [2024-10-30 15:50:58.304418] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2307813 ] 00:07:08.762 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.762 [2024-10-30 15:50:58.366441] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:08.762 [2024-10-30 15:50:58.454536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:08.762 15:50:58 -- accel/accel.sh@21 -- # val= 00:07:08.762 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.762 15:50:58 -- accel/accel.sh@21 -- # val= 00:07:08.762 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.762 15:50:58 -- accel/accel.sh@21 -- # val=0x1 00:07:08.762 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.762 15:50:58 -- accel/accel.sh@21 -- # val= 00:07:08.762 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.762 15:50:58 -- accel/accel.sh@21 -- # val= 00:07:08.762 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.762 15:50:58 -- accel/accel.sh@21 -- # val=dif_verify 00:07:08.762 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.762 15:50:58 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.762 15:50:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:08.762 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.762 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.763 15:50:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:08.763 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.763 15:50:58 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:08.763 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.763 15:50:58 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:08.763 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.763 15:50:58 -- accel/accel.sh@21 -- # val= 00:07:08.763 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.763 15:50:58 -- accel/accel.sh@21 -- # val=software 00:07:08.763 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.763 15:50:58 -- accel/accel.sh@23 -- # accel_module=software 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.763 15:50:58 -- accel/accel.sh@21 -- # val=32 00:07:08.763 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.763 15:50:58 -- accel/accel.sh@21 -- # val=32 00:07:08.763 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.763 15:50:58 -- accel/accel.sh@21 -- # val=1 00:07:08.763 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.763 15:50:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:08.763 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.763 15:50:58 -- accel/accel.sh@21 -- # val=No 00:07:08.763 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.763 15:50:58 -- accel/accel.sh@21 -- # val= 00:07:08.763 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:08.763 15:50:58 -- accel/accel.sh@21 -- # val= 00:07:08.763 15:50:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # IFS=: 00:07:08.763 15:50:58 -- accel/accel.sh@20 -- # read -r var val 00:07:10.136 15:50:59 -- accel/accel.sh@21 -- # val= 00:07:10.136 15:50:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.136 15:50:59 -- accel/accel.sh@20 -- # IFS=: 00:07:10.136 15:50:59 -- accel/accel.sh@20 -- # read -r var val 00:07:10.136 15:50:59 -- accel/accel.sh@21 -- # val= 00:07:10.136 15:50:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.136 15:50:59 -- accel/accel.sh@20 -- # IFS=: 00:07:10.136 15:50:59 -- accel/accel.sh@20 -- # read -r var val 00:07:10.136 15:50:59 -- accel/accel.sh@21 -- # val= 00:07:10.136 15:50:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.136 15:50:59 -- accel/accel.sh@20 -- # IFS=: 00:07:10.136 15:50:59 -- accel/accel.sh@20 -- # read -r var val 00:07:10.136 15:50:59 -- accel/accel.sh@21 -- # val= 00:07:10.136 15:50:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.136 15:50:59 -- accel/accel.sh@20 -- # IFS=: 00:07:10.136 15:50:59 -- accel/accel.sh@20 -- # read -r var val 00:07:10.136 15:50:59 -- accel/accel.sh@21 -- # val= 00:07:10.136 15:50:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.136 15:50:59 -- accel/accel.sh@20 -- # IFS=: 00:07:10.136 15:50:59 -- accel/accel.sh@20 -- # read -r var val 00:07:10.136 15:50:59 -- accel/accel.sh@21 -- # val= 00:07:10.136 15:50:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.136 15:50:59 -- accel/accel.sh@20 -- # IFS=: 00:07:10.136 15:50:59 -- accel/accel.sh@20 -- # read -r var val 00:07:10.136 15:50:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:10.136 15:50:59 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:10.136 15:50:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:10.136 00:07:10.136 real 0m2.779s 00:07:10.136 user 0m2.498s 00:07:10.136 sys 0m0.276s 00:07:10.136 15:50:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:10.136 15:50:59 -- common/autotest_common.sh@10 -- # set +x 00:07:10.136 ************************************ 00:07:10.136 END TEST accel_dif_verify 00:07:10.136 ************************************ 00:07:10.136 15:50:59 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:10.136 15:50:59 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:07:10.136 15:50:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:10.136 15:50:59 -- common/autotest_common.sh@10 -- # set +x 00:07:10.136 ************************************ 00:07:10.136 START TEST accel_dif_generate 00:07:10.136 ************************************ 00:07:10.136 15:50:59 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate 00:07:10.136 15:50:59 -- accel/accel.sh@16 -- # local accel_opc 00:07:10.136 15:50:59 -- accel/accel.sh@17 -- # local accel_module 00:07:10.136 15:50:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:10.136 15:50:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:10.136 15:50:59 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.136 15:50:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:10.136 15:50:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.136 15:50:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.136 15:50:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:10.136 15:50:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:10.136 15:50:59 -- accel/accel.sh@41 -- # local IFS=, 00:07:10.136 15:50:59 -- accel/accel.sh@42 -- # jq -r . 00:07:10.136 [2024-10-30 15:50:59.718368] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:10.136 [2024-10-30 15:50:59.718447] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2307979 ] 00:07:10.136 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.136 [2024-10-30 15:50:59.779892] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.136 [2024-10-30 15:50:59.871060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.510 15:51:01 -- accel/accel.sh@18 -- # out=' 00:07:11.510 SPDK Configuration: 00:07:11.510 Core mask: 0x1 00:07:11.510 00:07:11.510 Accel Perf Configuration: 00:07:11.510 Workload Type: dif_generate 00:07:11.510 Vector size: 4096 bytes 00:07:11.510 Transfer size: 4096 bytes 00:07:11.510 Block size: 512 bytes 00:07:11.510 Metadata size: 8 bytes 00:07:11.510 Vector count 1 00:07:11.510 Module: software 00:07:11.510 Queue depth: 32 00:07:11.510 Allocate depth: 32 00:07:11.510 # threads/core: 1 00:07:11.510 Run time: 1 seconds 00:07:11.510 Verify: No 00:07:11.510 00:07:11.510 Running for 1 seconds... 00:07:11.510 00:07:11.510 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:11.510 ------------------------------------------------------------------------------------ 00:07:11.510 0,0 97984/s 388 MiB/s 0 0 00:07:11.510 ==================================================================================== 00:07:11.510 Total 97984/s 382 MiB/s 0 0' 00:07:11.510 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.510 15:51:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:11.510 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.510 15:51:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:11.510 15:51:01 -- accel/accel.sh@12 -- # build_accel_config 00:07:11.510 15:51:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:11.510 15:51:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:11.510 15:51:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:11.510 15:51:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:11.510 15:51:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:11.510 15:51:01 -- accel/accel.sh@41 -- # local IFS=, 00:07:11.510 15:51:01 -- accel/accel.sh@42 -- # jq -r . 00:07:11.510 [2024-10-30 15:51:01.111875] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:11.510 [2024-10-30 15:51:01.111964] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2308185 ] 00:07:11.510 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.510 [2024-10-30 15:51:01.175645] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.510 [2024-10-30 15:51:01.265323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:11.510 15:51:01 -- accel/accel.sh@21 -- # val= 00:07:11.510 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.510 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.510 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.510 15:51:01 -- accel/accel.sh@21 -- # val= 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val=0x1 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val= 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val= 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val=dif_generate 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val= 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val=software 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@23 -- # accel_module=software 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val=32 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val=32 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val=1 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val=No 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val= 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:11.511 15:51:01 -- accel/accel.sh@21 -- # val= 00:07:11.511 15:51:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # IFS=: 00:07:11.511 15:51:01 -- accel/accel.sh@20 -- # read -r var val 00:07:12.886 15:51:02 -- accel/accel.sh@21 -- # val= 00:07:12.886 15:51:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.886 15:51:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.886 15:51:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.886 15:51:02 -- accel/accel.sh@21 -- # val= 00:07:12.886 15:51:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.886 15:51:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.886 15:51:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.886 15:51:02 -- accel/accel.sh@21 -- # val= 00:07:12.886 15:51:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.886 15:51:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.886 15:51:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.886 15:51:02 -- accel/accel.sh@21 -- # val= 00:07:12.886 15:51:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.886 15:51:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.886 15:51:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.886 15:51:02 -- accel/accel.sh@21 -- # val= 00:07:12.886 15:51:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.886 15:51:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.886 15:51:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.886 15:51:02 -- accel/accel.sh@21 -- # val= 00:07:12.886 15:51:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.886 15:51:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.886 15:51:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.886 15:51:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:12.886 15:51:02 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:12.886 15:51:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:12.886 00:07:12.886 real 0m2.794s 00:07:12.886 user 0m2.504s 00:07:12.886 sys 0m0.284s 00:07:12.886 15:51:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:12.886 15:51:02 -- common/autotest_common.sh@10 -- # set +x 00:07:12.886 ************************************ 00:07:12.886 END TEST accel_dif_generate 00:07:12.886 ************************************ 00:07:12.886 15:51:02 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:12.886 15:51:02 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:07:12.886 15:51:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:12.886 15:51:02 -- common/autotest_common.sh@10 -- # set +x 00:07:12.886 ************************************ 00:07:12.886 START TEST accel_dif_generate_copy 00:07:12.886 ************************************ 00:07:12.886 15:51:02 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate_copy 00:07:12.886 15:51:02 -- accel/accel.sh@16 -- # local accel_opc 00:07:12.886 15:51:02 -- accel/accel.sh@17 -- # local accel_module 00:07:12.886 15:51:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:12.886 15:51:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:12.886 15:51:02 -- accel/accel.sh@12 -- # build_accel_config 00:07:12.886 15:51:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:12.886 15:51:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:12.886 15:51:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:12.886 15:51:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:12.886 15:51:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:12.886 15:51:02 -- accel/accel.sh@41 -- # local IFS=, 00:07:12.886 15:51:02 -- accel/accel.sh@42 -- # jq -r . 00:07:12.886 [2024-10-30 15:51:02.539572] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:12.886 [2024-10-30 15:51:02.539653] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2308391 ] 00:07:12.886 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.886 [2024-10-30 15:51:02.603478] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.886 [2024-10-30 15:51:02.692871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.261 15:51:03 -- accel/accel.sh@18 -- # out=' 00:07:14.261 SPDK Configuration: 00:07:14.261 Core mask: 0x1 00:07:14.261 00:07:14.261 Accel Perf Configuration: 00:07:14.261 Workload Type: dif_generate_copy 00:07:14.261 Vector size: 4096 bytes 00:07:14.261 Transfer size: 4096 bytes 00:07:14.261 Vector count 1 00:07:14.261 Module: software 00:07:14.261 Queue depth: 32 00:07:14.261 Allocate depth: 32 00:07:14.261 # threads/core: 1 00:07:14.261 Run time: 1 seconds 00:07:14.261 Verify: No 00:07:14.261 00:07:14.261 Running for 1 seconds... 00:07:14.261 00:07:14.261 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:14.261 ------------------------------------------------------------------------------------ 00:07:14.261 0,0 76320/s 302 MiB/s 0 0 00:07:14.261 ==================================================================================== 00:07:14.261 Total 76320/s 298 MiB/s 0 0' 00:07:14.261 15:51:03 -- accel/accel.sh@20 -- # IFS=: 00:07:14.261 15:51:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:14.261 15:51:03 -- accel/accel.sh@20 -- # read -r var val 00:07:14.261 15:51:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:14.261 15:51:03 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.261 15:51:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.261 15:51:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.261 15:51:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.261 15:51:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.261 15:51:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.261 15:51:03 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.261 15:51:03 -- accel/accel.sh@42 -- # jq -r . 00:07:14.261 [2024-10-30 15:51:03.940213] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:14.261 [2024-10-30 15:51:03.940306] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2308650 ] 00:07:14.261 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.261 [2024-10-30 15:51:04.001511] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.261 [2024-10-30 15:51:04.094273] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val= 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val= 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val=0x1 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val= 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val= 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val= 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val=software 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@23 -- # accel_module=software 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val=32 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val=32 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val=1 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.520 15:51:04 -- accel/accel.sh@21 -- # val=No 00:07:14.520 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.520 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.521 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.521 15:51:04 -- accel/accel.sh@21 -- # val= 00:07:14.521 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.521 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.521 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:14.521 15:51:04 -- accel/accel.sh@21 -- # val= 00:07:14.521 15:51:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.521 15:51:04 -- accel/accel.sh@20 -- # IFS=: 00:07:14.521 15:51:04 -- accel/accel.sh@20 -- # read -r var val 00:07:15.455 15:51:05 -- accel/accel.sh@21 -- # val= 00:07:15.455 15:51:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.455 15:51:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.455 15:51:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.455 15:51:05 -- accel/accel.sh@21 -- # val= 00:07:15.455 15:51:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.455 15:51:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.455 15:51:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.455 15:51:05 -- accel/accel.sh@21 -- # val= 00:07:15.455 15:51:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.455 15:51:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.455 15:51:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.455 15:51:05 -- accel/accel.sh@21 -- # val= 00:07:15.455 15:51:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.455 15:51:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.455 15:51:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.455 15:51:05 -- accel/accel.sh@21 -- # val= 00:07:15.455 15:51:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.455 15:51:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.455 15:51:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.455 15:51:05 -- accel/accel.sh@21 -- # val= 00:07:15.455 15:51:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.455 15:51:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.455 15:51:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.455 15:51:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:15.455 15:51:05 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:15.455 15:51:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:15.455 00:07:15.455 real 0m2.800s 00:07:15.455 user 0m2.502s 00:07:15.455 sys 0m0.288s 00:07:15.455 15:51:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:15.455 15:51:05 -- common/autotest_common.sh@10 -- # set +x 00:07:15.455 ************************************ 00:07:15.455 END TEST accel_dif_generate_copy 00:07:15.456 ************************************ 00:07:15.714 15:51:05 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:15.714 15:51:05 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:15.714 15:51:05 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:07:15.714 15:51:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:15.714 15:51:05 -- common/autotest_common.sh@10 -- # set +x 00:07:15.714 ************************************ 00:07:15.714 START TEST accel_comp 00:07:15.714 ************************************ 00:07:15.714 15:51:05 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:15.714 15:51:05 -- accel/accel.sh@16 -- # local accel_opc 00:07:15.714 15:51:05 -- accel/accel.sh@17 -- # local accel_module 00:07:15.714 15:51:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:15.714 15:51:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:15.714 15:51:05 -- accel/accel.sh@12 -- # build_accel_config 00:07:15.714 15:51:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:15.714 15:51:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:15.714 15:51:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:15.714 15:51:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:15.714 15:51:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:15.714 15:51:05 -- accel/accel.sh@41 -- # local IFS=, 00:07:15.714 15:51:05 -- accel/accel.sh@42 -- # jq -r . 00:07:15.714 [2024-10-30 15:51:05.365470] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:15.714 [2024-10-30 15:51:05.365560] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2308807 ] 00:07:15.714 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.714 [2024-10-30 15:51:05.428536] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:15.714 [2024-10-30 15:51:05.519385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.087 15:51:06 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:17.088 00:07:17.088 SPDK Configuration: 00:07:17.088 Core mask: 0x1 00:07:17.088 00:07:17.088 Accel Perf Configuration: 00:07:17.088 Workload Type: compress 00:07:17.088 Transfer size: 4096 bytes 00:07:17.088 Vector count 1 00:07:17.088 Module: software 00:07:17.088 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:17.088 Queue depth: 32 00:07:17.088 Allocate depth: 32 00:07:17.088 # threads/core: 1 00:07:17.088 Run time: 1 seconds 00:07:17.088 Verify: No 00:07:17.088 00:07:17.088 Running for 1 seconds... 00:07:17.088 00:07:17.088 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:17.088 ------------------------------------------------------------------------------------ 00:07:17.088 0,0 31584/s 131 MiB/s 0 0 00:07:17.088 ==================================================================================== 00:07:17.088 Total 31584/s 123 MiB/s 0 0' 00:07:17.088 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.088 15:51:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:17.088 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.088 15:51:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:17.088 15:51:06 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.088 15:51:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.088 15:51:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.088 15:51:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.088 15:51:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.088 15:51:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.088 15:51:06 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.088 15:51:06 -- accel/accel.sh@42 -- # jq -r . 00:07:17.088 [2024-10-30 15:51:06.768884] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:17.088 [2024-10-30 15:51:06.768966] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2308959 ] 00:07:17.088 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.088 [2024-10-30 15:51:06.830950] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.088 [2024-10-30 15:51:06.921970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val= 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val= 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val= 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val=0x1 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val= 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val= 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val=compress 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val= 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val=software 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@23 -- # accel_module=software 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val=32 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val=32 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val=1 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val=No 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val= 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:17.346 15:51:06 -- accel/accel.sh@21 -- # val= 00:07:17.346 15:51:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # IFS=: 00:07:17.346 15:51:06 -- accel/accel.sh@20 -- # read -r var val 00:07:18.281 15:51:08 -- accel/accel.sh@21 -- # val= 00:07:18.281 15:51:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.281 15:51:08 -- accel/accel.sh@20 -- # IFS=: 00:07:18.281 15:51:08 -- accel/accel.sh@20 -- # read -r var val 00:07:18.281 15:51:08 -- accel/accel.sh@21 -- # val= 00:07:18.281 15:51:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.281 15:51:08 -- accel/accel.sh@20 -- # IFS=: 00:07:18.281 15:51:08 -- accel/accel.sh@20 -- # read -r var val 00:07:18.281 15:51:08 -- accel/accel.sh@21 -- # val= 00:07:18.281 15:51:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.281 15:51:08 -- accel/accel.sh@20 -- # IFS=: 00:07:18.281 15:51:08 -- accel/accel.sh@20 -- # read -r var val 00:07:18.281 15:51:08 -- accel/accel.sh@21 -- # val= 00:07:18.281 15:51:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.281 15:51:08 -- accel/accel.sh@20 -- # IFS=: 00:07:18.281 15:51:08 -- accel/accel.sh@20 -- # read -r var val 00:07:18.281 15:51:08 -- accel/accel.sh@21 -- # val= 00:07:18.281 15:51:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.281 15:51:08 -- accel/accel.sh@20 -- # IFS=: 00:07:18.281 15:51:08 -- accel/accel.sh@20 -- # read -r var val 00:07:18.281 15:51:08 -- accel/accel.sh@21 -- # val= 00:07:18.281 15:51:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.281 15:51:08 -- accel/accel.sh@20 -- # IFS=: 00:07:18.281 15:51:08 -- accel/accel.sh@20 -- # read -r var val 00:07:18.281 15:51:08 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:18.281 15:51:08 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:18.281 15:51:08 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:18.281 00:07:18.281 real 0m2.804s 00:07:18.281 user 0m2.504s 00:07:18.281 sys 0m0.292s 00:07:18.281 15:51:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:18.281 15:51:08 -- common/autotest_common.sh@10 -- # set +x 00:07:18.281 ************************************ 00:07:18.281 END TEST accel_comp 00:07:18.281 ************************************ 00:07:18.540 15:51:08 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:18.540 15:51:08 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:07:18.540 15:51:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:18.540 15:51:08 -- common/autotest_common.sh@10 -- # set +x 00:07:18.540 ************************************ 00:07:18.540 START TEST accel_decomp 00:07:18.540 ************************************ 00:07:18.540 15:51:08 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:18.540 15:51:08 -- accel/accel.sh@16 -- # local accel_opc 00:07:18.540 15:51:08 -- accel/accel.sh@17 -- # local accel_module 00:07:18.540 15:51:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:18.540 15:51:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:18.540 15:51:08 -- accel/accel.sh@12 -- # build_accel_config 00:07:18.540 15:51:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:18.540 15:51:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:18.540 15:51:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:18.540 15:51:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:18.540 15:51:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:18.540 15:51:08 -- accel/accel.sh@41 -- # local IFS=, 00:07:18.540 15:51:08 -- accel/accel.sh@42 -- # jq -r . 00:07:18.540 [2024-10-30 15:51:08.196407] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:18.540 [2024-10-30 15:51:08.196489] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2309429 ] 00:07:18.540 EAL: No free 2048 kB hugepages reported on node 1 00:07:18.540 [2024-10-30 15:51:08.262819] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:18.540 [2024-10-30 15:51:08.354955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.916 15:51:09 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:19.916 00:07:19.916 SPDK Configuration: 00:07:19.916 Core mask: 0x1 00:07:19.916 00:07:19.916 Accel Perf Configuration: 00:07:19.916 Workload Type: decompress 00:07:19.916 Transfer size: 4096 bytes 00:07:19.916 Vector count 1 00:07:19.916 Module: software 00:07:19.916 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:19.916 Queue depth: 32 00:07:19.916 Allocate depth: 32 00:07:19.916 # threads/core: 1 00:07:19.916 Run time: 1 seconds 00:07:19.916 Verify: Yes 00:07:19.916 00:07:19.916 Running for 1 seconds... 00:07:19.916 00:07:19.916 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:19.916 ------------------------------------------------------------------------------------ 00:07:19.916 0,0 55808/s 102 MiB/s 0 0 00:07:19.916 ==================================================================================== 00:07:19.916 Total 55808/s 218 MiB/s 0 0' 00:07:19.916 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:19.916 15:51:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:19.916 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:19.916 15:51:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:19.916 15:51:09 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.916 15:51:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:19.916 15:51:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.916 15:51:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.916 15:51:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:19.916 15:51:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:19.916 15:51:09 -- accel/accel.sh@41 -- # local IFS=, 00:07:19.916 15:51:09 -- accel/accel.sh@42 -- # jq -r . 00:07:19.916 [2024-10-30 15:51:09.594025] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:19.916 [2024-10-30 15:51:09.594106] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2309879 ] 00:07:19.916 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.916 [2024-10-30 15:51:09.655403] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.916 [2024-10-30 15:51:09.745789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val= 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val= 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val= 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val=0x1 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val= 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val= 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val=decompress 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val= 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val=software 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@23 -- # accel_module=software 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val=32 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val=32 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val=1 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val=Yes 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val= 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:20.175 15:51:09 -- accel/accel.sh@21 -- # val= 00:07:20.175 15:51:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # IFS=: 00:07:20.175 15:51:09 -- accel/accel.sh@20 -- # read -r var val 00:07:21.110 15:51:10 -- accel/accel.sh@21 -- # val= 00:07:21.110 15:51:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.110 15:51:10 -- accel/accel.sh@20 -- # IFS=: 00:07:21.110 15:51:10 -- accel/accel.sh@20 -- # read -r var val 00:07:21.110 15:51:10 -- accel/accel.sh@21 -- # val= 00:07:21.110 15:51:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.110 15:51:10 -- accel/accel.sh@20 -- # IFS=: 00:07:21.110 15:51:10 -- accel/accel.sh@20 -- # read -r var val 00:07:21.110 15:51:10 -- accel/accel.sh@21 -- # val= 00:07:21.110 15:51:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.110 15:51:10 -- accel/accel.sh@20 -- # IFS=: 00:07:21.110 15:51:10 -- accel/accel.sh@20 -- # read -r var val 00:07:21.110 15:51:10 -- accel/accel.sh@21 -- # val= 00:07:21.110 15:51:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.110 15:51:10 -- accel/accel.sh@20 -- # IFS=: 00:07:21.110 15:51:10 -- accel/accel.sh@20 -- # read -r var val 00:07:21.110 15:51:10 -- accel/accel.sh@21 -- # val= 00:07:21.110 15:51:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.110 15:51:10 -- accel/accel.sh@20 -- # IFS=: 00:07:21.110 15:51:10 -- accel/accel.sh@20 -- # read -r var val 00:07:21.110 15:51:10 -- accel/accel.sh@21 -- # val= 00:07:21.110 15:51:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.110 15:51:10 -- accel/accel.sh@20 -- # IFS=: 00:07:21.110 15:51:10 -- accel/accel.sh@20 -- # read -r var val 00:07:21.110 15:51:10 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:21.110 15:51:10 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:21.110 15:51:10 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:21.110 00:07:21.110 real 0m2.807s 00:07:21.110 user 0m2.514s 00:07:21.110 sys 0m0.284s 00:07:21.110 15:51:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:21.110 15:51:10 -- common/autotest_common.sh@10 -- # set +x 00:07:21.110 ************************************ 00:07:21.110 END TEST accel_decomp 00:07:21.110 ************************************ 00:07:21.368 15:51:11 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:21.368 15:51:11 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:07:21.368 15:51:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:21.368 15:51:11 -- common/autotest_common.sh@10 -- # set +x 00:07:21.368 ************************************ 00:07:21.368 START TEST accel_decmop_full 00:07:21.368 ************************************ 00:07:21.368 15:51:11 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:21.368 15:51:11 -- accel/accel.sh@16 -- # local accel_opc 00:07:21.368 15:51:11 -- accel/accel.sh@17 -- # local accel_module 00:07:21.368 15:51:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:21.369 15:51:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:21.369 15:51:11 -- accel/accel.sh@12 -- # build_accel_config 00:07:21.369 15:51:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:21.369 15:51:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:21.369 15:51:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:21.369 15:51:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:21.369 15:51:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:21.369 15:51:11 -- accel/accel.sh@41 -- # local IFS=, 00:07:21.369 15:51:11 -- accel/accel.sh@42 -- # jq -r . 00:07:21.369 [2024-10-30 15:51:11.027688] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:21.369 [2024-10-30 15:51:11.027762] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2310036 ] 00:07:21.369 EAL: No free 2048 kB hugepages reported on node 1 00:07:21.369 [2024-10-30 15:51:11.088457] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:21.369 [2024-10-30 15:51:11.176529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:22.742 15:51:12 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:22.742 00:07:22.742 SPDK Configuration: 00:07:22.742 Core mask: 0x1 00:07:22.742 00:07:22.742 Accel Perf Configuration: 00:07:22.742 Workload Type: decompress 00:07:22.742 Transfer size: 111250 bytes 00:07:22.742 Vector count 1 00:07:22.742 Module: software 00:07:22.742 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:22.742 Queue depth: 32 00:07:22.742 Allocate depth: 32 00:07:22.742 # threads/core: 1 00:07:22.742 Run time: 1 seconds 00:07:22.742 Verify: Yes 00:07:22.742 00:07:22.742 Running for 1 seconds... 00:07:22.742 00:07:22.742 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:22.742 ------------------------------------------------------------------------------------ 00:07:22.742 0,0 3808/s 157 MiB/s 0 0 00:07:22.742 ==================================================================================== 00:07:22.742 Total 3808/s 404 MiB/s 0 0' 00:07:22.742 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:22.742 15:51:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:22.742 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:22.742 15:51:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:22.742 15:51:12 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.742 15:51:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:22.742 15:51:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.742 15:51:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.742 15:51:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:22.742 15:51:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:22.742 15:51:12 -- accel/accel.sh@41 -- # local IFS=, 00:07:22.742 15:51:12 -- accel/accel.sh@42 -- # jq -r . 00:07:22.742 [2024-10-30 15:51:12.428656] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:22.742 [2024-10-30 15:51:12.428738] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2310183 ] 00:07:22.742 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.742 [2024-10-30 15:51:12.489759] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.742 [2024-10-30 15:51:12.580315] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val= 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val= 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val= 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val=0x1 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val= 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val= 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val=decompress 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val= 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val=software 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@23 -- # accel_module=software 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val=32 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val=32 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val=1 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val=Yes 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val= 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:23.000 15:51:12 -- accel/accel.sh@21 -- # val= 00:07:23.000 15:51:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # IFS=: 00:07:23.000 15:51:12 -- accel/accel.sh@20 -- # read -r var val 00:07:24.370 15:51:13 -- accel/accel.sh@21 -- # val= 00:07:24.370 15:51:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.370 15:51:13 -- accel/accel.sh@20 -- # IFS=: 00:07:24.370 15:51:13 -- accel/accel.sh@20 -- # read -r var val 00:07:24.370 15:51:13 -- accel/accel.sh@21 -- # val= 00:07:24.370 15:51:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.370 15:51:13 -- accel/accel.sh@20 -- # IFS=: 00:07:24.370 15:51:13 -- accel/accel.sh@20 -- # read -r var val 00:07:24.370 15:51:13 -- accel/accel.sh@21 -- # val= 00:07:24.370 15:51:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.370 15:51:13 -- accel/accel.sh@20 -- # IFS=: 00:07:24.370 15:51:13 -- accel/accel.sh@20 -- # read -r var val 00:07:24.370 15:51:13 -- accel/accel.sh@21 -- # val= 00:07:24.370 15:51:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.370 15:51:13 -- accel/accel.sh@20 -- # IFS=: 00:07:24.370 15:51:13 -- accel/accel.sh@20 -- # read -r var val 00:07:24.370 15:51:13 -- accel/accel.sh@21 -- # val= 00:07:24.370 15:51:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.370 15:51:13 -- accel/accel.sh@20 -- # IFS=: 00:07:24.370 15:51:13 -- accel/accel.sh@20 -- # read -r var val 00:07:24.370 15:51:13 -- accel/accel.sh@21 -- # val= 00:07:24.370 15:51:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.370 15:51:13 -- accel/accel.sh@20 -- # IFS=: 00:07:24.370 15:51:13 -- accel/accel.sh@20 -- # read -r var val 00:07:24.370 15:51:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:24.370 15:51:13 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:24.370 15:51:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:24.370 00:07:24.370 real 0m2.823s 00:07:24.370 user 0m2.529s 00:07:24.370 sys 0m0.286s 00:07:24.370 15:51:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:24.370 15:51:13 -- common/autotest_common.sh@10 -- # set +x 00:07:24.370 ************************************ 00:07:24.370 END TEST accel_decmop_full 00:07:24.370 ************************************ 00:07:24.370 15:51:13 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:24.370 15:51:13 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:07:24.370 15:51:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:24.370 15:51:13 -- common/autotest_common.sh@10 -- # set +x 00:07:24.370 ************************************ 00:07:24.370 START TEST accel_decomp_mcore 00:07:24.370 ************************************ 00:07:24.370 15:51:13 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:24.370 15:51:13 -- accel/accel.sh@16 -- # local accel_opc 00:07:24.370 15:51:13 -- accel/accel.sh@17 -- # local accel_module 00:07:24.370 15:51:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:24.370 15:51:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:24.370 15:51:13 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.370 15:51:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:24.370 15:51:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.370 15:51:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.370 15:51:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:24.370 15:51:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:24.370 15:51:13 -- accel/accel.sh@41 -- # local IFS=, 00:07:24.370 15:51:13 -- accel/accel.sh@42 -- # jq -r . 00:07:24.370 [2024-10-30 15:51:13.879982] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:24.370 [2024-10-30 15:51:13.880064] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2310345 ] 00:07:24.370 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.370 [2024-10-30 15:51:13.945373] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:24.370 [2024-10-30 15:51:14.037948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:24.370 [2024-10-30 15:51:14.038008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:24.370 [2024-10-30 15:51:14.038030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:24.370 [2024-10-30 15:51:14.038032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.743 15:51:15 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:25.743 00:07:25.743 SPDK Configuration: 00:07:25.743 Core mask: 0xf 00:07:25.743 00:07:25.743 Accel Perf Configuration: 00:07:25.743 Workload Type: decompress 00:07:25.743 Transfer size: 4096 bytes 00:07:25.743 Vector count 1 00:07:25.743 Module: software 00:07:25.743 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.743 Queue depth: 32 00:07:25.743 Allocate depth: 32 00:07:25.743 # threads/core: 1 00:07:25.743 Run time: 1 seconds 00:07:25.743 Verify: Yes 00:07:25.743 00:07:25.743 Running for 1 seconds... 00:07:25.743 00:07:25.743 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:25.743 ------------------------------------------------------------------------------------ 00:07:25.743 0,0 56768/s 104 MiB/s 0 0 00:07:25.743 3,0 57312/s 105 MiB/s 0 0 00:07:25.743 2,0 57280/s 105 MiB/s 0 0 00:07:25.743 1,0 57120/s 105 MiB/s 0 0 00:07:25.743 ==================================================================================== 00:07:25.743 Total 228480/s 892 MiB/s 0 0' 00:07:25.743 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.743 15:51:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:25.743 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.743 15:51:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:25.743 15:51:15 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.743 15:51:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:25.743 15:51:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.743 15:51:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.743 15:51:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:25.743 15:51:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:25.743 15:51:15 -- accel/accel.sh@41 -- # local IFS=, 00:07:25.743 15:51:15 -- accel/accel.sh@42 -- # jq -r . 00:07:25.743 [2024-10-30 15:51:15.294155] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:25.743 [2024-10-30 15:51:15.294237] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2310605 ] 00:07:25.743 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.743 [2024-10-30 15:51:15.355416] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:25.743 [2024-10-30 15:51:15.449463] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:25.743 [2024-10-30 15:51:15.449518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:25.743 [2024-10-30 15:51:15.449635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:25.743 [2024-10-30 15:51:15.449638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.743 15:51:15 -- accel/accel.sh@21 -- # val= 00:07:25.743 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.743 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.743 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.743 15:51:15 -- accel/accel.sh@21 -- # val= 00:07:25.743 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.743 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.743 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.743 15:51:15 -- accel/accel.sh@21 -- # val= 00:07:25.743 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.743 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.743 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.743 15:51:15 -- accel/accel.sh@21 -- # val=0xf 00:07:25.743 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.743 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.743 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.743 15:51:15 -- accel/accel.sh@21 -- # val= 00:07:25.743 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.743 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.743 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.743 15:51:15 -- accel/accel.sh@21 -- # val= 00:07:25.743 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.743 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.743 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.743 15:51:15 -- accel/accel.sh@21 -- # val=decompress 00:07:25.743 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.743 15:51:15 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.744 15:51:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:25.744 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.744 15:51:15 -- accel/accel.sh@21 -- # val= 00:07:25.744 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.744 15:51:15 -- accel/accel.sh@21 -- # val=software 00:07:25.744 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.744 15:51:15 -- accel/accel.sh@23 -- # accel_module=software 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.744 15:51:15 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.744 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.744 15:51:15 -- accel/accel.sh@21 -- # val=32 00:07:25.744 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.744 15:51:15 -- accel/accel.sh@21 -- # val=32 00:07:25.744 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.744 15:51:15 -- accel/accel.sh@21 -- # val=1 00:07:25.744 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.744 15:51:15 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:25.744 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.744 15:51:15 -- accel/accel.sh@21 -- # val=Yes 00:07:25.744 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.744 15:51:15 -- accel/accel.sh@21 -- # val= 00:07:25.744 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:25.744 15:51:15 -- accel/accel.sh@21 -- # val= 00:07:25.744 15:51:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # IFS=: 00:07:25.744 15:51:15 -- accel/accel.sh@20 -- # read -r var val 00:07:27.117 15:51:16 -- accel/accel.sh@21 -- # val= 00:07:27.117 15:51:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.117 15:51:16 -- accel/accel.sh@20 -- # IFS=: 00:07:27.117 15:51:16 -- accel/accel.sh@20 -- # read -r var val 00:07:27.117 15:51:16 -- accel/accel.sh@21 -- # val= 00:07:27.117 15:51:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # IFS=: 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # read -r var val 00:07:27.118 15:51:16 -- accel/accel.sh@21 -- # val= 00:07:27.118 15:51:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # IFS=: 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # read -r var val 00:07:27.118 15:51:16 -- accel/accel.sh@21 -- # val= 00:07:27.118 15:51:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # IFS=: 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # read -r var val 00:07:27.118 15:51:16 -- accel/accel.sh@21 -- # val= 00:07:27.118 15:51:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # IFS=: 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # read -r var val 00:07:27.118 15:51:16 -- accel/accel.sh@21 -- # val= 00:07:27.118 15:51:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # IFS=: 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # read -r var val 00:07:27.118 15:51:16 -- accel/accel.sh@21 -- # val= 00:07:27.118 15:51:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # IFS=: 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # read -r var val 00:07:27.118 15:51:16 -- accel/accel.sh@21 -- # val= 00:07:27.118 15:51:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # IFS=: 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # read -r var val 00:07:27.118 15:51:16 -- accel/accel.sh@21 -- # val= 00:07:27.118 15:51:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # IFS=: 00:07:27.118 15:51:16 -- accel/accel.sh@20 -- # read -r var val 00:07:27.118 15:51:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:27.118 15:51:16 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:27.118 15:51:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:27.118 00:07:27.118 real 0m2.829s 00:07:27.118 user 0m9.415s 00:07:27.118 sys 0m0.300s 00:07:27.118 15:51:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:27.118 15:51:16 -- common/autotest_common.sh@10 -- # set +x 00:07:27.118 ************************************ 00:07:27.118 END TEST accel_decomp_mcore 00:07:27.118 ************************************ 00:07:27.118 15:51:16 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:27.118 15:51:16 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:07:27.118 15:51:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:27.118 15:51:16 -- common/autotest_common.sh@10 -- # set +x 00:07:27.118 ************************************ 00:07:27.118 START TEST accel_decomp_full_mcore 00:07:27.118 ************************************ 00:07:27.118 15:51:16 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:27.118 15:51:16 -- accel/accel.sh@16 -- # local accel_opc 00:07:27.118 15:51:16 -- accel/accel.sh@17 -- # local accel_module 00:07:27.118 15:51:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:27.118 15:51:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:27.118 15:51:16 -- accel/accel.sh@12 -- # build_accel_config 00:07:27.118 15:51:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:27.118 15:51:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:27.118 15:51:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:27.118 15:51:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:27.118 15:51:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:27.118 15:51:16 -- accel/accel.sh@41 -- # local IFS=, 00:07:27.118 15:51:16 -- accel/accel.sh@42 -- # jq -r . 00:07:27.118 [2024-10-30 15:51:16.737177] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:27.118 [2024-10-30 15:51:16.737278] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2310769 ] 00:07:27.118 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.118 [2024-10-30 15:51:16.801764] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:27.118 [2024-10-30 15:51:16.898570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:27.118 [2024-10-30 15:51:16.898628] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:27.118 [2024-10-30 15:51:16.898694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:27.118 [2024-10-30 15:51:16.898696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.491 15:51:18 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:28.491 00:07:28.491 SPDK Configuration: 00:07:28.491 Core mask: 0xf 00:07:28.491 00:07:28.491 Accel Perf Configuration: 00:07:28.491 Workload Type: decompress 00:07:28.491 Transfer size: 111250 bytes 00:07:28.491 Vector count 1 00:07:28.491 Module: software 00:07:28.491 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.491 Queue depth: 32 00:07:28.491 Allocate depth: 32 00:07:28.491 # threads/core: 1 00:07:28.491 Run time: 1 seconds 00:07:28.491 Verify: Yes 00:07:28.492 00:07:28.492 Running for 1 seconds... 00:07:28.492 00:07:28.492 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:28.492 ------------------------------------------------------------------------------------ 00:07:28.492 0,0 4256/s 175 MiB/s 0 0 00:07:28.492 3,0 4256/s 175 MiB/s 0 0 00:07:28.492 2,0 4256/s 175 MiB/s 0 0 00:07:28.492 1,0 4256/s 175 MiB/s 0 0 00:07:28.492 ==================================================================================== 00:07:28.492 Total 17024/s 1806 MiB/s 0 0' 00:07:28.492 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.492 15:51:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:28.492 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.492 15:51:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:28.492 15:51:18 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.492 15:51:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:28.492 15:51:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.492 15:51:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.492 15:51:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:28.492 15:51:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:28.492 15:51:18 -- accel/accel.sh@41 -- # local IFS=, 00:07:28.492 15:51:18 -- accel/accel.sh@42 -- # jq -r . 00:07:28.492 [2024-10-30 15:51:18.150140] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:28.492 [2024-10-30 15:51:18.150224] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2310919 ] 00:07:28.492 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.492 [2024-10-30 15:51:18.212751] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:28.492 [2024-10-30 15:51:18.307114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:28.492 [2024-10-30 15:51:18.307182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:28.492 [2024-10-30 15:51:18.307341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:28.492 [2024-10-30 15:51:18.307344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.750 15:51:18 -- accel/accel.sh@21 -- # val= 00:07:28.750 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.750 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.750 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.750 15:51:18 -- accel/accel.sh@21 -- # val= 00:07:28.750 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.750 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.750 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.750 15:51:18 -- accel/accel.sh@21 -- # val= 00:07:28.750 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.750 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.750 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.750 15:51:18 -- accel/accel.sh@21 -- # val=0xf 00:07:28.750 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.750 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.750 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.750 15:51:18 -- accel/accel.sh@21 -- # val= 00:07:28.750 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.750 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.750 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.751 15:51:18 -- accel/accel.sh@21 -- # val= 00:07:28.751 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.751 15:51:18 -- accel/accel.sh@21 -- # val=decompress 00:07:28.751 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.751 15:51:18 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.751 15:51:18 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:28.751 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.751 15:51:18 -- accel/accel.sh@21 -- # val= 00:07:28.751 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.751 15:51:18 -- accel/accel.sh@21 -- # val=software 00:07:28.751 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.751 15:51:18 -- accel/accel.sh@23 -- # accel_module=software 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.751 15:51:18 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.751 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.751 15:51:18 -- accel/accel.sh@21 -- # val=32 00:07:28.751 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.751 15:51:18 -- accel/accel.sh@21 -- # val=32 00:07:28.751 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.751 15:51:18 -- accel/accel.sh@21 -- # val=1 00:07:28.751 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.751 15:51:18 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:28.751 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.751 15:51:18 -- accel/accel.sh@21 -- # val=Yes 00:07:28.751 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.751 15:51:18 -- accel/accel.sh@21 -- # val= 00:07:28.751 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:28.751 15:51:18 -- accel/accel.sh@21 -- # val= 00:07:28.751 15:51:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # IFS=: 00:07:28.751 15:51:18 -- accel/accel.sh@20 -- # read -r var val 00:07:29.686 15:51:19 -- accel/accel.sh@21 -- # val= 00:07:29.686 15:51:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.686 15:51:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.686 15:51:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.686 15:51:19 -- accel/accel.sh@21 -- # val= 00:07:29.686 15:51:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.686 15:51:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.686 15:51:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.686 15:51:19 -- accel/accel.sh@21 -- # val= 00:07:29.686 15:51:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.686 15:51:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.686 15:51:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.686 15:51:19 -- accel/accel.sh@21 -- # val= 00:07:29.686 15:51:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.686 15:51:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.686 15:51:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.686 15:51:19 -- accel/accel.sh@21 -- # val= 00:07:29.686 15:51:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.686 15:51:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.687 15:51:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.687 15:51:19 -- accel/accel.sh@21 -- # val= 00:07:29.687 15:51:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.687 15:51:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.687 15:51:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.687 15:51:19 -- accel/accel.sh@21 -- # val= 00:07:29.687 15:51:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.687 15:51:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.687 15:51:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.687 15:51:19 -- accel/accel.sh@21 -- # val= 00:07:29.687 15:51:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.687 15:51:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.687 15:51:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.687 15:51:19 -- accel/accel.sh@21 -- # val= 00:07:29.687 15:51:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.687 15:51:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.687 15:51:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.687 15:51:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:29.687 15:51:19 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:29.687 15:51:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:29.687 00:07:29.687 real 0m2.841s 00:07:29.687 user 0m9.466s 00:07:29.687 sys 0m0.304s 00:07:29.687 15:51:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:29.687 15:51:19 -- common/autotest_common.sh@10 -- # set +x 00:07:29.687 ************************************ 00:07:29.687 END TEST accel_decomp_full_mcore 00:07:29.687 ************************************ 00:07:29.951 15:51:19 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:29.951 15:51:19 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:07:29.951 15:51:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:29.951 15:51:19 -- common/autotest_common.sh@10 -- # set +x 00:07:29.951 ************************************ 00:07:29.951 START TEST accel_decomp_mthread 00:07:29.951 ************************************ 00:07:29.951 15:51:19 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:29.951 15:51:19 -- accel/accel.sh@16 -- # local accel_opc 00:07:29.951 15:51:19 -- accel/accel.sh@17 -- # local accel_module 00:07:29.951 15:51:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:29.951 15:51:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:29.951 15:51:19 -- accel/accel.sh@12 -- # build_accel_config 00:07:29.951 15:51:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:29.951 15:51:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:29.951 15:51:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:29.951 15:51:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:29.951 15:51:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:29.951 15:51:19 -- accel/accel.sh@41 -- # local IFS=, 00:07:29.951 15:51:19 -- accel/accel.sh@42 -- # jq -r . 00:07:29.951 [2024-10-30 15:51:19.603958] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:29.951 [2024-10-30 15:51:19.604041] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2311084 ] 00:07:29.951 EAL: No free 2048 kB hugepages reported on node 1 00:07:29.951 [2024-10-30 15:51:19.669338] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:29.951 [2024-10-30 15:51:19.761577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.327 15:51:21 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:31.327 00:07:31.327 SPDK Configuration: 00:07:31.327 Core mask: 0x1 00:07:31.327 00:07:31.327 Accel Perf Configuration: 00:07:31.327 Workload Type: decompress 00:07:31.327 Transfer size: 4096 bytes 00:07:31.327 Vector count 1 00:07:31.327 Module: software 00:07:31.327 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:31.327 Queue depth: 32 00:07:31.327 Allocate depth: 32 00:07:31.327 # threads/core: 2 00:07:31.327 Run time: 1 seconds 00:07:31.327 Verify: Yes 00:07:31.327 00:07:31.327 Running for 1 seconds... 00:07:31.327 00:07:31.327 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:31.327 ------------------------------------------------------------------------------------ 00:07:31.327 0,1 28128/s 51 MiB/s 0 0 00:07:31.327 0,0 28032/s 51 MiB/s 0 0 00:07:31.327 ==================================================================================== 00:07:31.327 Total 56160/s 219 MiB/s 0 0' 00:07:31.327 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.327 15:51:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:31.327 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.327 15:51:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:31.327 15:51:21 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.327 15:51:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:31.327 15:51:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.327 15:51:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.327 15:51:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:31.327 15:51:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:31.327 15:51:21 -- accel/accel.sh@41 -- # local IFS=, 00:07:31.327 15:51:21 -- accel/accel.sh@42 -- # jq -r . 00:07:31.327 [2024-10-30 15:51:21.021705] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:31.327 [2024-10-30 15:51:21.021787] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2311341 ] 00:07:31.327 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.327 [2024-10-30 15:51:21.084353] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.327 [2024-10-30 15:51:21.175507] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val= 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val= 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val= 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val=0x1 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val= 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val= 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val=decompress 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val= 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val=software 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@23 -- # accel_module=software 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val=32 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val=32 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val=2 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val=Yes 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val= 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:31.586 15:51:21 -- accel/accel.sh@21 -- # val= 00:07:31.586 15:51:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # IFS=: 00:07:31.586 15:51:21 -- accel/accel.sh@20 -- # read -r var val 00:07:32.998 15:51:22 -- accel/accel.sh@21 -- # val= 00:07:32.998 15:51:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.998 15:51:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.998 15:51:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.998 15:51:22 -- accel/accel.sh@21 -- # val= 00:07:32.998 15:51:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.998 15:51:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.998 15:51:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.998 15:51:22 -- accel/accel.sh@21 -- # val= 00:07:32.998 15:51:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.998 15:51:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.998 15:51:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.998 15:51:22 -- accel/accel.sh@21 -- # val= 00:07:32.998 15:51:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.998 15:51:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.998 15:51:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.998 15:51:22 -- accel/accel.sh@21 -- # val= 00:07:32.998 15:51:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.998 15:51:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.998 15:51:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.998 15:51:22 -- accel/accel.sh@21 -- # val= 00:07:32.998 15:51:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.998 15:51:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.998 15:51:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.998 15:51:22 -- accel/accel.sh@21 -- # val= 00:07:32.998 15:51:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.998 15:51:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.998 15:51:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.998 15:51:22 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:32.998 15:51:22 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:32.998 15:51:22 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:32.998 00:07:32.998 real 0m2.831s 00:07:32.998 user 0m2.527s 00:07:32.998 sys 0m0.296s 00:07:32.998 15:51:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:32.998 15:51:22 -- common/autotest_common.sh@10 -- # set +x 00:07:32.998 ************************************ 00:07:32.998 END TEST accel_decomp_mthread 00:07:32.998 ************************************ 00:07:32.998 15:51:22 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:32.998 15:51:22 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:07:32.998 15:51:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:32.998 15:51:22 -- common/autotest_common.sh@10 -- # set +x 00:07:32.998 ************************************ 00:07:32.998 START TEST accel_deomp_full_mthread 00:07:32.998 ************************************ 00:07:32.998 15:51:22 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:32.998 15:51:22 -- accel/accel.sh@16 -- # local accel_opc 00:07:32.998 15:51:22 -- accel/accel.sh@17 -- # local accel_module 00:07:32.998 15:51:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:32.998 15:51:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:32.998 15:51:22 -- accel/accel.sh@12 -- # build_accel_config 00:07:32.998 15:51:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:32.998 15:51:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:32.998 15:51:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:32.998 15:51:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:32.998 15:51:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:32.998 15:51:22 -- accel/accel.sh@41 -- # local IFS=, 00:07:32.998 15:51:22 -- accel/accel.sh@42 -- # jq -r . 00:07:32.998 [2024-10-30 15:51:22.456766] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:32.998 [2024-10-30 15:51:22.456848] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2311496 ] 00:07:32.998 EAL: No free 2048 kB hugepages reported on node 1 00:07:32.998 [2024-10-30 15:51:22.519324] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:32.998 [2024-10-30 15:51:22.609018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.395 15:51:23 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:34.395 00:07:34.395 SPDK Configuration: 00:07:34.395 Core mask: 0x1 00:07:34.395 00:07:34.395 Accel Perf Configuration: 00:07:34.395 Workload Type: decompress 00:07:34.395 Transfer size: 111250 bytes 00:07:34.395 Vector count 1 00:07:34.395 Module: software 00:07:34.395 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.395 Queue depth: 32 00:07:34.395 Allocate depth: 32 00:07:34.395 # threads/core: 2 00:07:34.395 Run time: 1 seconds 00:07:34.395 Verify: Yes 00:07:34.395 00:07:34.395 Running for 1 seconds... 00:07:34.395 00:07:34.395 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:34.395 ------------------------------------------------------------------------------------ 00:07:34.395 0,1 1952/s 80 MiB/s 0 0 00:07:34.395 0,0 1952/s 80 MiB/s 0 0 00:07:34.395 ==================================================================================== 00:07:34.395 Total 3904/s 414 MiB/s 0 0' 00:07:34.395 15:51:23 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:34.395 15:51:23 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:34.395 15:51:23 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.395 15:51:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:34.395 15:51:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.395 15:51:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.395 15:51:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:34.395 15:51:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:34.395 15:51:23 -- accel/accel.sh@41 -- # local IFS=, 00:07:34.395 15:51:23 -- accel/accel.sh@42 -- # jq -r . 00:07:34.395 [2024-10-30 15:51:23.873454] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:34.395 [2024-10-30 15:51:23.873534] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2311653 ] 00:07:34.395 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.395 [2024-10-30 15:51:23.936799] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:34.395 [2024-10-30 15:51:24.027205] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val= 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val= 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val= 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val=0x1 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val= 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val= 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val=decompress 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val= 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val=software 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@23 -- # accel_module=software 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val=32 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val=32 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val=2 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val=Yes 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val= 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:34.395 15:51:24 -- accel/accel.sh@21 -- # val= 00:07:34.395 15:51:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # IFS=: 00:07:34.395 15:51:24 -- accel/accel.sh@20 -- # read -r var val 00:07:35.768 15:51:25 -- accel/accel.sh@21 -- # val= 00:07:35.768 15:51:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.768 15:51:25 -- accel/accel.sh@20 -- # IFS=: 00:07:35.768 15:51:25 -- accel/accel.sh@20 -- # read -r var val 00:07:35.768 15:51:25 -- accel/accel.sh@21 -- # val= 00:07:35.768 15:51:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.768 15:51:25 -- accel/accel.sh@20 -- # IFS=: 00:07:35.768 15:51:25 -- accel/accel.sh@20 -- # read -r var val 00:07:35.768 15:51:25 -- accel/accel.sh@21 -- # val= 00:07:35.768 15:51:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.768 15:51:25 -- accel/accel.sh@20 -- # IFS=: 00:07:35.768 15:51:25 -- accel/accel.sh@20 -- # read -r var val 00:07:35.768 15:51:25 -- accel/accel.sh@21 -- # val= 00:07:35.768 15:51:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.768 15:51:25 -- accel/accel.sh@20 -- # IFS=: 00:07:35.768 15:51:25 -- accel/accel.sh@20 -- # read -r var val 00:07:35.768 15:51:25 -- accel/accel.sh@21 -- # val= 00:07:35.768 15:51:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.768 15:51:25 -- accel/accel.sh@20 -- # IFS=: 00:07:35.768 15:51:25 -- accel/accel.sh@20 -- # read -r var val 00:07:35.768 15:51:25 -- accel/accel.sh@21 -- # val= 00:07:35.768 15:51:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.768 15:51:25 -- accel/accel.sh@20 -- # IFS=: 00:07:35.768 15:51:25 -- accel/accel.sh@20 -- # read -r var val 00:07:35.768 15:51:25 -- accel/accel.sh@21 -- # val= 00:07:35.768 15:51:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.768 15:51:25 -- accel/accel.sh@20 -- # IFS=: 00:07:35.768 15:51:25 -- accel/accel.sh@20 -- # read -r var val 00:07:35.768 15:51:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:35.768 15:51:25 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:35.768 15:51:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:35.768 00:07:35.768 real 0m2.854s 00:07:35.768 user 0m2.549s 00:07:35.768 sys 0m0.299s 00:07:35.768 15:51:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:35.768 15:51:25 -- common/autotest_common.sh@10 -- # set +x 00:07:35.768 ************************************ 00:07:35.768 END TEST accel_deomp_full_mthread 00:07:35.768 ************************************ 00:07:35.768 15:51:25 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:35.768 15:51:25 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:35.768 15:51:25 -- accel/accel.sh@129 -- # build_accel_config 00:07:35.768 15:51:25 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:35.768 15:51:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:35.768 15:51:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:35.768 15:51:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:35.768 15:51:25 -- common/autotest_common.sh@10 -- # set +x 00:07:35.768 15:51:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:35.768 15:51:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:35.768 15:51:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:35.768 15:51:25 -- accel/accel.sh@41 -- # local IFS=, 00:07:35.768 15:51:25 -- accel/accel.sh@42 -- # jq -r . 00:07:35.768 ************************************ 00:07:35.768 START TEST accel_dif_functional_tests 00:07:35.768 ************************************ 00:07:35.768 15:51:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:35.768 [2024-10-30 15:51:25.355867] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:35.768 [2024-10-30 15:51:25.355964] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2311848 ] 00:07:35.768 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.768 [2024-10-30 15:51:25.417502] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:35.768 [2024-10-30 15:51:25.510306] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:35.768 [2024-10-30 15:51:25.510377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:35.768 [2024-10-30 15:51:25.510380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:35.768 00:07:35.768 00:07:35.768 CUnit - A unit testing framework for C - Version 2.1-3 00:07:35.768 http://cunit.sourceforge.net/ 00:07:35.768 00:07:35.768 00:07:35.768 Suite: accel_dif 00:07:35.768 Test: verify: DIF generated, GUARD check ...passed 00:07:35.768 Test: verify: DIF generated, APPTAG check ...passed 00:07:35.768 Test: verify: DIF generated, REFTAG check ...passed 00:07:35.768 Test: verify: DIF not generated, GUARD check ...[2024-10-30 15:51:25.604519] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:35.768 [2024-10-30 15:51:25.604615] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:35.768 passed 00:07:35.768 Test: verify: DIF not generated, APPTAG check ...[2024-10-30 15:51:25.604652] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:35.768 [2024-10-30 15:51:25.604677] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:35.768 passed 00:07:35.768 Test: verify: DIF not generated, REFTAG check ...[2024-10-30 15:51:25.604712] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:35.768 [2024-10-30 15:51:25.604735] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:35.768 passed 00:07:35.768 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:35.768 Test: verify: APPTAG incorrect, APPTAG check ...[2024-10-30 15:51:25.604794] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:35.768 passed 00:07:35.768 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:35.768 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:35.768 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:35.768 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-10-30 15:51:25.604922] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:35.768 passed 00:07:35.768 Test: generate copy: DIF generated, GUARD check ...passed 00:07:35.768 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:35.768 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:35.768 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:35.768 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:35.768 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:35.768 Test: generate copy: iovecs-len validate ...[2024-10-30 15:51:25.605157] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:35.768 passed 00:07:35.768 Test: generate copy: buffer alignment validate ...passed 00:07:35.768 00:07:35.768 Run Summary: Type Total Ran Passed Failed Inactive 00:07:35.768 suites 1 1 n/a 0 0 00:07:35.768 tests 20 20 20 0 0 00:07:35.768 asserts 204 204 204 0 n/a 00:07:35.768 00:07:35.768 Elapsed time = 0.000 seconds 00:07:36.025 00:07:36.025 real 0m0.497s 00:07:36.025 user 0m0.762s 00:07:36.025 sys 0m0.191s 00:07:36.025 15:51:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:36.025 15:51:25 -- common/autotest_common.sh@10 -- # set +x 00:07:36.025 ************************************ 00:07:36.025 END TEST accel_dif_functional_tests 00:07:36.025 ************************************ 00:07:36.025 00:07:36.025 real 0m59.710s 00:07:36.025 user 1m7.448s 00:07:36.025 sys 0m7.248s 00:07:36.025 15:51:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:36.025 15:51:25 -- common/autotest_common.sh@10 -- # set +x 00:07:36.025 ************************************ 00:07:36.025 END TEST accel 00:07:36.025 ************************************ 00:07:36.025 15:51:25 -- spdk/autotest.sh@190 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:36.025 15:51:25 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:36.025 15:51:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:36.025 15:51:25 -- common/autotest_common.sh@10 -- # set +x 00:07:36.025 ************************************ 00:07:36.025 START TEST accel_rpc 00:07:36.025 ************************************ 00:07:36.025 15:51:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:36.283 * Looking for test storage... 00:07:36.283 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:36.283 15:51:25 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:36.283 15:51:25 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=2311994 00:07:36.283 15:51:25 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:36.283 15:51:25 -- accel/accel_rpc.sh@15 -- # waitforlisten 2311994 00:07:36.283 15:51:25 -- common/autotest_common.sh@819 -- # '[' -z 2311994 ']' 00:07:36.283 15:51:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:36.283 15:51:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:36.283 15:51:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:36.283 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:36.283 15:51:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:36.283 15:51:25 -- common/autotest_common.sh@10 -- # set +x 00:07:36.283 [2024-10-30 15:51:25.966455] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:36.283 [2024-10-30 15:51:25.966549] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2311994 ] 00:07:36.283 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.283 [2024-10-30 15:51:26.024991] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:36.283 [2024-10-30 15:51:26.115646] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:36.283 [2024-10-30 15:51:26.115802] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:36.541 15:51:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:36.541 15:51:26 -- common/autotest_common.sh@852 -- # return 0 00:07:36.541 15:51:26 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:36.541 15:51:26 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:36.541 15:51:26 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:36.541 15:51:26 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:36.541 15:51:26 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:36.541 15:51:26 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:36.541 15:51:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:36.541 15:51:26 -- common/autotest_common.sh@10 -- # set +x 00:07:36.541 ************************************ 00:07:36.541 START TEST accel_assign_opcode 00:07:36.541 ************************************ 00:07:36.541 15:51:26 -- common/autotest_common.sh@1104 -- # accel_assign_opcode_test_suite 00:07:36.541 15:51:26 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:36.541 15:51:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:36.541 15:51:26 -- common/autotest_common.sh@10 -- # set +x 00:07:36.541 [2024-10-30 15:51:26.196376] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:36.541 15:51:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:36.541 15:51:26 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:36.541 15:51:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:36.541 15:51:26 -- common/autotest_common.sh@10 -- # set +x 00:07:36.541 [2024-10-30 15:51:26.204377] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:36.541 15:51:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:36.541 15:51:26 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:36.541 15:51:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:36.541 15:51:26 -- common/autotest_common.sh@10 -- # set +x 00:07:36.799 15:51:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:36.799 15:51:26 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:36.799 15:51:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:36.799 15:51:26 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:36.799 15:51:26 -- common/autotest_common.sh@10 -- # set +x 00:07:36.799 15:51:26 -- accel/accel_rpc.sh@42 -- # grep software 00:07:36.799 15:51:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:36.799 software 00:07:36.799 00:07:36.799 real 0m0.290s 00:07:36.799 user 0m0.036s 00:07:36.799 sys 0m0.007s 00:07:36.799 15:51:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:36.799 15:51:26 -- common/autotest_common.sh@10 -- # set +x 00:07:36.799 ************************************ 00:07:36.799 END TEST accel_assign_opcode 00:07:36.799 ************************************ 00:07:36.799 15:51:26 -- accel/accel_rpc.sh@55 -- # killprocess 2311994 00:07:36.799 15:51:26 -- common/autotest_common.sh@926 -- # '[' -z 2311994 ']' 00:07:36.799 15:51:26 -- common/autotest_common.sh@930 -- # kill -0 2311994 00:07:36.799 15:51:26 -- common/autotest_common.sh@931 -- # uname 00:07:36.799 15:51:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:36.799 15:51:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2311994 00:07:36.799 15:51:26 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:36.799 15:51:26 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:36.799 15:51:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2311994' 00:07:36.799 killing process with pid 2311994 00:07:36.799 15:51:26 -- common/autotest_common.sh@945 -- # kill 2311994 00:07:36.799 15:51:26 -- common/autotest_common.sh@950 -- # wait 2311994 00:07:37.366 00:07:37.366 real 0m1.085s 00:07:37.366 user 0m1.008s 00:07:37.366 sys 0m0.440s 00:07:37.366 15:51:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:37.366 15:51:26 -- common/autotest_common.sh@10 -- # set +x 00:07:37.366 ************************************ 00:07:37.366 END TEST accel_rpc 00:07:37.366 ************************************ 00:07:37.366 15:51:26 -- spdk/autotest.sh@191 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:37.366 15:51:26 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:37.366 15:51:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:37.366 15:51:26 -- common/autotest_common.sh@10 -- # set +x 00:07:37.366 ************************************ 00:07:37.366 START TEST app_cmdline 00:07:37.366 ************************************ 00:07:37.366 15:51:26 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:37.366 * Looking for test storage... 00:07:37.366 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:37.366 15:51:27 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:37.366 15:51:27 -- app/cmdline.sh@17 -- # spdk_tgt_pid=2312197 00:07:37.366 15:51:27 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:37.366 15:51:27 -- app/cmdline.sh@18 -- # waitforlisten 2312197 00:07:37.366 15:51:27 -- common/autotest_common.sh@819 -- # '[' -z 2312197 ']' 00:07:37.366 15:51:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:37.366 15:51:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:37.366 15:51:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:37.366 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:37.366 15:51:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:37.366 15:51:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.366 [2024-10-30 15:51:27.082463] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:37.366 [2024-10-30 15:51:27.082563] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2312197 ] 00:07:37.366 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.366 [2024-10-30 15:51:27.144165] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:37.366 [2024-10-30 15:51:27.231201] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:37.366 [2024-10-30 15:51:27.231406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:38.301 15:51:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:38.301 15:51:28 -- common/autotest_common.sh@852 -- # return 0 00:07:38.301 15:51:28 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:38.560 { 00:07:38.560 "version": "SPDK v24.01.1-pre git sha1 726a04d70", 00:07:38.560 "fields": { 00:07:38.560 "major": 24, 00:07:38.560 "minor": 1, 00:07:38.560 "patch": 1, 00:07:38.560 "suffix": "-pre", 00:07:38.560 "commit": "726a04d70" 00:07:38.560 } 00:07:38.560 } 00:07:38.560 15:51:28 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:38.560 15:51:28 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:38.560 15:51:28 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:38.560 15:51:28 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:38.560 15:51:28 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:38.560 15:51:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:38.560 15:51:28 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:38.560 15:51:28 -- app/cmdline.sh@26 -- # sort 00:07:38.560 15:51:28 -- common/autotest_common.sh@10 -- # set +x 00:07:38.560 15:51:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:38.560 15:51:28 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:38.560 15:51:28 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:38.560 15:51:28 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:38.560 15:51:28 -- common/autotest_common.sh@640 -- # local es=0 00:07:38.560 15:51:28 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:38.560 15:51:28 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:38.560 15:51:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:38.560 15:51:28 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:38.560 15:51:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:38.560 15:51:28 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:38.560 15:51:28 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:07:38.560 15:51:28 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:38.560 15:51:28 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:38.560 15:51:28 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:38.818 request: 00:07:38.818 { 00:07:38.818 "method": "env_dpdk_get_mem_stats", 00:07:38.818 "req_id": 1 00:07:38.818 } 00:07:38.818 Got JSON-RPC error response 00:07:38.818 response: 00:07:38.818 { 00:07:38.818 "code": -32601, 00:07:38.818 "message": "Method not found" 00:07:38.819 } 00:07:38.819 15:51:28 -- common/autotest_common.sh@643 -- # es=1 00:07:38.819 15:51:28 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:07:38.819 15:51:28 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:07:38.819 15:51:28 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:07:38.819 15:51:28 -- app/cmdline.sh@1 -- # killprocess 2312197 00:07:38.819 15:51:28 -- common/autotest_common.sh@926 -- # '[' -z 2312197 ']' 00:07:38.819 15:51:28 -- common/autotest_common.sh@930 -- # kill -0 2312197 00:07:38.819 15:51:28 -- common/autotest_common.sh@931 -- # uname 00:07:38.819 15:51:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:38.819 15:51:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2312197 00:07:38.819 15:51:28 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:38.819 15:51:28 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:38.819 15:51:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2312197' 00:07:38.819 killing process with pid 2312197 00:07:38.819 15:51:28 -- common/autotest_common.sh@945 -- # kill 2312197 00:07:38.819 15:51:28 -- common/autotest_common.sh@950 -- # wait 2312197 00:07:39.384 00:07:39.384 real 0m2.104s 00:07:39.384 user 0m2.692s 00:07:39.384 sys 0m0.518s 00:07:39.384 15:51:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:39.384 15:51:29 -- common/autotest_common.sh@10 -- # set +x 00:07:39.384 ************************************ 00:07:39.384 END TEST app_cmdline 00:07:39.384 ************************************ 00:07:39.384 15:51:29 -- spdk/autotest.sh@192 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:39.384 15:51:29 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:07:39.384 15:51:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:39.384 15:51:29 -- common/autotest_common.sh@10 -- # set +x 00:07:39.384 ************************************ 00:07:39.384 START TEST version 00:07:39.384 ************************************ 00:07:39.384 15:51:29 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:39.384 * Looking for test storage... 00:07:39.384 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:39.384 15:51:29 -- app/version.sh@17 -- # get_header_version major 00:07:39.384 15:51:29 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:39.384 15:51:29 -- app/version.sh@14 -- # cut -f2 00:07:39.384 15:51:29 -- app/version.sh@14 -- # tr -d '"' 00:07:39.384 15:51:29 -- app/version.sh@17 -- # major=24 00:07:39.384 15:51:29 -- app/version.sh@18 -- # get_header_version minor 00:07:39.384 15:51:29 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:39.384 15:51:29 -- app/version.sh@14 -- # cut -f2 00:07:39.384 15:51:29 -- app/version.sh@14 -- # tr -d '"' 00:07:39.384 15:51:29 -- app/version.sh@18 -- # minor=1 00:07:39.384 15:51:29 -- app/version.sh@19 -- # get_header_version patch 00:07:39.384 15:51:29 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:39.384 15:51:29 -- app/version.sh@14 -- # cut -f2 00:07:39.384 15:51:29 -- app/version.sh@14 -- # tr -d '"' 00:07:39.384 15:51:29 -- app/version.sh@19 -- # patch=1 00:07:39.385 15:51:29 -- app/version.sh@20 -- # get_header_version suffix 00:07:39.385 15:51:29 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:39.385 15:51:29 -- app/version.sh@14 -- # cut -f2 00:07:39.385 15:51:29 -- app/version.sh@14 -- # tr -d '"' 00:07:39.385 15:51:29 -- app/version.sh@20 -- # suffix=-pre 00:07:39.385 15:51:29 -- app/version.sh@22 -- # version=24.1 00:07:39.385 15:51:29 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:39.385 15:51:29 -- app/version.sh@25 -- # version=24.1.1 00:07:39.385 15:51:29 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:39.385 15:51:29 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:39.385 15:51:29 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:39.385 15:51:29 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:39.385 15:51:29 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:39.385 00:07:39.385 real 0m0.103s 00:07:39.385 user 0m0.051s 00:07:39.385 sys 0m0.075s 00:07:39.385 15:51:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:39.385 15:51:29 -- common/autotest_common.sh@10 -- # set +x 00:07:39.385 ************************************ 00:07:39.385 END TEST version 00:07:39.385 ************************************ 00:07:39.385 15:51:29 -- spdk/autotest.sh@194 -- # '[' 0 -eq 1 ']' 00:07:39.385 15:51:29 -- spdk/autotest.sh@204 -- # uname -s 00:07:39.385 15:51:29 -- spdk/autotest.sh@204 -- # [[ Linux == Linux ]] 00:07:39.385 15:51:29 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:07:39.385 15:51:29 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:07:39.385 15:51:29 -- spdk/autotest.sh@217 -- # '[' 0 -eq 1 ']' 00:07:39.385 15:51:29 -- spdk/autotest.sh@264 -- # '[' 0 -eq 1 ']' 00:07:39.385 15:51:29 -- spdk/autotest.sh@268 -- # timing_exit lib 00:07:39.385 15:51:29 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:39.385 15:51:29 -- common/autotest_common.sh@10 -- # set +x 00:07:39.385 15:51:29 -- spdk/autotest.sh@270 -- # '[' 0 -eq 1 ']' 00:07:39.385 15:51:29 -- spdk/autotest.sh@278 -- # '[' 0 -eq 1 ']' 00:07:39.385 15:51:29 -- spdk/autotest.sh@287 -- # '[' 1 -eq 1 ']' 00:07:39.385 15:51:29 -- spdk/autotest.sh@288 -- # export NET_TYPE 00:07:39.385 15:51:29 -- spdk/autotest.sh@291 -- # '[' tcp = rdma ']' 00:07:39.385 15:51:29 -- spdk/autotest.sh@294 -- # '[' tcp = tcp ']' 00:07:39.385 15:51:29 -- spdk/autotest.sh@295 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:39.385 15:51:29 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:39.385 15:51:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:39.385 15:51:29 -- common/autotest_common.sh@10 -- # set +x 00:07:39.385 ************************************ 00:07:39.385 START TEST nvmf_tcp 00:07:39.385 ************************************ 00:07:39.644 15:51:29 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:39.644 * Looking for test storage... 00:07:39.644 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:39.644 15:51:29 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:39.644 15:51:29 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:39.644 15:51:29 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:39.644 15:51:29 -- nvmf/common.sh@7 -- # uname -s 00:07:39.644 15:51:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:39.644 15:51:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:39.644 15:51:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:39.644 15:51:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:39.644 15:51:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:39.644 15:51:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:39.644 15:51:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:39.644 15:51:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:39.644 15:51:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:39.644 15:51:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:39.644 15:51:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:39.644 15:51:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:39.644 15:51:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:39.644 15:51:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:39.644 15:51:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:39.644 15:51:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:39.644 15:51:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:39.644 15:51:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:39.644 15:51:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:39.644 15:51:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.645 15:51:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.645 15:51:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.645 15:51:29 -- paths/export.sh@5 -- # export PATH 00:07:39.645 15:51:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.645 15:51:29 -- nvmf/common.sh@46 -- # : 0 00:07:39.645 15:51:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:39.645 15:51:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:39.645 15:51:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:39.645 15:51:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:39.645 15:51:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:39.645 15:51:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:39.645 15:51:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:39.645 15:51:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:39.645 15:51:29 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:39.645 15:51:29 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:39.645 15:51:29 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:39.645 15:51:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:39.645 15:51:29 -- common/autotest_common.sh@10 -- # set +x 00:07:39.645 15:51:29 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:39.645 15:51:29 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:39.645 15:51:29 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:39.645 15:51:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:39.645 15:51:29 -- common/autotest_common.sh@10 -- # set +x 00:07:39.645 ************************************ 00:07:39.645 START TEST nvmf_example 00:07:39.645 ************************************ 00:07:39.645 15:51:29 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:39.645 * Looking for test storage... 00:07:39.645 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:39.645 15:51:29 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:39.645 15:51:29 -- nvmf/common.sh@7 -- # uname -s 00:07:39.645 15:51:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:39.645 15:51:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:39.645 15:51:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:39.645 15:51:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:39.645 15:51:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:39.645 15:51:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:39.645 15:51:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:39.645 15:51:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:39.645 15:51:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:39.645 15:51:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:39.645 15:51:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:39.645 15:51:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:39.645 15:51:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:39.645 15:51:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:39.645 15:51:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:39.645 15:51:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:39.645 15:51:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:39.645 15:51:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:39.645 15:51:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:39.645 15:51:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.645 15:51:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.645 15:51:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.645 15:51:29 -- paths/export.sh@5 -- # export PATH 00:07:39.645 15:51:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.645 15:51:29 -- nvmf/common.sh@46 -- # : 0 00:07:39.645 15:51:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:39.645 15:51:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:39.645 15:51:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:39.645 15:51:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:39.645 15:51:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:39.645 15:51:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:39.645 15:51:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:39.645 15:51:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:39.645 15:51:29 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:39.645 15:51:29 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:39.645 15:51:29 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:39.645 15:51:29 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:39.645 15:51:29 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:39.645 15:51:29 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:39.645 15:51:29 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:39.645 15:51:29 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:39.645 15:51:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:39.645 15:51:29 -- common/autotest_common.sh@10 -- # set +x 00:07:39.645 15:51:29 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:39.645 15:51:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:39.645 15:51:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:39.645 15:51:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:39.645 15:51:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:39.645 15:51:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:39.645 15:51:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:39.645 15:51:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:39.645 15:51:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:39.645 15:51:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:39.645 15:51:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:39.645 15:51:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:39.645 15:51:29 -- common/autotest_common.sh@10 -- # set +x 00:07:41.569 15:51:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:41.569 15:51:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:41.569 15:51:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:41.569 15:51:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:41.569 15:51:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:41.569 15:51:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:41.569 15:51:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:41.569 15:51:31 -- nvmf/common.sh@294 -- # net_devs=() 00:07:41.569 15:51:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:41.569 15:51:31 -- nvmf/common.sh@295 -- # e810=() 00:07:41.569 15:51:31 -- nvmf/common.sh@295 -- # local -ga e810 00:07:41.569 15:51:31 -- nvmf/common.sh@296 -- # x722=() 00:07:41.569 15:51:31 -- nvmf/common.sh@296 -- # local -ga x722 00:07:41.569 15:51:31 -- nvmf/common.sh@297 -- # mlx=() 00:07:41.569 15:51:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:41.569 15:51:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:41.569 15:51:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:41.569 15:51:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:41.569 15:51:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:41.569 15:51:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:41.569 15:51:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:41.569 15:51:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:41.569 15:51:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:41.569 15:51:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:41.569 15:51:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:41.569 15:51:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:41.569 15:51:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:41.569 15:51:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:41.569 15:51:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:41.569 15:51:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:41.569 15:51:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:41.569 15:51:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:41.569 15:51:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:41.569 15:51:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:41.569 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:41.569 15:51:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:41.569 15:51:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:41.569 15:51:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:41.569 15:51:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:41.569 15:51:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:41.569 15:51:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:41.569 15:51:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:41.569 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:41.569 15:51:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:41.569 15:51:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:41.569 15:51:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:41.569 15:51:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:41.569 15:51:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:41.569 15:51:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:41.569 15:51:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:41.570 15:51:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:41.570 15:51:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:41.570 15:51:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:41.570 15:51:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:41.570 15:51:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:41.570 15:51:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:41.570 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:41.570 15:51:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:41.570 15:51:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:41.570 15:51:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:41.570 15:51:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:41.570 15:51:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:41.570 15:51:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:41.570 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:41.570 15:51:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:41.570 15:51:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:41.570 15:51:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:41.570 15:51:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:41.570 15:51:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:41.570 15:51:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:41.570 15:51:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:41.570 15:51:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:41.570 15:51:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:41.570 15:51:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:41.570 15:51:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:41.570 15:51:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:41.570 15:51:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:41.570 15:51:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:41.828 15:51:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:41.828 15:51:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:41.828 15:51:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:41.828 15:51:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:41.828 15:51:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:41.828 15:51:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:41.828 15:51:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:41.828 15:51:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:41.828 15:51:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:41.828 15:51:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:41.828 15:51:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:41.828 15:51:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:41.828 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:41.828 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.291 ms 00:07:41.828 00:07:41.828 --- 10.0.0.2 ping statistics --- 00:07:41.828 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:41.828 rtt min/avg/max/mdev = 0.291/0.291/0.291/0.000 ms 00:07:41.828 15:51:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:41.828 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:41.828 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:07:41.828 00:07:41.828 --- 10.0.0.1 ping statistics --- 00:07:41.828 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:41.828 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:07:41.828 15:51:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:41.828 15:51:31 -- nvmf/common.sh@410 -- # return 0 00:07:41.828 15:51:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:41.828 15:51:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:41.828 15:51:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:41.828 15:51:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:41.828 15:51:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:41.828 15:51:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:41.828 15:51:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:41.828 15:51:31 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:41.828 15:51:31 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:41.828 15:51:31 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:41.828 15:51:31 -- common/autotest_common.sh@10 -- # set +x 00:07:41.828 15:51:31 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:41.828 15:51:31 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:41.828 15:51:31 -- target/nvmf_example.sh@34 -- # nvmfpid=2314229 00:07:41.828 15:51:31 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:41.828 15:51:31 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:41.828 15:51:31 -- target/nvmf_example.sh@36 -- # waitforlisten 2314229 00:07:41.828 15:51:31 -- common/autotest_common.sh@819 -- # '[' -z 2314229 ']' 00:07:41.828 15:51:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:41.828 15:51:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:41.828 15:51:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:41.828 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:41.828 15:51:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:41.828 15:51:31 -- common/autotest_common.sh@10 -- # set +x 00:07:41.828 EAL: No free 2048 kB hugepages reported on node 1 00:07:42.085 15:51:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:42.085 15:51:31 -- common/autotest_common.sh@852 -- # return 0 00:07:42.085 15:51:31 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:42.085 15:51:31 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:42.085 15:51:31 -- common/autotest_common.sh@10 -- # set +x 00:07:42.085 15:51:31 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:42.085 15:51:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:42.085 15:51:31 -- common/autotest_common.sh@10 -- # set +x 00:07:42.085 15:51:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:42.085 15:51:31 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:42.085 15:51:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:42.085 15:51:31 -- common/autotest_common.sh@10 -- # set +x 00:07:42.085 15:51:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:42.085 15:51:31 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:42.085 15:51:31 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:42.085 15:51:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:42.085 15:51:31 -- common/autotest_common.sh@10 -- # set +x 00:07:42.085 15:51:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:42.085 15:51:31 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:42.085 15:51:31 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:42.085 15:51:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:42.085 15:51:31 -- common/autotest_common.sh@10 -- # set +x 00:07:42.085 15:51:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:42.085 15:51:31 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:42.085 15:51:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:42.085 15:51:31 -- common/autotest_common.sh@10 -- # set +x 00:07:42.085 15:51:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:42.085 15:51:31 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:42.085 15:51:31 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:42.341 EAL: No free 2048 kB hugepages reported on node 1 00:07:52.324 Initializing NVMe Controllers 00:07:52.324 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:07:52.324 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:07:52.324 Initialization complete. Launching workers. 00:07:52.324 ======================================================== 00:07:52.324 Latency(us) 00:07:52.324 Device Information : IOPS MiB/s Average min max 00:07:52.324 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15836.72 61.86 4041.64 865.61 15303.54 00:07:52.324 ======================================================== 00:07:52.324 Total : 15836.72 61.86 4041.64 865.61 15303.54 00:07:52.324 00:07:52.324 15:51:42 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:07:52.324 15:51:42 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:07:52.324 15:51:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:52.324 15:51:42 -- nvmf/common.sh@116 -- # sync 00:07:52.324 15:51:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:52.324 15:51:42 -- nvmf/common.sh@119 -- # set +e 00:07:52.324 15:51:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:52.324 15:51:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:52.324 rmmod nvme_tcp 00:07:52.324 rmmod nvme_fabrics 00:07:52.324 rmmod nvme_keyring 00:07:52.324 15:51:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:52.324 15:51:42 -- nvmf/common.sh@123 -- # set -e 00:07:52.324 15:51:42 -- nvmf/common.sh@124 -- # return 0 00:07:52.324 15:51:42 -- nvmf/common.sh@477 -- # '[' -n 2314229 ']' 00:07:52.324 15:51:42 -- nvmf/common.sh@478 -- # killprocess 2314229 00:07:52.324 15:51:42 -- common/autotest_common.sh@926 -- # '[' -z 2314229 ']' 00:07:52.324 15:51:42 -- common/autotest_common.sh@930 -- # kill -0 2314229 00:07:52.324 15:51:42 -- common/autotest_common.sh@931 -- # uname 00:07:52.324 15:51:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:52.324 15:51:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2314229 00:07:52.324 15:51:42 -- common/autotest_common.sh@932 -- # process_name=nvmf 00:07:52.324 15:51:42 -- common/autotest_common.sh@936 -- # '[' nvmf = sudo ']' 00:07:52.324 15:51:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2314229' 00:07:52.324 killing process with pid 2314229 00:07:52.583 15:51:42 -- common/autotest_common.sh@945 -- # kill 2314229 00:07:52.583 15:51:42 -- common/autotest_common.sh@950 -- # wait 2314229 00:07:52.583 nvmf threads initialize successfully 00:07:52.583 bdev subsystem init successfully 00:07:52.583 created a nvmf target service 00:07:52.583 create targets's poll groups done 00:07:52.583 all subsystems of target started 00:07:52.583 nvmf target is running 00:07:52.583 all subsystems of target stopped 00:07:52.583 destroy targets's poll groups done 00:07:52.583 destroyed the nvmf target service 00:07:52.583 bdev subsystem finish successfully 00:07:52.583 nvmf threads destroy successfully 00:07:52.583 15:51:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:52.584 15:51:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:52.584 15:51:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:52.584 15:51:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:52.584 15:51:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:52.584 15:51:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:52.584 15:51:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:52.584 15:51:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:55.122 15:51:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:55.122 15:51:44 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:07:55.122 15:51:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:55.122 15:51:44 -- common/autotest_common.sh@10 -- # set +x 00:07:55.122 00:07:55.122 real 0m15.144s 00:07:55.122 user 0m40.966s 00:07:55.122 sys 0m3.624s 00:07:55.122 15:51:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:55.122 15:51:44 -- common/autotest_common.sh@10 -- # set +x 00:07:55.122 ************************************ 00:07:55.122 END TEST nvmf_example 00:07:55.122 ************************************ 00:07:55.122 15:51:44 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:55.122 15:51:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:55.122 15:51:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:55.122 15:51:44 -- common/autotest_common.sh@10 -- # set +x 00:07:55.122 ************************************ 00:07:55.122 START TEST nvmf_filesystem 00:07:55.122 ************************************ 00:07:55.122 15:51:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:55.122 * Looking for test storage... 00:07:55.122 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:55.122 15:51:44 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:07:55.122 15:51:44 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:07:55.122 15:51:44 -- common/autotest_common.sh@34 -- # set -e 00:07:55.122 15:51:44 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:07:55.122 15:51:44 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:07:55.122 15:51:44 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:07:55.122 15:51:44 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:07:55.122 15:51:44 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:07:55.122 15:51:44 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:07:55.122 15:51:44 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:07:55.122 15:51:44 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:07:55.122 15:51:44 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:07:55.122 15:51:44 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:07:55.122 15:51:44 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:07:55.122 15:51:44 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:07:55.122 15:51:44 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:07:55.122 15:51:44 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:07:55.122 15:51:44 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:07:55.122 15:51:44 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:07:55.122 15:51:44 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:07:55.122 15:51:44 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:07:55.122 15:51:44 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:07:55.122 15:51:44 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:07:55.122 15:51:44 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:07:55.122 15:51:44 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:07:55.122 15:51:44 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:55.122 15:51:44 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:07:55.122 15:51:44 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:07:55.122 15:51:44 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:07:55.122 15:51:44 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:07:55.122 15:51:44 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:07:55.122 15:51:44 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:07:55.122 15:51:44 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:07:55.122 15:51:44 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:07:55.122 15:51:44 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:07:55.122 15:51:44 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:07:55.122 15:51:44 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:07:55.122 15:51:44 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:07:55.122 15:51:44 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:07:55.122 15:51:44 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:07:55.122 15:51:44 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:07:55.122 15:51:44 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:07:55.122 15:51:44 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:55.122 15:51:44 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:07:55.122 15:51:44 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:07:55.122 15:51:44 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:07:55.122 15:51:44 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:07:55.122 15:51:44 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:07:55.122 15:51:44 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:07:55.122 15:51:44 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:07:55.122 15:51:44 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:07:55.122 15:51:44 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:07:55.122 15:51:44 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:07:55.122 15:51:44 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:07:55.122 15:51:44 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:07:55.122 15:51:44 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:07:55.122 15:51:44 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:07:55.122 15:51:44 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:07:55.122 15:51:44 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:07:55.122 15:51:44 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:07:55.122 15:51:44 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:07:55.122 15:51:44 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:07:55.122 15:51:44 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:07:55.122 15:51:44 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:07:55.122 15:51:44 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:07:55.122 15:51:44 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:07:55.122 15:51:44 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:07:55.122 15:51:44 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:55.122 15:51:44 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:07:55.122 15:51:44 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:07:55.122 15:51:44 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:07:55.122 15:51:44 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:07:55.122 15:51:44 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:07:55.122 15:51:44 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:07:55.122 15:51:44 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:07:55.122 15:51:44 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:07:55.122 15:51:44 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:07:55.122 15:51:44 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:07:55.122 15:51:44 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:07:55.122 15:51:44 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:07:55.123 15:51:44 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:07:55.123 15:51:44 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:07:55.123 15:51:44 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:07:55.123 15:51:44 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:07:55.123 15:51:44 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:07:55.123 15:51:44 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:07:55.123 15:51:44 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:55.123 15:51:44 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:55.123 15:51:44 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:55.123 15:51:44 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:55.123 15:51:44 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:55.123 15:51:44 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:55.123 15:51:44 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:55.123 15:51:44 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:55.123 15:51:44 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:07:55.123 15:51:44 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:07:55.123 15:51:44 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:07:55.123 15:51:44 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:07:55.123 15:51:44 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:07:55.123 15:51:44 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:07:55.123 15:51:44 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:07:55.123 15:51:44 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:07:55.123 #define SPDK_CONFIG_H 00:07:55.123 #define SPDK_CONFIG_APPS 1 00:07:55.123 #define SPDK_CONFIG_ARCH native 00:07:55.123 #undef SPDK_CONFIG_ASAN 00:07:55.123 #undef SPDK_CONFIG_AVAHI 00:07:55.123 #undef SPDK_CONFIG_CET 00:07:55.123 #define SPDK_CONFIG_COVERAGE 1 00:07:55.123 #define SPDK_CONFIG_CROSS_PREFIX 00:07:55.123 #undef SPDK_CONFIG_CRYPTO 00:07:55.123 #undef SPDK_CONFIG_CRYPTO_MLX5 00:07:55.123 #undef SPDK_CONFIG_CUSTOMOCF 00:07:55.123 #undef SPDK_CONFIG_DAOS 00:07:55.123 #define SPDK_CONFIG_DAOS_DIR 00:07:55.123 #define SPDK_CONFIG_DEBUG 1 00:07:55.123 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:07:55.123 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:55.123 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:07:55.123 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:55.123 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:07:55.123 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:55.123 #define SPDK_CONFIG_EXAMPLES 1 00:07:55.123 #undef SPDK_CONFIG_FC 00:07:55.123 #define SPDK_CONFIG_FC_PATH 00:07:55.123 #define SPDK_CONFIG_FIO_PLUGIN 1 00:07:55.123 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:07:55.123 #undef SPDK_CONFIG_FUSE 00:07:55.123 #undef SPDK_CONFIG_FUZZER 00:07:55.123 #define SPDK_CONFIG_FUZZER_LIB 00:07:55.123 #undef SPDK_CONFIG_GOLANG 00:07:55.123 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:07:55.123 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:07:55.123 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:07:55.123 #undef SPDK_CONFIG_HAVE_LIBBSD 00:07:55.123 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:07:55.123 #define SPDK_CONFIG_IDXD 1 00:07:55.123 #define SPDK_CONFIG_IDXD_KERNEL 1 00:07:55.123 #undef SPDK_CONFIG_IPSEC_MB 00:07:55.123 #define SPDK_CONFIG_IPSEC_MB_DIR 00:07:55.123 #define SPDK_CONFIG_ISAL 1 00:07:55.123 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:07:55.123 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:07:55.123 #define SPDK_CONFIG_LIBDIR 00:07:55.123 #undef SPDK_CONFIG_LTO 00:07:55.123 #define SPDK_CONFIG_MAX_LCORES 00:07:55.123 #define SPDK_CONFIG_NVME_CUSE 1 00:07:55.123 #undef SPDK_CONFIG_OCF 00:07:55.123 #define SPDK_CONFIG_OCF_PATH 00:07:55.123 #define SPDK_CONFIG_OPENSSL_PATH 00:07:55.123 #undef SPDK_CONFIG_PGO_CAPTURE 00:07:55.123 #undef SPDK_CONFIG_PGO_USE 00:07:55.123 #define SPDK_CONFIG_PREFIX /usr/local 00:07:55.123 #undef SPDK_CONFIG_RAID5F 00:07:55.123 #undef SPDK_CONFIG_RBD 00:07:55.123 #define SPDK_CONFIG_RDMA 1 00:07:55.123 #define SPDK_CONFIG_RDMA_PROV verbs 00:07:55.123 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:07:55.123 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:07:55.123 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:07:55.123 #define SPDK_CONFIG_SHARED 1 00:07:55.123 #undef SPDK_CONFIG_SMA 00:07:55.123 #define SPDK_CONFIG_TESTS 1 00:07:55.123 #undef SPDK_CONFIG_TSAN 00:07:55.123 #define SPDK_CONFIG_UBLK 1 00:07:55.123 #define SPDK_CONFIG_UBSAN 1 00:07:55.123 #undef SPDK_CONFIG_UNIT_TESTS 00:07:55.123 #undef SPDK_CONFIG_URING 00:07:55.123 #define SPDK_CONFIG_URING_PATH 00:07:55.123 #undef SPDK_CONFIG_URING_ZNS 00:07:55.123 #undef SPDK_CONFIG_USDT 00:07:55.123 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:07:55.123 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:07:55.123 #define SPDK_CONFIG_VFIO_USER 1 00:07:55.123 #define SPDK_CONFIG_VFIO_USER_DIR 00:07:55.123 #define SPDK_CONFIG_VHOST 1 00:07:55.123 #define SPDK_CONFIG_VIRTIO 1 00:07:55.123 #undef SPDK_CONFIG_VTUNE 00:07:55.123 #define SPDK_CONFIG_VTUNE_DIR 00:07:55.123 #define SPDK_CONFIG_WERROR 1 00:07:55.123 #define SPDK_CONFIG_WPDK_DIR 00:07:55.123 #undef SPDK_CONFIG_XNVME 00:07:55.123 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:07:55.123 15:51:44 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:07:55.123 15:51:44 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:55.123 15:51:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:55.123 15:51:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:55.123 15:51:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:55.123 15:51:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.123 15:51:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.123 15:51:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.123 15:51:44 -- paths/export.sh@5 -- # export PATH 00:07:55.123 15:51:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.123 15:51:44 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:55.123 15:51:44 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:55.123 15:51:44 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:55.123 15:51:44 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:55.123 15:51:44 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:07:55.123 15:51:44 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:55.123 15:51:44 -- pm/common@16 -- # TEST_TAG=N/A 00:07:55.123 15:51:44 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:07:55.123 15:51:44 -- common/autotest_common.sh@52 -- # : 1 00:07:55.123 15:51:44 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:07:55.123 15:51:44 -- common/autotest_common.sh@56 -- # : 0 00:07:55.123 15:51:44 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:07:55.123 15:51:44 -- common/autotest_common.sh@58 -- # : 0 00:07:55.123 15:51:44 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:07:55.123 15:51:44 -- common/autotest_common.sh@60 -- # : 1 00:07:55.123 15:51:44 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:07:55.123 15:51:44 -- common/autotest_common.sh@62 -- # : 0 00:07:55.123 15:51:44 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:07:55.123 15:51:44 -- common/autotest_common.sh@64 -- # : 00:07:55.123 15:51:44 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:07:55.123 15:51:44 -- common/autotest_common.sh@66 -- # : 0 00:07:55.123 15:51:44 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:07:55.123 15:51:44 -- common/autotest_common.sh@68 -- # : 0 00:07:55.123 15:51:44 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:07:55.123 15:51:44 -- common/autotest_common.sh@70 -- # : 0 00:07:55.123 15:51:44 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:07:55.123 15:51:44 -- common/autotest_common.sh@72 -- # : 0 00:07:55.123 15:51:44 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:07:55.123 15:51:44 -- common/autotest_common.sh@74 -- # : 0 00:07:55.123 15:51:44 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:07:55.123 15:51:44 -- common/autotest_common.sh@76 -- # : 0 00:07:55.123 15:51:44 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:07:55.123 15:51:44 -- common/autotest_common.sh@78 -- # : 0 00:07:55.123 15:51:44 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:07:55.123 15:51:44 -- common/autotest_common.sh@80 -- # : 1 00:07:55.123 15:51:44 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:07:55.123 15:51:44 -- common/autotest_common.sh@82 -- # : 0 00:07:55.123 15:51:44 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:07:55.123 15:51:44 -- common/autotest_common.sh@84 -- # : 0 00:07:55.123 15:51:44 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:07:55.123 15:51:44 -- common/autotest_common.sh@86 -- # : 1 00:07:55.123 15:51:44 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:07:55.123 15:51:44 -- common/autotest_common.sh@88 -- # : 1 00:07:55.123 15:51:44 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:07:55.123 15:51:44 -- common/autotest_common.sh@90 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:07:55.124 15:51:44 -- common/autotest_common.sh@92 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:07:55.124 15:51:44 -- common/autotest_common.sh@94 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:07:55.124 15:51:44 -- common/autotest_common.sh@96 -- # : tcp 00:07:55.124 15:51:44 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:07:55.124 15:51:44 -- common/autotest_common.sh@98 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:07:55.124 15:51:44 -- common/autotest_common.sh@100 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:07:55.124 15:51:44 -- common/autotest_common.sh@102 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:07:55.124 15:51:44 -- common/autotest_common.sh@104 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:07:55.124 15:51:44 -- common/autotest_common.sh@106 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:07:55.124 15:51:44 -- common/autotest_common.sh@108 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:07:55.124 15:51:44 -- common/autotest_common.sh@110 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:07:55.124 15:51:44 -- common/autotest_common.sh@112 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:07:55.124 15:51:44 -- common/autotest_common.sh@114 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:07:55.124 15:51:44 -- common/autotest_common.sh@116 -- # : 1 00:07:55.124 15:51:44 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:07:55.124 15:51:44 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:55.124 15:51:44 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:07:55.124 15:51:44 -- common/autotest_common.sh@120 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:07:55.124 15:51:44 -- common/autotest_common.sh@122 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:07:55.124 15:51:44 -- common/autotest_common.sh@124 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:07:55.124 15:51:44 -- common/autotest_common.sh@126 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:07:55.124 15:51:44 -- common/autotest_common.sh@128 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:07:55.124 15:51:44 -- common/autotest_common.sh@130 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:07:55.124 15:51:44 -- common/autotest_common.sh@132 -- # : v23.11 00:07:55.124 15:51:44 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:07:55.124 15:51:44 -- common/autotest_common.sh@134 -- # : true 00:07:55.124 15:51:44 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:07:55.124 15:51:44 -- common/autotest_common.sh@136 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:07:55.124 15:51:44 -- common/autotest_common.sh@138 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:07:55.124 15:51:44 -- common/autotest_common.sh@140 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:07:55.124 15:51:44 -- common/autotest_common.sh@142 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:07:55.124 15:51:44 -- common/autotest_common.sh@144 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:07:55.124 15:51:44 -- common/autotest_common.sh@146 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:07:55.124 15:51:44 -- common/autotest_common.sh@148 -- # : e810 00:07:55.124 15:51:44 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:07:55.124 15:51:44 -- common/autotest_common.sh@150 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:07:55.124 15:51:44 -- common/autotest_common.sh@152 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:07:55.124 15:51:44 -- common/autotest_common.sh@154 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:07:55.124 15:51:44 -- common/autotest_common.sh@156 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:07:55.124 15:51:44 -- common/autotest_common.sh@158 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:07:55.124 15:51:44 -- common/autotest_common.sh@160 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:07:55.124 15:51:44 -- common/autotest_common.sh@163 -- # : 00:07:55.124 15:51:44 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:07:55.124 15:51:44 -- common/autotest_common.sh@165 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:07:55.124 15:51:44 -- common/autotest_common.sh@167 -- # : 0 00:07:55.124 15:51:44 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:07:55.124 15:51:44 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:55.124 15:51:44 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:55.124 15:51:44 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:55.124 15:51:44 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:55.124 15:51:44 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:55.124 15:51:44 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:55.124 15:51:44 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:55.124 15:51:44 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:55.124 15:51:44 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:07:55.124 15:51:44 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:07:55.124 15:51:44 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:55.124 15:51:44 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:55.124 15:51:44 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:07:55.124 15:51:44 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:07:55.124 15:51:44 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:55.124 15:51:44 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:55.124 15:51:44 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:55.124 15:51:44 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:55.124 15:51:44 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:07:55.124 15:51:44 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:07:55.124 15:51:44 -- common/autotest_common.sh@196 -- # cat 00:07:55.124 15:51:44 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:07:55.124 15:51:44 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:55.124 15:51:44 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:55.124 15:51:44 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:55.124 15:51:44 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:55.124 15:51:44 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:07:55.124 15:51:44 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:07:55.124 15:51:44 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:55.124 15:51:44 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:55.124 15:51:44 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:55.124 15:51:44 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:55.124 15:51:44 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:55.124 15:51:44 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:55.124 15:51:44 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:55.124 15:51:44 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:55.124 15:51:44 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:55.124 15:51:44 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:55.124 15:51:44 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:55.124 15:51:44 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:55.124 15:51:44 -- common/autotest_common.sh@248 -- # '[' 0 -eq 0 ']' 00:07:55.124 15:51:44 -- common/autotest_common.sh@249 -- # export valgrind= 00:07:55.124 15:51:44 -- common/autotest_common.sh@249 -- # valgrind= 00:07:55.125 15:51:44 -- common/autotest_common.sh@255 -- # uname -s 00:07:55.125 15:51:44 -- common/autotest_common.sh@255 -- # '[' Linux = Linux ']' 00:07:55.125 15:51:44 -- common/autotest_common.sh@256 -- # HUGEMEM=4096 00:07:55.125 15:51:44 -- common/autotest_common.sh@257 -- # export CLEAR_HUGE=yes 00:07:55.125 15:51:44 -- common/autotest_common.sh@257 -- # CLEAR_HUGE=yes 00:07:55.125 15:51:44 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:07:55.125 15:51:44 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:07:55.125 15:51:44 -- common/autotest_common.sh@265 -- # MAKE=make 00:07:55.125 15:51:44 -- common/autotest_common.sh@266 -- # MAKEFLAGS=-j48 00:07:55.125 15:51:44 -- common/autotest_common.sh@282 -- # export HUGEMEM=4096 00:07:55.125 15:51:44 -- common/autotest_common.sh@282 -- # HUGEMEM=4096 00:07:55.125 15:51:44 -- common/autotest_common.sh@284 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:07:55.125 15:51:44 -- common/autotest_common.sh@289 -- # NO_HUGE=() 00:07:55.125 15:51:44 -- common/autotest_common.sh@290 -- # TEST_MODE= 00:07:55.125 15:51:44 -- common/autotest_common.sh@291 -- # for i in "$@" 00:07:55.125 15:51:44 -- common/autotest_common.sh@292 -- # case "$i" in 00:07:55.125 15:51:44 -- common/autotest_common.sh@297 -- # TEST_TRANSPORT=tcp 00:07:55.125 15:51:44 -- common/autotest_common.sh@309 -- # [[ -z 2315850 ]] 00:07:55.125 15:51:44 -- common/autotest_common.sh@309 -- # kill -0 2315850 00:07:55.125 15:51:44 -- common/autotest_common.sh@1665 -- # set_test_storage 2147483648 00:07:55.125 15:51:44 -- common/autotest_common.sh@319 -- # [[ -v testdir ]] 00:07:55.125 15:51:44 -- common/autotest_common.sh@321 -- # local requested_size=2147483648 00:07:55.125 15:51:44 -- common/autotest_common.sh@322 -- # local mount target_dir 00:07:55.125 15:51:44 -- common/autotest_common.sh@324 -- # local -A mounts fss sizes avails uses 00:07:55.125 15:51:44 -- common/autotest_common.sh@325 -- # local source fs size avail mount use 00:07:55.125 15:51:44 -- common/autotest_common.sh@327 -- # local storage_fallback storage_candidates 00:07:55.125 15:51:44 -- common/autotest_common.sh@329 -- # mktemp -udt spdk.XXXXXX 00:07:55.125 15:51:44 -- common/autotest_common.sh@329 -- # storage_fallback=/tmp/spdk.FPlR89 00:07:55.125 15:51:44 -- common/autotest_common.sh@334 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:07:55.125 15:51:44 -- common/autotest_common.sh@336 -- # [[ -n '' ]] 00:07:55.125 15:51:44 -- common/autotest_common.sh@341 -- # [[ -n '' ]] 00:07:55.125 15:51:44 -- common/autotest_common.sh@346 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.FPlR89/tests/target /tmp/spdk.FPlR89 00:07:55.125 15:51:44 -- common/autotest_common.sh@349 -- # requested_size=2214592512 00:07:55.125 15:51:44 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:55.125 15:51:44 -- common/autotest_common.sh@318 -- # df -T 00:07:55.125 15:51:44 -- common/autotest_common.sh@318 -- # grep -v Filesystem 00:07:55.125 15:51:44 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_devtmpfs 00:07:55.125 15:51:44 -- common/autotest_common.sh@352 -- # fss["$mount"]=devtmpfs 00:07:55.125 15:51:44 -- common/autotest_common.sh@353 -- # avails["$mount"]=67108864 00:07:55.125 15:51:44 -- common/autotest_common.sh@353 -- # sizes["$mount"]=67108864 00:07:55.125 15:51:44 -- common/autotest_common.sh@354 -- # uses["$mount"]=0 00:07:55.125 15:51:44 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:55.125 15:51:44 -- common/autotest_common.sh@352 -- # mounts["$mount"]=/dev/pmem0 00:07:55.125 15:51:44 -- common/autotest_common.sh@352 -- # fss["$mount"]=ext2 00:07:55.125 15:51:44 -- common/autotest_common.sh@353 -- # avails["$mount"]=4096 00:07:55.125 15:51:44 -- common/autotest_common.sh@353 -- # sizes["$mount"]=5284429824 00:07:55.125 15:51:44 -- common/autotest_common.sh@354 -- # uses["$mount"]=5284425728 00:07:55.125 15:51:44 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:55.125 15:51:44 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_root 00:07:55.125 15:51:44 -- common/autotest_common.sh@352 -- # fss["$mount"]=overlay 00:07:55.125 15:51:44 -- common/autotest_common.sh@353 -- # avails["$mount"]=53142142976 00:07:55.125 15:51:44 -- common/autotest_common.sh@353 -- # sizes["$mount"]=61988528128 00:07:55.125 15:51:44 -- common/autotest_common.sh@354 -- # uses["$mount"]=8846385152 00:07:55.125 15:51:44 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:55.125 15:51:44 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:07:55.125 15:51:44 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:07:55.125 15:51:44 -- common/autotest_common.sh@353 -- # avails["$mount"]=30993006592 00:07:55.125 15:51:44 -- common/autotest_common.sh@353 -- # sizes["$mount"]=30994264064 00:07:55.125 15:51:44 -- common/autotest_common.sh@354 -- # uses["$mount"]=1257472 00:07:55.125 15:51:44 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:55.125 15:51:44 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:07:55.125 15:51:44 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:07:55.125 15:51:44 -- common/autotest_common.sh@353 -- # avails["$mount"]=12388921344 00:07:55.125 15:51:44 -- common/autotest_common.sh@353 -- # sizes["$mount"]=12397707264 00:07:55.125 15:51:44 -- common/autotest_common.sh@354 -- # uses["$mount"]=8785920 00:07:55.125 15:51:44 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:55.125 15:51:44 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:07:55.125 15:51:44 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:07:55.125 15:51:44 -- common/autotest_common.sh@353 -- # avails["$mount"]=30993842176 00:07:55.125 15:51:44 -- common/autotest_common.sh@353 -- # sizes["$mount"]=30994264064 00:07:55.125 15:51:44 -- common/autotest_common.sh@354 -- # uses["$mount"]=421888 00:07:55.125 15:51:44 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:55.125 15:51:44 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:07:55.125 15:51:44 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:07:55.125 15:51:44 -- common/autotest_common.sh@353 -- # avails["$mount"]=6198837248 00:07:55.125 15:51:44 -- common/autotest_common.sh@353 -- # sizes["$mount"]=6198849536 00:07:55.125 15:51:44 -- common/autotest_common.sh@354 -- # uses["$mount"]=12288 00:07:55.125 15:51:44 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:07:55.125 15:51:44 -- common/autotest_common.sh@357 -- # printf '* Looking for test storage...\n' 00:07:55.125 * Looking for test storage... 00:07:55.125 15:51:44 -- common/autotest_common.sh@359 -- # local target_space new_size 00:07:55.125 15:51:44 -- common/autotest_common.sh@360 -- # for target_dir in "${storage_candidates[@]}" 00:07:55.125 15:51:44 -- common/autotest_common.sh@363 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:55.125 15:51:44 -- common/autotest_common.sh@363 -- # awk '$1 !~ /Filesystem/{print $6}' 00:07:55.125 15:51:44 -- common/autotest_common.sh@363 -- # mount=/ 00:07:55.125 15:51:44 -- common/autotest_common.sh@365 -- # target_space=53142142976 00:07:55.125 15:51:44 -- common/autotest_common.sh@366 -- # (( target_space == 0 || target_space < requested_size )) 00:07:55.125 15:51:44 -- common/autotest_common.sh@369 -- # (( target_space >= requested_size )) 00:07:55.125 15:51:44 -- common/autotest_common.sh@371 -- # [[ overlay == tmpfs ]] 00:07:55.125 15:51:44 -- common/autotest_common.sh@371 -- # [[ overlay == ramfs ]] 00:07:55.125 15:51:44 -- common/autotest_common.sh@371 -- # [[ / == / ]] 00:07:55.125 15:51:44 -- common/autotest_common.sh@372 -- # new_size=11060977664 00:07:55.125 15:51:44 -- common/autotest_common.sh@373 -- # (( new_size * 100 / sizes[/] > 95 )) 00:07:55.125 15:51:44 -- common/autotest_common.sh@378 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:55.125 15:51:44 -- common/autotest_common.sh@378 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:55.125 15:51:44 -- common/autotest_common.sh@379 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:55.125 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:55.125 15:51:44 -- common/autotest_common.sh@380 -- # return 0 00:07:55.125 15:51:44 -- common/autotest_common.sh@1667 -- # set -o errtrace 00:07:55.125 15:51:44 -- common/autotest_common.sh@1668 -- # shopt -s extdebug 00:07:55.125 15:51:44 -- common/autotest_common.sh@1669 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:07:55.125 15:51:44 -- common/autotest_common.sh@1671 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:07:55.125 15:51:44 -- common/autotest_common.sh@1672 -- # true 00:07:55.125 15:51:44 -- common/autotest_common.sh@1674 -- # xtrace_fd 00:07:55.125 15:51:44 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:07:55.125 15:51:44 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:07:55.125 15:51:44 -- common/autotest_common.sh@27 -- # exec 00:07:55.125 15:51:44 -- common/autotest_common.sh@29 -- # exec 00:07:55.125 15:51:44 -- common/autotest_common.sh@31 -- # xtrace_restore 00:07:55.125 15:51:44 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:07:55.125 15:51:44 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:07:55.125 15:51:44 -- common/autotest_common.sh@18 -- # set -x 00:07:55.125 15:51:44 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:55.125 15:51:44 -- nvmf/common.sh@7 -- # uname -s 00:07:55.125 15:51:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:55.125 15:51:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:55.125 15:51:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:55.125 15:51:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:55.125 15:51:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:55.125 15:51:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:55.125 15:51:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:55.125 15:51:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:55.125 15:51:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:55.125 15:51:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:55.125 15:51:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:55.125 15:51:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:55.125 15:51:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:55.125 15:51:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:55.125 15:51:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:55.125 15:51:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:55.125 15:51:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:55.125 15:51:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:55.125 15:51:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:55.125 15:51:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.125 15:51:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.126 15:51:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.126 15:51:44 -- paths/export.sh@5 -- # export PATH 00:07:55.126 15:51:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:55.126 15:51:44 -- nvmf/common.sh@46 -- # : 0 00:07:55.126 15:51:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:55.126 15:51:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:55.126 15:51:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:55.126 15:51:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:55.126 15:51:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:55.126 15:51:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:55.126 15:51:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:55.126 15:51:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:55.126 15:51:44 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:07:55.126 15:51:44 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:07:55.126 15:51:44 -- target/filesystem.sh@15 -- # nvmftestinit 00:07:55.126 15:51:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:55.126 15:51:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:55.126 15:51:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:55.126 15:51:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:55.126 15:51:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:55.126 15:51:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:55.126 15:51:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:55.126 15:51:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:55.126 15:51:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:55.126 15:51:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:55.126 15:51:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:55.126 15:51:44 -- common/autotest_common.sh@10 -- # set +x 00:07:57.028 15:51:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:57.028 15:51:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:57.028 15:51:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:57.028 15:51:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:57.028 15:51:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:57.028 15:51:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:57.028 15:51:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:57.028 15:51:46 -- nvmf/common.sh@294 -- # net_devs=() 00:07:57.028 15:51:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:57.028 15:51:46 -- nvmf/common.sh@295 -- # e810=() 00:07:57.028 15:51:46 -- nvmf/common.sh@295 -- # local -ga e810 00:07:57.028 15:51:46 -- nvmf/common.sh@296 -- # x722=() 00:07:57.028 15:51:46 -- nvmf/common.sh@296 -- # local -ga x722 00:07:57.028 15:51:46 -- nvmf/common.sh@297 -- # mlx=() 00:07:57.028 15:51:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:57.028 15:51:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:57.028 15:51:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:57.028 15:51:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:57.028 15:51:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:57.028 15:51:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:57.028 15:51:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:57.028 15:51:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:57.028 15:51:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:57.028 15:51:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:57.028 15:51:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:57.028 15:51:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:57.028 15:51:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:57.029 15:51:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:57.029 15:51:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:57.029 15:51:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:57.029 15:51:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:57.029 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:57.029 15:51:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:57.029 15:51:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:57.029 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:57.029 15:51:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:57.029 15:51:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:57.029 15:51:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:57.029 15:51:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:57.029 15:51:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:57.029 15:51:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:57.029 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:57.029 15:51:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:57.029 15:51:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:57.029 15:51:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:57.029 15:51:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:57.029 15:51:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:57.029 15:51:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:57.029 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:57.029 15:51:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:57.029 15:51:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:57.029 15:51:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:57.029 15:51:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:57.029 15:51:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:57.029 15:51:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:57.029 15:51:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:57.029 15:51:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:57.029 15:51:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:57.029 15:51:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:57.029 15:51:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:57.029 15:51:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:57.029 15:51:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:57.029 15:51:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:57.029 15:51:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:57.029 15:51:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:57.029 15:51:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:57.029 15:51:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:57.029 15:51:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:57.029 15:51:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:57.029 15:51:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:57.029 15:51:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:57.029 15:51:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:57.029 15:51:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:57.029 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:57.029 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:07:57.029 00:07:57.029 --- 10.0.0.2 ping statistics --- 00:07:57.029 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:57.029 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:07:57.029 15:51:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:57.029 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:57.029 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:07:57.029 00:07:57.029 --- 10.0.0.1 ping statistics --- 00:07:57.029 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:57.029 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:07:57.029 15:51:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:57.029 15:51:46 -- nvmf/common.sh@410 -- # return 0 00:07:57.029 15:51:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:57.029 15:51:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:57.029 15:51:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:57.029 15:51:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:57.029 15:51:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:57.029 15:51:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:57.029 15:51:46 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:57.029 15:51:46 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:57.029 15:51:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:57.029 15:51:46 -- common/autotest_common.sh@10 -- # set +x 00:07:57.029 ************************************ 00:07:57.029 START TEST nvmf_filesystem_no_in_capsule 00:07:57.029 ************************************ 00:07:57.029 15:51:46 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 0 00:07:57.029 15:51:46 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:57.029 15:51:46 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:57.029 15:51:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:57.029 15:51:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:57.029 15:51:46 -- common/autotest_common.sh@10 -- # set +x 00:07:57.029 15:51:46 -- nvmf/common.sh@469 -- # nvmfpid=2317475 00:07:57.029 15:51:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:57.029 15:51:46 -- nvmf/common.sh@470 -- # waitforlisten 2317475 00:07:57.029 15:51:46 -- common/autotest_common.sh@819 -- # '[' -z 2317475 ']' 00:07:57.029 15:51:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:57.029 15:51:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:57.029 15:51:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:57.029 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:57.029 15:51:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:57.029 15:51:46 -- common/autotest_common.sh@10 -- # set +x 00:07:57.029 [2024-10-30 15:51:46.775785] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:07:57.029 [2024-10-30 15:51:46.775848] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:57.029 EAL: No free 2048 kB hugepages reported on node 1 00:07:57.029 [2024-10-30 15:51:46.843806] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:57.288 [2024-10-30 15:51:46.935763] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:57.288 [2024-10-30 15:51:46.935931] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:57.288 [2024-10-30 15:51:46.935948] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:57.288 [2024-10-30 15:51:46.935961] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:57.288 [2024-10-30 15:51:46.936030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:57.288 [2024-10-30 15:51:46.939277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:57.288 [2024-10-30 15:51:46.939352] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:57.288 [2024-10-30 15:51:46.939357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:58.221 15:51:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:58.221 15:51:47 -- common/autotest_common.sh@852 -- # return 0 00:07:58.221 15:51:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:58.221 15:51:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:58.221 15:51:47 -- common/autotest_common.sh@10 -- # set +x 00:07:58.221 15:51:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:58.221 15:51:47 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:58.221 15:51:47 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:58.221 15:51:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:58.221 15:51:47 -- common/autotest_common.sh@10 -- # set +x 00:07:58.221 [2024-10-30 15:51:47.831103] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:58.221 15:51:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:58.221 15:51:47 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:58.221 15:51:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:58.221 15:51:47 -- common/autotest_common.sh@10 -- # set +x 00:07:58.221 Malloc1 00:07:58.221 15:51:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:58.221 15:51:47 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:58.221 15:51:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:58.221 15:51:47 -- common/autotest_common.sh@10 -- # set +x 00:07:58.221 15:51:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:58.221 15:51:48 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:58.221 15:51:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:58.221 15:51:48 -- common/autotest_common.sh@10 -- # set +x 00:07:58.221 15:51:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:58.221 15:51:48 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:58.221 15:51:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:58.221 15:51:48 -- common/autotest_common.sh@10 -- # set +x 00:07:58.221 [2024-10-30 15:51:48.017209] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:58.221 15:51:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:58.221 15:51:48 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:58.221 15:51:48 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:07:58.221 15:51:48 -- common/autotest_common.sh@1358 -- # local bdev_info 00:07:58.221 15:51:48 -- common/autotest_common.sh@1359 -- # local bs 00:07:58.221 15:51:48 -- common/autotest_common.sh@1360 -- # local nb 00:07:58.221 15:51:48 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:58.221 15:51:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:58.221 15:51:48 -- common/autotest_common.sh@10 -- # set +x 00:07:58.221 15:51:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:58.221 15:51:48 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:07:58.221 { 00:07:58.221 "name": "Malloc1", 00:07:58.222 "aliases": [ 00:07:58.222 "108085af-e274-48bb-b1b8-fd6efb9317f0" 00:07:58.222 ], 00:07:58.222 "product_name": "Malloc disk", 00:07:58.222 "block_size": 512, 00:07:58.222 "num_blocks": 1048576, 00:07:58.222 "uuid": "108085af-e274-48bb-b1b8-fd6efb9317f0", 00:07:58.222 "assigned_rate_limits": { 00:07:58.222 "rw_ios_per_sec": 0, 00:07:58.222 "rw_mbytes_per_sec": 0, 00:07:58.222 "r_mbytes_per_sec": 0, 00:07:58.222 "w_mbytes_per_sec": 0 00:07:58.222 }, 00:07:58.222 "claimed": true, 00:07:58.222 "claim_type": "exclusive_write", 00:07:58.222 "zoned": false, 00:07:58.222 "supported_io_types": { 00:07:58.222 "read": true, 00:07:58.222 "write": true, 00:07:58.222 "unmap": true, 00:07:58.222 "write_zeroes": true, 00:07:58.222 "flush": true, 00:07:58.222 "reset": true, 00:07:58.222 "compare": false, 00:07:58.222 "compare_and_write": false, 00:07:58.222 "abort": true, 00:07:58.222 "nvme_admin": false, 00:07:58.222 "nvme_io": false 00:07:58.222 }, 00:07:58.222 "memory_domains": [ 00:07:58.222 { 00:07:58.222 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:58.222 "dma_device_type": 2 00:07:58.222 } 00:07:58.222 ], 00:07:58.222 "driver_specific": {} 00:07:58.222 } 00:07:58.222 ]' 00:07:58.222 15:51:48 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:07:58.222 15:51:48 -- common/autotest_common.sh@1362 -- # bs=512 00:07:58.222 15:51:48 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:07:58.480 15:51:48 -- common/autotest_common.sh@1363 -- # nb=1048576 00:07:58.480 15:51:48 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:07:58.480 15:51:48 -- common/autotest_common.sh@1367 -- # echo 512 00:07:58.480 15:51:48 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:58.480 15:51:48 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:59.044 15:51:48 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:59.044 15:51:48 -- common/autotest_common.sh@1177 -- # local i=0 00:07:59.044 15:51:48 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:07:59.044 15:51:48 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:07:59.044 15:51:48 -- common/autotest_common.sh@1184 -- # sleep 2 00:08:00.941 15:51:50 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:08:00.942 15:51:50 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:08:00.942 15:51:50 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:08:00.942 15:51:50 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:08:00.942 15:51:50 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:08:00.942 15:51:50 -- common/autotest_common.sh@1187 -- # return 0 00:08:00.942 15:51:50 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:00.942 15:51:50 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:00.942 15:51:50 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:00.942 15:51:50 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:00.942 15:51:50 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:00.942 15:51:50 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:00.942 15:51:50 -- setup/common.sh@80 -- # echo 536870912 00:08:00.942 15:51:50 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:00.942 15:51:50 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:00.942 15:51:50 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:00.942 15:51:50 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:01.199 15:51:51 -- target/filesystem.sh@69 -- # partprobe 00:08:01.762 15:51:51 -- target/filesystem.sh@70 -- # sleep 1 00:08:03.134 15:51:52 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:03.134 15:51:52 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:03.134 15:51:52 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:03.134 15:51:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:03.134 15:51:52 -- common/autotest_common.sh@10 -- # set +x 00:08:03.134 ************************************ 00:08:03.134 START TEST filesystem_ext4 00:08:03.134 ************************************ 00:08:03.134 15:51:52 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:03.134 15:51:52 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:03.134 15:51:52 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:03.134 15:51:52 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:03.134 15:51:52 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:08:03.134 15:51:52 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:03.134 15:51:52 -- common/autotest_common.sh@904 -- # local i=0 00:08:03.134 15:51:52 -- common/autotest_common.sh@905 -- # local force 00:08:03.134 15:51:52 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:08:03.134 15:51:52 -- common/autotest_common.sh@908 -- # force=-F 00:08:03.134 15:51:52 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:03.134 mke2fs 1.47.0 (5-Feb-2023) 00:08:03.134 Discarding device blocks: 0/522240 done 00:08:03.134 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:03.134 Filesystem UUID: 18354b51-e508-4bae-b11a-c4a7541a43d5 00:08:03.134 Superblock backups stored on blocks: 00:08:03.134 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:03.134 00:08:03.134 Allocating group tables: 0/64 done 00:08:03.134 Writing inode tables: 0/64 done 00:08:03.392 Creating journal (8192 blocks): done 00:08:04.471 Writing superblocks and filesystem accounting information: 0/64 8/64 done 00:08:04.471 00:08:04.471 15:51:54 -- common/autotest_common.sh@921 -- # return 0 00:08:04.471 15:51:54 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:09.733 15:51:59 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:09.733 15:51:59 -- target/filesystem.sh@25 -- # sync 00:08:09.733 15:51:59 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:09.733 15:51:59 -- target/filesystem.sh@27 -- # sync 00:08:09.733 15:51:59 -- target/filesystem.sh@29 -- # i=0 00:08:09.733 15:51:59 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:09.733 15:51:59 -- target/filesystem.sh@37 -- # kill -0 2317475 00:08:09.733 15:51:59 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:09.733 15:51:59 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:09.733 15:51:59 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:09.733 15:51:59 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:09.733 00:08:09.733 real 0m6.940s 00:08:09.733 user 0m0.015s 00:08:09.733 sys 0m0.060s 00:08:09.733 15:51:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:09.733 15:51:59 -- common/autotest_common.sh@10 -- # set +x 00:08:09.733 ************************************ 00:08:09.733 END TEST filesystem_ext4 00:08:09.733 ************************************ 00:08:09.733 15:51:59 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:09.733 15:51:59 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:09.733 15:51:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:09.733 15:51:59 -- common/autotest_common.sh@10 -- # set +x 00:08:09.733 ************************************ 00:08:09.733 START TEST filesystem_btrfs 00:08:09.733 ************************************ 00:08:09.733 15:51:59 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:09.733 15:51:59 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:09.733 15:51:59 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:09.733 15:51:59 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:09.733 15:51:59 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:08:09.733 15:51:59 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:09.733 15:51:59 -- common/autotest_common.sh@904 -- # local i=0 00:08:09.733 15:51:59 -- common/autotest_common.sh@905 -- # local force 00:08:09.733 15:51:59 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:08:09.733 15:51:59 -- common/autotest_common.sh@910 -- # force=-f 00:08:09.733 15:51:59 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:09.991 btrfs-progs v6.8.1 00:08:09.991 See https://btrfs.readthedocs.io for more information. 00:08:09.991 00:08:09.991 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:09.991 NOTE: several default settings have changed in version 5.15, please make sure 00:08:09.991 this does not affect your deployments: 00:08:09.991 - DUP for metadata (-m dup) 00:08:09.991 - enabled no-holes (-O no-holes) 00:08:09.991 - enabled free-space-tree (-R free-space-tree) 00:08:09.991 00:08:09.991 Label: (null) 00:08:09.991 UUID: 91f40343-143c-4733-b814-c75a8a9b6176 00:08:09.991 Node size: 16384 00:08:09.991 Sector size: 4096 (CPU page size: 4096) 00:08:09.991 Filesystem size: 510.00MiB 00:08:09.991 Block group profiles: 00:08:09.991 Data: single 8.00MiB 00:08:09.991 Metadata: DUP 32.00MiB 00:08:09.991 System: DUP 8.00MiB 00:08:09.991 SSD detected: yes 00:08:09.991 Zoned device: no 00:08:09.991 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:09.991 Checksum: crc32c 00:08:09.991 Number of devices: 1 00:08:09.991 Devices: 00:08:09.991 ID SIZE PATH 00:08:09.991 1 510.00MiB /dev/nvme0n1p1 00:08:09.991 00:08:09.991 15:51:59 -- common/autotest_common.sh@921 -- # return 0 00:08:09.991 15:51:59 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:10.923 15:52:00 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:10.923 15:52:00 -- target/filesystem.sh@25 -- # sync 00:08:10.923 15:52:00 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:10.923 15:52:00 -- target/filesystem.sh@27 -- # sync 00:08:10.923 15:52:00 -- target/filesystem.sh@29 -- # i=0 00:08:10.923 15:52:00 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:10.923 15:52:00 -- target/filesystem.sh@37 -- # kill -0 2317475 00:08:10.923 15:52:00 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:10.923 15:52:00 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:10.923 15:52:00 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:10.923 15:52:00 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:10.923 00:08:10.923 real 0m1.222s 00:08:10.923 user 0m0.021s 00:08:10.923 sys 0m0.098s 00:08:10.923 15:52:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:10.923 15:52:00 -- common/autotest_common.sh@10 -- # set +x 00:08:10.923 ************************************ 00:08:10.923 END TEST filesystem_btrfs 00:08:10.923 ************************************ 00:08:10.923 15:52:00 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:10.923 15:52:00 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:10.923 15:52:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:11.181 15:52:00 -- common/autotest_common.sh@10 -- # set +x 00:08:11.181 ************************************ 00:08:11.181 START TEST filesystem_xfs 00:08:11.181 ************************************ 00:08:11.181 15:52:00 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:08:11.181 15:52:00 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:11.181 15:52:00 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:11.181 15:52:00 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:11.181 15:52:00 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:08:11.181 15:52:00 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:11.181 15:52:00 -- common/autotest_common.sh@904 -- # local i=0 00:08:11.181 15:52:00 -- common/autotest_common.sh@905 -- # local force 00:08:11.181 15:52:00 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:08:11.181 15:52:00 -- common/autotest_common.sh@910 -- # force=-f 00:08:11.181 15:52:00 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:11.181 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:11.181 = sectsz=512 attr=2, projid32bit=1 00:08:11.181 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:11.181 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:11.181 data = bsize=4096 blocks=130560, imaxpct=25 00:08:11.181 = sunit=0 swidth=0 blks 00:08:11.181 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:11.181 log =internal log bsize=4096 blocks=16384, version=2 00:08:11.181 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:11.181 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:12.113 Discarding blocks...Done. 00:08:12.113 15:52:01 -- common/autotest_common.sh@921 -- # return 0 00:08:12.113 15:52:01 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:14.013 15:52:03 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:14.013 15:52:03 -- target/filesystem.sh@25 -- # sync 00:08:14.013 15:52:03 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:14.013 15:52:03 -- target/filesystem.sh@27 -- # sync 00:08:14.013 15:52:03 -- target/filesystem.sh@29 -- # i=0 00:08:14.013 15:52:03 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:14.013 15:52:03 -- target/filesystem.sh@37 -- # kill -0 2317475 00:08:14.013 15:52:03 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:14.013 15:52:03 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:14.013 15:52:03 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:14.013 15:52:03 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:14.013 00:08:14.013 real 0m3.045s 00:08:14.013 user 0m0.015s 00:08:14.013 sys 0m0.060s 00:08:14.013 15:52:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:14.013 15:52:03 -- common/autotest_common.sh@10 -- # set +x 00:08:14.013 ************************************ 00:08:14.013 END TEST filesystem_xfs 00:08:14.013 ************************************ 00:08:14.013 15:52:03 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:14.271 15:52:04 -- target/filesystem.sh@93 -- # sync 00:08:14.271 15:52:04 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:14.529 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.529 15:52:04 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:14.529 15:52:04 -- common/autotest_common.sh@1198 -- # local i=0 00:08:14.529 15:52:04 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:08:14.529 15:52:04 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:14.529 15:52:04 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:08:14.529 15:52:04 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:14.529 15:52:04 -- common/autotest_common.sh@1210 -- # return 0 00:08:14.529 15:52:04 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:14.529 15:52:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:14.529 15:52:04 -- common/autotest_common.sh@10 -- # set +x 00:08:14.529 15:52:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:14.529 15:52:04 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:14.529 15:52:04 -- target/filesystem.sh@101 -- # killprocess 2317475 00:08:14.529 15:52:04 -- common/autotest_common.sh@926 -- # '[' -z 2317475 ']' 00:08:14.529 15:52:04 -- common/autotest_common.sh@930 -- # kill -0 2317475 00:08:14.529 15:52:04 -- common/autotest_common.sh@931 -- # uname 00:08:14.529 15:52:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:14.529 15:52:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2317475 00:08:14.529 15:52:04 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:08:14.529 15:52:04 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:08:14.529 15:52:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2317475' 00:08:14.529 killing process with pid 2317475 00:08:14.529 15:52:04 -- common/autotest_common.sh@945 -- # kill 2317475 00:08:14.529 15:52:04 -- common/autotest_common.sh@950 -- # wait 2317475 00:08:15.095 15:52:04 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:15.095 00:08:15.095 real 0m17.975s 00:08:15.095 user 1m9.612s 00:08:15.095 sys 0m2.323s 00:08:15.095 15:52:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:15.095 15:52:04 -- common/autotest_common.sh@10 -- # set +x 00:08:15.095 ************************************ 00:08:15.095 END TEST nvmf_filesystem_no_in_capsule 00:08:15.095 ************************************ 00:08:15.095 15:52:04 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:15.095 15:52:04 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:15.095 15:52:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:15.095 15:52:04 -- common/autotest_common.sh@10 -- # set +x 00:08:15.095 ************************************ 00:08:15.095 START TEST nvmf_filesystem_in_capsule 00:08:15.095 ************************************ 00:08:15.095 15:52:04 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 4096 00:08:15.095 15:52:04 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:15.095 15:52:04 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:15.095 15:52:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:15.095 15:52:04 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:15.095 15:52:04 -- common/autotest_common.sh@10 -- # set +x 00:08:15.095 15:52:04 -- nvmf/common.sh@469 -- # nvmfpid=2319896 00:08:15.095 15:52:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:15.095 15:52:04 -- nvmf/common.sh@470 -- # waitforlisten 2319896 00:08:15.095 15:52:04 -- common/autotest_common.sh@819 -- # '[' -z 2319896 ']' 00:08:15.095 15:52:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:15.095 15:52:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:15.095 15:52:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:15.095 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:15.095 15:52:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:15.095 15:52:04 -- common/autotest_common.sh@10 -- # set +x 00:08:15.095 [2024-10-30 15:52:04.782622] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:08:15.095 [2024-10-30 15:52:04.782710] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:15.095 EAL: No free 2048 kB hugepages reported on node 1 00:08:15.095 [2024-10-30 15:52:04.851647] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:15.095 [2024-10-30 15:52:04.938871] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:15.095 [2024-10-30 15:52:04.939031] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:15.095 [2024-10-30 15:52:04.939049] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:15.095 [2024-10-30 15:52:04.939061] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:15.095 [2024-10-30 15:52:04.939125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:15.095 [2024-10-30 15:52:04.941274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:15.095 [2024-10-30 15:52:04.941345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:15.095 [2024-10-30 15:52:04.941349] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:16.086 15:52:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:16.086 15:52:05 -- common/autotest_common.sh@852 -- # return 0 00:08:16.086 15:52:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:16.086 15:52:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:16.086 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:08:16.086 15:52:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:16.086 15:52:05 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:16.086 15:52:05 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:16.086 15:52:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:16.086 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:08:16.086 [2024-10-30 15:52:05.817096] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:16.086 15:52:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:16.086 15:52:05 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:16.086 15:52:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:16.086 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:08:16.345 Malloc1 00:08:16.345 15:52:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:16.345 15:52:05 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:16.345 15:52:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:16.345 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:08:16.345 15:52:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:16.345 15:52:05 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:16.345 15:52:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:16.345 15:52:05 -- common/autotest_common.sh@10 -- # set +x 00:08:16.345 15:52:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:16.345 15:52:06 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:16.345 15:52:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:16.345 15:52:06 -- common/autotest_common.sh@10 -- # set +x 00:08:16.345 [2024-10-30 15:52:06.004729] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:16.345 15:52:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:16.345 15:52:06 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:16.345 15:52:06 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:08:16.345 15:52:06 -- common/autotest_common.sh@1358 -- # local bdev_info 00:08:16.345 15:52:06 -- common/autotest_common.sh@1359 -- # local bs 00:08:16.345 15:52:06 -- common/autotest_common.sh@1360 -- # local nb 00:08:16.345 15:52:06 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:16.345 15:52:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:16.345 15:52:06 -- common/autotest_common.sh@10 -- # set +x 00:08:16.345 15:52:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:16.345 15:52:06 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:08:16.345 { 00:08:16.345 "name": "Malloc1", 00:08:16.345 "aliases": [ 00:08:16.345 "a6129d18-8cc8-46e5-b83e-8f9cb0235f86" 00:08:16.345 ], 00:08:16.345 "product_name": "Malloc disk", 00:08:16.345 "block_size": 512, 00:08:16.345 "num_blocks": 1048576, 00:08:16.345 "uuid": "a6129d18-8cc8-46e5-b83e-8f9cb0235f86", 00:08:16.345 "assigned_rate_limits": { 00:08:16.345 "rw_ios_per_sec": 0, 00:08:16.345 "rw_mbytes_per_sec": 0, 00:08:16.345 "r_mbytes_per_sec": 0, 00:08:16.345 "w_mbytes_per_sec": 0 00:08:16.345 }, 00:08:16.345 "claimed": true, 00:08:16.345 "claim_type": "exclusive_write", 00:08:16.345 "zoned": false, 00:08:16.345 "supported_io_types": { 00:08:16.345 "read": true, 00:08:16.345 "write": true, 00:08:16.345 "unmap": true, 00:08:16.345 "write_zeroes": true, 00:08:16.345 "flush": true, 00:08:16.345 "reset": true, 00:08:16.345 "compare": false, 00:08:16.345 "compare_and_write": false, 00:08:16.345 "abort": true, 00:08:16.345 "nvme_admin": false, 00:08:16.345 "nvme_io": false 00:08:16.345 }, 00:08:16.345 "memory_domains": [ 00:08:16.345 { 00:08:16.345 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:16.345 "dma_device_type": 2 00:08:16.345 } 00:08:16.345 ], 00:08:16.345 "driver_specific": {} 00:08:16.345 } 00:08:16.345 ]' 00:08:16.345 15:52:06 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:08:16.345 15:52:06 -- common/autotest_common.sh@1362 -- # bs=512 00:08:16.345 15:52:06 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:08:16.345 15:52:06 -- common/autotest_common.sh@1363 -- # nb=1048576 00:08:16.345 15:52:06 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:08:16.345 15:52:06 -- common/autotest_common.sh@1367 -- # echo 512 00:08:16.345 15:52:06 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:16.345 15:52:06 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:16.911 15:52:06 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:16.911 15:52:06 -- common/autotest_common.sh@1177 -- # local i=0 00:08:16.911 15:52:06 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:08:16.911 15:52:06 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:08:16.911 15:52:06 -- common/autotest_common.sh@1184 -- # sleep 2 00:08:19.438 15:52:08 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:08:19.438 15:52:08 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:08:19.438 15:52:08 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:08:19.438 15:52:08 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:08:19.438 15:52:08 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:08:19.438 15:52:08 -- common/autotest_common.sh@1187 -- # return 0 00:08:19.438 15:52:08 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:19.438 15:52:08 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:19.438 15:52:08 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:19.438 15:52:08 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:19.438 15:52:08 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:19.438 15:52:08 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:19.438 15:52:08 -- setup/common.sh@80 -- # echo 536870912 00:08:19.438 15:52:08 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:19.438 15:52:08 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:19.438 15:52:08 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:19.438 15:52:08 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:19.438 15:52:09 -- target/filesystem.sh@69 -- # partprobe 00:08:20.379 15:52:09 -- target/filesystem.sh@70 -- # sleep 1 00:08:21.312 15:52:10 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:21.312 15:52:10 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:21.312 15:52:10 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:21.312 15:52:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:21.312 15:52:10 -- common/autotest_common.sh@10 -- # set +x 00:08:21.312 ************************************ 00:08:21.312 START TEST filesystem_in_capsule_ext4 00:08:21.312 ************************************ 00:08:21.312 15:52:10 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:21.312 15:52:10 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:21.312 15:52:10 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:21.312 15:52:10 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:21.312 15:52:10 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:08:21.312 15:52:10 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:21.312 15:52:10 -- common/autotest_common.sh@904 -- # local i=0 00:08:21.312 15:52:10 -- common/autotest_common.sh@905 -- # local force 00:08:21.312 15:52:10 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:08:21.312 15:52:10 -- common/autotest_common.sh@908 -- # force=-F 00:08:21.312 15:52:10 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:21.312 mke2fs 1.47.0 (5-Feb-2023) 00:08:21.312 Discarding device blocks: 0/522240 done 00:08:21.312 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:21.312 Filesystem UUID: 87e9a262-fdd4-4de2-83ce-3ae7e3b38c16 00:08:21.312 Superblock backups stored on blocks: 00:08:21.312 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:21.312 00:08:21.312 Allocating group tables: 0/64 done 00:08:21.312 Writing inode tables: 0/64 done 00:08:23.211 Creating journal (8192 blocks): done 00:08:23.211 Writing superblocks and filesystem accounting information: 0/64 done 00:08:23.211 00:08:23.211 15:52:12 -- common/autotest_common.sh@921 -- # return 0 00:08:23.211 15:52:12 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:29.766 15:52:18 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:29.766 15:52:18 -- target/filesystem.sh@25 -- # sync 00:08:29.766 15:52:18 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:29.766 15:52:18 -- target/filesystem.sh@27 -- # sync 00:08:29.766 15:52:18 -- target/filesystem.sh@29 -- # i=0 00:08:29.766 15:52:18 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:29.766 15:52:18 -- target/filesystem.sh@37 -- # kill -0 2319896 00:08:29.766 15:52:18 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:29.766 15:52:18 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:29.766 15:52:18 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:29.766 15:52:18 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:29.766 00:08:29.766 real 0m7.699s 00:08:29.766 user 0m0.018s 00:08:29.766 sys 0m0.069s 00:08:29.766 15:52:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:29.766 15:52:18 -- common/autotest_common.sh@10 -- # set +x 00:08:29.766 ************************************ 00:08:29.766 END TEST filesystem_in_capsule_ext4 00:08:29.766 ************************************ 00:08:29.766 15:52:18 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:29.766 15:52:18 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:29.766 15:52:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:29.766 15:52:18 -- common/autotest_common.sh@10 -- # set +x 00:08:29.766 ************************************ 00:08:29.766 START TEST filesystem_in_capsule_btrfs 00:08:29.766 ************************************ 00:08:29.766 15:52:18 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:29.766 15:52:18 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:29.766 15:52:18 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:29.766 15:52:18 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:29.766 15:52:18 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:08:29.766 15:52:18 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:29.766 15:52:18 -- common/autotest_common.sh@904 -- # local i=0 00:08:29.766 15:52:18 -- common/autotest_common.sh@905 -- # local force 00:08:29.766 15:52:18 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:08:29.766 15:52:18 -- common/autotest_common.sh@910 -- # force=-f 00:08:29.766 15:52:18 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:29.766 btrfs-progs v6.8.1 00:08:29.766 See https://btrfs.readthedocs.io for more information. 00:08:29.766 00:08:29.766 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:29.766 NOTE: several default settings have changed in version 5.15, please make sure 00:08:29.766 this does not affect your deployments: 00:08:29.766 - DUP for metadata (-m dup) 00:08:29.766 - enabled no-holes (-O no-holes) 00:08:29.766 - enabled free-space-tree (-R free-space-tree) 00:08:29.766 00:08:29.766 Label: (null) 00:08:29.766 UUID: 7c879d70-6f65-432e-b4cc-63e19ed362c3 00:08:29.766 Node size: 16384 00:08:29.766 Sector size: 4096 (CPU page size: 4096) 00:08:29.766 Filesystem size: 510.00MiB 00:08:29.766 Block group profiles: 00:08:29.766 Data: single 8.00MiB 00:08:29.766 Metadata: DUP 32.00MiB 00:08:29.766 System: DUP 8.00MiB 00:08:29.766 SSD detected: yes 00:08:29.766 Zoned device: no 00:08:29.766 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:29.766 Checksum: crc32c 00:08:29.766 Number of devices: 1 00:08:29.766 Devices: 00:08:29.766 ID SIZE PATH 00:08:29.766 1 510.00MiB /dev/nvme0n1p1 00:08:29.766 00:08:29.766 15:52:18 -- common/autotest_common.sh@921 -- # return 0 00:08:29.766 15:52:18 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:29.766 15:52:19 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:29.766 15:52:19 -- target/filesystem.sh@25 -- # sync 00:08:29.766 15:52:19 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:29.766 15:52:19 -- target/filesystem.sh@27 -- # sync 00:08:29.766 15:52:19 -- target/filesystem.sh@29 -- # i=0 00:08:29.766 15:52:19 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:29.766 15:52:19 -- target/filesystem.sh@37 -- # kill -0 2319896 00:08:29.767 15:52:19 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:29.767 15:52:19 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:29.767 15:52:19 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:29.767 15:52:19 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:29.767 00:08:29.767 real 0m0.921s 00:08:29.767 user 0m0.021s 00:08:29.767 sys 0m0.098s 00:08:29.767 15:52:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:29.767 15:52:19 -- common/autotest_common.sh@10 -- # set +x 00:08:29.767 ************************************ 00:08:29.767 END TEST filesystem_in_capsule_btrfs 00:08:29.767 ************************************ 00:08:30.023 15:52:19 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:30.023 15:52:19 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:08:30.023 15:52:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:30.023 15:52:19 -- common/autotest_common.sh@10 -- # set +x 00:08:30.023 ************************************ 00:08:30.023 START TEST filesystem_in_capsule_xfs 00:08:30.023 ************************************ 00:08:30.023 15:52:19 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:08:30.023 15:52:19 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:30.023 15:52:19 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:30.023 15:52:19 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:30.023 15:52:19 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:08:30.023 15:52:19 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:08:30.023 15:52:19 -- common/autotest_common.sh@904 -- # local i=0 00:08:30.023 15:52:19 -- common/autotest_common.sh@905 -- # local force 00:08:30.023 15:52:19 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:08:30.023 15:52:19 -- common/autotest_common.sh@910 -- # force=-f 00:08:30.023 15:52:19 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:30.023 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:30.023 = sectsz=512 attr=2, projid32bit=1 00:08:30.023 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:30.023 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:30.023 data = bsize=4096 blocks=130560, imaxpct=25 00:08:30.023 = sunit=0 swidth=0 blks 00:08:30.023 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:30.023 log =internal log bsize=4096 blocks=16384, version=2 00:08:30.023 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:30.023 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:30.956 Discarding blocks...Done. 00:08:30.956 15:52:20 -- common/autotest_common.sh@921 -- # return 0 00:08:30.956 15:52:20 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:32.854 15:52:22 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:32.854 15:52:22 -- target/filesystem.sh@25 -- # sync 00:08:32.854 15:52:22 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:32.854 15:52:22 -- target/filesystem.sh@27 -- # sync 00:08:32.854 15:52:22 -- target/filesystem.sh@29 -- # i=0 00:08:32.854 15:52:22 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:32.854 15:52:22 -- target/filesystem.sh@37 -- # kill -0 2319896 00:08:32.854 15:52:22 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:32.854 15:52:22 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:32.854 15:52:22 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:32.854 15:52:22 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:32.854 00:08:32.854 real 0m2.804s 00:08:32.854 user 0m0.018s 00:08:32.854 sys 0m0.055s 00:08:32.854 15:52:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:32.854 15:52:22 -- common/autotest_common.sh@10 -- # set +x 00:08:32.854 ************************************ 00:08:32.854 END TEST filesystem_in_capsule_xfs 00:08:32.854 ************************************ 00:08:32.854 15:52:22 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:33.111 15:52:22 -- target/filesystem.sh@93 -- # sync 00:08:33.111 15:52:22 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:33.111 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.111 15:52:22 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:33.111 15:52:22 -- common/autotest_common.sh@1198 -- # local i=0 00:08:33.111 15:52:22 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:08:33.111 15:52:22 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:33.111 15:52:22 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:08:33.111 15:52:22 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:33.111 15:52:22 -- common/autotest_common.sh@1210 -- # return 0 00:08:33.111 15:52:22 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:33.111 15:52:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:33.111 15:52:22 -- common/autotest_common.sh@10 -- # set +x 00:08:33.111 15:52:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:33.111 15:52:22 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:33.111 15:52:22 -- target/filesystem.sh@101 -- # killprocess 2319896 00:08:33.111 15:52:22 -- common/autotest_common.sh@926 -- # '[' -z 2319896 ']' 00:08:33.111 15:52:22 -- common/autotest_common.sh@930 -- # kill -0 2319896 00:08:33.111 15:52:22 -- common/autotest_common.sh@931 -- # uname 00:08:33.111 15:52:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:33.111 15:52:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2319896 00:08:33.111 15:52:22 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:08:33.111 15:52:22 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:08:33.111 15:52:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2319896' 00:08:33.111 killing process with pid 2319896 00:08:33.111 15:52:22 -- common/autotest_common.sh@945 -- # kill 2319896 00:08:33.111 15:52:22 -- common/autotest_common.sh@950 -- # wait 2319896 00:08:33.675 15:52:23 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:33.675 00:08:33.675 real 0m18.610s 00:08:33.675 user 1m12.100s 00:08:33.675 sys 0m2.393s 00:08:33.675 15:52:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:33.675 15:52:23 -- common/autotest_common.sh@10 -- # set +x 00:08:33.675 ************************************ 00:08:33.675 END TEST nvmf_filesystem_in_capsule 00:08:33.675 ************************************ 00:08:33.675 15:52:23 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:33.675 15:52:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:33.675 15:52:23 -- nvmf/common.sh@116 -- # sync 00:08:33.675 15:52:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:33.675 15:52:23 -- nvmf/common.sh@119 -- # set +e 00:08:33.675 15:52:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:33.675 15:52:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:33.675 rmmod nvme_tcp 00:08:33.675 rmmod nvme_fabrics 00:08:33.675 rmmod nvme_keyring 00:08:33.675 15:52:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:33.675 15:52:23 -- nvmf/common.sh@123 -- # set -e 00:08:33.675 15:52:23 -- nvmf/common.sh@124 -- # return 0 00:08:33.675 15:52:23 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:33.675 15:52:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:33.675 15:52:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:33.675 15:52:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:33.675 15:52:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:33.675 15:52:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:33.675 15:52:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:33.675 15:52:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:33.675 15:52:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:36.205 15:52:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:36.205 00:08:36.205 real 0m40.964s 00:08:36.205 user 2m22.550s 00:08:36.205 sys 0m6.255s 00:08:36.205 15:52:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:36.205 15:52:25 -- common/autotest_common.sh@10 -- # set +x 00:08:36.205 ************************************ 00:08:36.205 END TEST nvmf_filesystem 00:08:36.205 ************************************ 00:08:36.205 15:52:25 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:36.205 15:52:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:36.205 15:52:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:36.205 15:52:25 -- common/autotest_common.sh@10 -- # set +x 00:08:36.205 ************************************ 00:08:36.205 START TEST nvmf_discovery 00:08:36.205 ************************************ 00:08:36.205 15:52:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:36.205 * Looking for test storage... 00:08:36.205 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:36.205 15:52:25 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:36.205 15:52:25 -- nvmf/common.sh@7 -- # uname -s 00:08:36.205 15:52:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:36.205 15:52:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:36.205 15:52:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:36.205 15:52:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:36.205 15:52:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:36.205 15:52:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:36.205 15:52:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:36.205 15:52:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:36.205 15:52:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:36.205 15:52:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:36.205 15:52:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:36.205 15:52:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:36.205 15:52:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:36.205 15:52:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:36.205 15:52:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:36.205 15:52:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:36.205 15:52:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:36.205 15:52:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:36.205 15:52:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:36.206 15:52:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.206 15:52:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.206 15:52:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.206 15:52:25 -- paths/export.sh@5 -- # export PATH 00:08:36.206 15:52:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:36.206 15:52:25 -- nvmf/common.sh@46 -- # : 0 00:08:36.206 15:52:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:36.206 15:52:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:36.206 15:52:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:36.206 15:52:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:36.206 15:52:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:36.206 15:52:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:36.206 15:52:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:36.206 15:52:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:36.206 15:52:25 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:36.206 15:52:25 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:36.206 15:52:25 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:36.206 15:52:25 -- target/discovery.sh@15 -- # hash nvme 00:08:36.206 15:52:25 -- target/discovery.sh@20 -- # nvmftestinit 00:08:36.206 15:52:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:36.206 15:52:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:36.206 15:52:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:36.206 15:52:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:36.206 15:52:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:36.206 15:52:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:36.206 15:52:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:36.206 15:52:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:36.206 15:52:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:36.206 15:52:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:36.206 15:52:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:36.206 15:52:25 -- common/autotest_common.sh@10 -- # set +x 00:08:38.107 15:52:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:38.107 15:52:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:38.107 15:52:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:38.107 15:52:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:38.107 15:52:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:38.107 15:52:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:38.107 15:52:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:38.107 15:52:27 -- nvmf/common.sh@294 -- # net_devs=() 00:08:38.107 15:52:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:38.107 15:52:27 -- nvmf/common.sh@295 -- # e810=() 00:08:38.107 15:52:27 -- nvmf/common.sh@295 -- # local -ga e810 00:08:38.107 15:52:27 -- nvmf/common.sh@296 -- # x722=() 00:08:38.107 15:52:27 -- nvmf/common.sh@296 -- # local -ga x722 00:08:38.107 15:52:27 -- nvmf/common.sh@297 -- # mlx=() 00:08:38.107 15:52:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:38.107 15:52:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:38.107 15:52:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:38.107 15:52:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:38.107 15:52:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:38.107 15:52:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:38.107 15:52:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:38.107 15:52:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:38.107 15:52:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:38.107 15:52:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:38.107 15:52:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:38.107 15:52:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:38.107 15:52:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:38.107 15:52:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:38.107 15:52:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:38.107 15:52:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:38.107 15:52:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:38.107 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:38.107 15:52:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:38.107 15:52:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:38.107 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:38.107 15:52:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:38.107 15:52:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:38.107 15:52:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:38.107 15:52:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:38.107 15:52:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:38.107 15:52:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:38.107 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:38.107 15:52:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:38.107 15:52:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:38.107 15:52:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:38.107 15:52:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:38.107 15:52:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:38.107 15:52:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:38.107 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:38.107 15:52:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:38.107 15:52:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:38.107 15:52:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:38.107 15:52:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:38.107 15:52:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:38.107 15:52:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:38.107 15:52:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:38.107 15:52:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:38.107 15:52:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:38.107 15:52:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:38.107 15:52:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:38.107 15:52:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:38.107 15:52:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:38.107 15:52:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:38.107 15:52:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:38.107 15:52:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:38.107 15:52:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:38.107 15:52:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:38.108 15:52:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:38.108 15:52:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:38.108 15:52:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:38.108 15:52:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:38.108 15:52:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:38.108 15:52:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:38.108 15:52:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:38.108 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:38.108 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.215 ms 00:08:38.108 00:08:38.108 --- 10.0.0.2 ping statistics --- 00:08:38.108 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:38.108 rtt min/avg/max/mdev = 0.215/0.215/0.215/0.000 ms 00:08:38.108 15:52:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:38.108 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:38.108 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.050 ms 00:08:38.108 00:08:38.108 --- 10.0.0.1 ping statistics --- 00:08:38.108 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:38.108 rtt min/avg/max/mdev = 0.050/0.050/0.050/0.000 ms 00:08:38.108 15:52:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:38.108 15:52:27 -- nvmf/common.sh@410 -- # return 0 00:08:38.108 15:52:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:38.108 15:52:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:38.108 15:52:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:38.108 15:52:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:38.108 15:52:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:38.108 15:52:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:38.108 15:52:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:38.108 15:52:27 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:38.108 15:52:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:38.108 15:52:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:38.108 15:52:27 -- common/autotest_common.sh@10 -- # set +x 00:08:38.108 15:52:27 -- nvmf/common.sh@469 -- # nvmfpid=2324377 00:08:38.108 15:52:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:38.108 15:52:27 -- nvmf/common.sh@470 -- # waitforlisten 2324377 00:08:38.108 15:52:27 -- common/autotest_common.sh@819 -- # '[' -z 2324377 ']' 00:08:38.108 15:52:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:38.108 15:52:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:38.108 15:52:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:38.108 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:38.108 15:52:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:38.108 15:52:27 -- common/autotest_common.sh@10 -- # set +x 00:08:38.108 [2024-10-30 15:52:27.960786] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:08:38.108 [2024-10-30 15:52:27.960862] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:38.365 EAL: No free 2048 kB hugepages reported on node 1 00:08:38.365 [2024-10-30 15:52:28.029195] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:38.365 [2024-10-30 15:52:28.119245] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:38.365 [2024-10-30 15:52:28.119404] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:38.365 [2024-10-30 15:52:28.119420] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:38.365 [2024-10-30 15:52:28.119445] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:38.365 [2024-10-30 15:52:28.119503] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:38.365 [2024-10-30 15:52:28.119562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:38.365 [2024-10-30 15:52:28.119629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:38.365 [2024-10-30 15:52:28.119631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:39.298 15:52:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:39.298 15:52:28 -- common/autotest_common.sh@852 -- # return 0 00:08:39.298 15:52:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:39.298 15:52:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:39.298 15:52:28 -- common/autotest_common.sh@10 -- # set +x 00:08:39.298 15:52:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:39.298 15:52:28 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:39.298 15:52:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.298 15:52:28 -- common/autotest_common.sh@10 -- # set +x 00:08:39.298 [2024-10-30 15:52:28.978046] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:39.298 15:52:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.298 15:52:28 -- target/discovery.sh@26 -- # seq 1 4 00:08:39.298 15:52:28 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:39.298 15:52:28 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:39.298 15:52:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.298 15:52:28 -- common/autotest_common.sh@10 -- # set +x 00:08:39.298 Null1 00:08:39.298 15:52:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.298 15:52:28 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:39.298 15:52:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.298 15:52:28 -- common/autotest_common.sh@10 -- # set +x 00:08:39.298 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.298 15:52:29 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:39.298 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.298 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.298 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.298 15:52:29 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:39.298 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.298 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.298 [2024-10-30 15:52:29.018395] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:39.298 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.298 15:52:29 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:39.298 15:52:29 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:39.298 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.298 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.298 Null2 00:08:39.298 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.298 15:52:29 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:39.298 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.298 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.298 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.298 15:52:29 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:39.298 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.298 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.298 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.298 15:52:29 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:39.298 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.298 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.298 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.298 15:52:29 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:39.298 15:52:29 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:39.298 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.298 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.298 Null3 00:08:39.298 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.298 15:52:29 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:39.298 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.298 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.299 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.299 15:52:29 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:39.299 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.299 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.299 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.299 15:52:29 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:39.299 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.299 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.299 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.299 15:52:29 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:39.299 15:52:29 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:39.299 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.299 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.299 Null4 00:08:39.299 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.299 15:52:29 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:39.299 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.299 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.299 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.299 15:52:29 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:39.299 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.299 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.299 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.299 15:52:29 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:39.299 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.299 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.299 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.299 15:52:29 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:39.299 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.299 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.299 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.299 15:52:29 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:39.299 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.299 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.299 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.299 15:52:29 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:08:39.557 00:08:39.557 Discovery Log Number of Records 6, Generation counter 6 00:08:39.557 =====Discovery Log Entry 0====== 00:08:39.557 trtype: tcp 00:08:39.557 adrfam: ipv4 00:08:39.557 subtype: current discovery subsystem 00:08:39.557 treq: not required 00:08:39.557 portid: 0 00:08:39.557 trsvcid: 4420 00:08:39.557 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:39.557 traddr: 10.0.0.2 00:08:39.557 eflags: explicit discovery connections, duplicate discovery information 00:08:39.557 sectype: none 00:08:39.557 =====Discovery Log Entry 1====== 00:08:39.557 trtype: tcp 00:08:39.557 adrfam: ipv4 00:08:39.557 subtype: nvme subsystem 00:08:39.557 treq: not required 00:08:39.557 portid: 0 00:08:39.557 trsvcid: 4420 00:08:39.557 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:39.557 traddr: 10.0.0.2 00:08:39.557 eflags: none 00:08:39.557 sectype: none 00:08:39.557 =====Discovery Log Entry 2====== 00:08:39.557 trtype: tcp 00:08:39.557 adrfam: ipv4 00:08:39.557 subtype: nvme subsystem 00:08:39.557 treq: not required 00:08:39.557 portid: 0 00:08:39.557 trsvcid: 4420 00:08:39.557 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:39.557 traddr: 10.0.0.2 00:08:39.557 eflags: none 00:08:39.557 sectype: none 00:08:39.557 =====Discovery Log Entry 3====== 00:08:39.557 trtype: tcp 00:08:39.557 adrfam: ipv4 00:08:39.557 subtype: nvme subsystem 00:08:39.557 treq: not required 00:08:39.557 portid: 0 00:08:39.557 trsvcid: 4420 00:08:39.557 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:39.557 traddr: 10.0.0.2 00:08:39.557 eflags: none 00:08:39.557 sectype: none 00:08:39.557 =====Discovery Log Entry 4====== 00:08:39.557 trtype: tcp 00:08:39.557 adrfam: ipv4 00:08:39.557 subtype: nvme subsystem 00:08:39.557 treq: not required 00:08:39.557 portid: 0 00:08:39.557 trsvcid: 4420 00:08:39.557 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:39.557 traddr: 10.0.0.2 00:08:39.557 eflags: none 00:08:39.557 sectype: none 00:08:39.557 =====Discovery Log Entry 5====== 00:08:39.557 trtype: tcp 00:08:39.557 adrfam: ipv4 00:08:39.557 subtype: discovery subsystem referral 00:08:39.557 treq: not required 00:08:39.557 portid: 0 00:08:39.557 trsvcid: 4430 00:08:39.557 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:39.557 traddr: 10.0.0.2 00:08:39.557 eflags: none 00:08:39.557 sectype: none 00:08:39.557 15:52:29 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:39.557 Perform nvmf subsystem discovery via RPC 00:08:39.557 15:52:29 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:39.557 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.557 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.557 [2024-10-30 15:52:29.351346] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:39.557 [ 00:08:39.557 { 00:08:39.557 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:39.557 "subtype": "Discovery", 00:08:39.557 "listen_addresses": [ 00:08:39.557 { 00:08:39.557 "transport": "TCP", 00:08:39.557 "trtype": "TCP", 00:08:39.557 "adrfam": "IPv4", 00:08:39.557 "traddr": "10.0.0.2", 00:08:39.557 "trsvcid": "4420" 00:08:39.557 } 00:08:39.557 ], 00:08:39.557 "allow_any_host": true, 00:08:39.557 "hosts": [] 00:08:39.557 }, 00:08:39.557 { 00:08:39.557 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:39.557 "subtype": "NVMe", 00:08:39.557 "listen_addresses": [ 00:08:39.557 { 00:08:39.557 "transport": "TCP", 00:08:39.557 "trtype": "TCP", 00:08:39.557 "adrfam": "IPv4", 00:08:39.557 "traddr": "10.0.0.2", 00:08:39.557 "trsvcid": "4420" 00:08:39.557 } 00:08:39.557 ], 00:08:39.557 "allow_any_host": true, 00:08:39.557 "hosts": [], 00:08:39.557 "serial_number": "SPDK00000000000001", 00:08:39.557 "model_number": "SPDK bdev Controller", 00:08:39.557 "max_namespaces": 32, 00:08:39.557 "min_cntlid": 1, 00:08:39.557 "max_cntlid": 65519, 00:08:39.557 "namespaces": [ 00:08:39.557 { 00:08:39.557 "nsid": 1, 00:08:39.557 "bdev_name": "Null1", 00:08:39.557 "name": "Null1", 00:08:39.557 "nguid": "9CCE974518B04A26AA05533A9FA524C3", 00:08:39.557 "uuid": "9cce9745-18b0-4a26-aa05-533a9fa524c3" 00:08:39.557 } 00:08:39.557 ] 00:08:39.557 }, 00:08:39.557 { 00:08:39.557 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:39.557 "subtype": "NVMe", 00:08:39.557 "listen_addresses": [ 00:08:39.557 { 00:08:39.557 "transport": "TCP", 00:08:39.557 "trtype": "TCP", 00:08:39.557 "adrfam": "IPv4", 00:08:39.557 "traddr": "10.0.0.2", 00:08:39.557 "trsvcid": "4420" 00:08:39.557 } 00:08:39.557 ], 00:08:39.557 "allow_any_host": true, 00:08:39.557 "hosts": [], 00:08:39.557 "serial_number": "SPDK00000000000002", 00:08:39.557 "model_number": "SPDK bdev Controller", 00:08:39.557 "max_namespaces": 32, 00:08:39.557 "min_cntlid": 1, 00:08:39.557 "max_cntlid": 65519, 00:08:39.557 "namespaces": [ 00:08:39.557 { 00:08:39.557 "nsid": 1, 00:08:39.557 "bdev_name": "Null2", 00:08:39.557 "name": "Null2", 00:08:39.557 "nguid": "7326E8A3DEA8490AAE66B28E94438E2E", 00:08:39.557 "uuid": "7326e8a3-dea8-490a-ae66-b28e94438e2e" 00:08:39.557 } 00:08:39.557 ] 00:08:39.557 }, 00:08:39.557 { 00:08:39.557 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:39.557 "subtype": "NVMe", 00:08:39.557 "listen_addresses": [ 00:08:39.557 { 00:08:39.557 "transport": "TCP", 00:08:39.558 "trtype": "TCP", 00:08:39.558 "adrfam": "IPv4", 00:08:39.558 "traddr": "10.0.0.2", 00:08:39.558 "trsvcid": "4420" 00:08:39.558 } 00:08:39.558 ], 00:08:39.558 "allow_any_host": true, 00:08:39.558 "hosts": [], 00:08:39.558 "serial_number": "SPDK00000000000003", 00:08:39.558 "model_number": "SPDK bdev Controller", 00:08:39.558 "max_namespaces": 32, 00:08:39.558 "min_cntlid": 1, 00:08:39.558 "max_cntlid": 65519, 00:08:39.558 "namespaces": [ 00:08:39.558 { 00:08:39.558 "nsid": 1, 00:08:39.558 "bdev_name": "Null3", 00:08:39.558 "name": "Null3", 00:08:39.558 "nguid": "949422124D7443F7AFA8AEF88570EB08", 00:08:39.558 "uuid": "94942212-4d74-43f7-afa8-aef88570eb08" 00:08:39.558 } 00:08:39.558 ] 00:08:39.558 }, 00:08:39.558 { 00:08:39.558 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:39.558 "subtype": "NVMe", 00:08:39.558 "listen_addresses": [ 00:08:39.558 { 00:08:39.558 "transport": "TCP", 00:08:39.558 "trtype": "TCP", 00:08:39.558 "adrfam": "IPv4", 00:08:39.558 "traddr": "10.0.0.2", 00:08:39.558 "trsvcid": "4420" 00:08:39.558 } 00:08:39.558 ], 00:08:39.558 "allow_any_host": true, 00:08:39.558 "hosts": [], 00:08:39.558 "serial_number": "SPDK00000000000004", 00:08:39.558 "model_number": "SPDK bdev Controller", 00:08:39.558 "max_namespaces": 32, 00:08:39.558 "min_cntlid": 1, 00:08:39.558 "max_cntlid": 65519, 00:08:39.558 "namespaces": [ 00:08:39.558 { 00:08:39.558 "nsid": 1, 00:08:39.558 "bdev_name": "Null4", 00:08:39.558 "name": "Null4", 00:08:39.558 "nguid": "F201D1D471F14314AA7F79A60D2A6A0E", 00:08:39.558 "uuid": "f201d1d4-71f1-4314-aa7f-79a60d2a6a0e" 00:08:39.558 } 00:08:39.558 ] 00:08:39.558 } 00:08:39.558 ] 00:08:39.558 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.558 15:52:29 -- target/discovery.sh@42 -- # seq 1 4 00:08:39.558 15:52:29 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:39.558 15:52:29 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:39.558 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.558 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.558 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.558 15:52:29 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:39.558 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.558 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.558 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.558 15:52:29 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:39.558 15:52:29 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:39.558 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.558 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.558 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.558 15:52:29 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:39.558 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.558 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.558 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.558 15:52:29 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:39.558 15:52:29 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:39.558 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.558 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.558 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.558 15:52:29 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:39.558 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.558 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.558 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.558 15:52:29 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:39.558 15:52:29 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:39.558 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.558 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.558 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.558 15:52:29 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:39.558 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.558 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.816 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.816 15:52:29 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:39.816 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.816 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.816 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.816 15:52:29 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:39.816 15:52:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:39.816 15:52:29 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:39.816 15:52:29 -- common/autotest_common.sh@10 -- # set +x 00:08:39.816 15:52:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:39.816 15:52:29 -- target/discovery.sh@49 -- # check_bdevs= 00:08:39.816 15:52:29 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:39.816 15:52:29 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:39.816 15:52:29 -- target/discovery.sh@57 -- # nvmftestfini 00:08:39.816 15:52:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:39.816 15:52:29 -- nvmf/common.sh@116 -- # sync 00:08:39.816 15:52:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:39.816 15:52:29 -- nvmf/common.sh@119 -- # set +e 00:08:39.816 15:52:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:39.816 15:52:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:39.816 rmmod nvme_tcp 00:08:39.816 rmmod nvme_fabrics 00:08:39.816 rmmod nvme_keyring 00:08:39.816 15:52:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:39.816 15:52:29 -- nvmf/common.sh@123 -- # set -e 00:08:39.816 15:52:29 -- nvmf/common.sh@124 -- # return 0 00:08:39.816 15:52:29 -- nvmf/common.sh@477 -- # '[' -n 2324377 ']' 00:08:39.816 15:52:29 -- nvmf/common.sh@478 -- # killprocess 2324377 00:08:39.816 15:52:29 -- common/autotest_common.sh@926 -- # '[' -z 2324377 ']' 00:08:39.816 15:52:29 -- common/autotest_common.sh@930 -- # kill -0 2324377 00:08:39.816 15:52:29 -- common/autotest_common.sh@931 -- # uname 00:08:39.816 15:52:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:39.816 15:52:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2324377 00:08:39.816 15:52:29 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:08:39.816 15:52:29 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:08:39.816 15:52:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2324377' 00:08:39.816 killing process with pid 2324377 00:08:39.816 15:52:29 -- common/autotest_common.sh@945 -- # kill 2324377 00:08:39.816 [2024-10-30 15:52:29.580662] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:39.816 15:52:29 -- common/autotest_common.sh@950 -- # wait 2324377 00:08:40.074 15:52:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:40.074 15:52:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:40.074 15:52:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:40.074 15:52:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:40.074 15:52:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:40.074 15:52:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:40.074 15:52:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:40.074 15:52:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:41.978 15:52:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:42.237 00:08:42.237 real 0m6.365s 00:08:42.237 user 0m7.801s 00:08:42.237 sys 0m1.948s 00:08:42.237 15:52:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:42.237 15:52:31 -- common/autotest_common.sh@10 -- # set +x 00:08:42.237 ************************************ 00:08:42.237 END TEST nvmf_discovery 00:08:42.237 ************************************ 00:08:42.237 15:52:31 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:42.237 15:52:31 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:42.237 15:52:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:42.237 15:52:31 -- common/autotest_common.sh@10 -- # set +x 00:08:42.237 ************************************ 00:08:42.237 START TEST nvmf_referrals 00:08:42.237 ************************************ 00:08:42.237 15:52:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:42.237 * Looking for test storage... 00:08:42.237 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:42.237 15:52:31 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:42.237 15:52:31 -- nvmf/common.sh@7 -- # uname -s 00:08:42.237 15:52:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:42.237 15:52:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:42.237 15:52:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:42.237 15:52:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:42.237 15:52:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:42.237 15:52:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:42.237 15:52:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:42.237 15:52:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:42.237 15:52:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:42.237 15:52:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:42.237 15:52:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:42.237 15:52:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:42.237 15:52:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:42.237 15:52:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:42.237 15:52:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:42.237 15:52:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:42.237 15:52:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:42.237 15:52:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:42.237 15:52:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:42.237 15:52:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.237 15:52:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.237 15:52:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.237 15:52:31 -- paths/export.sh@5 -- # export PATH 00:08:42.237 15:52:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:42.237 15:52:31 -- nvmf/common.sh@46 -- # : 0 00:08:42.237 15:52:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:42.237 15:52:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:42.237 15:52:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:42.237 15:52:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:42.237 15:52:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:42.237 15:52:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:42.237 15:52:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:42.237 15:52:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:42.237 15:52:31 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:42.237 15:52:31 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:42.237 15:52:31 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:42.237 15:52:31 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:42.237 15:52:31 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:42.237 15:52:31 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:42.237 15:52:31 -- target/referrals.sh@37 -- # nvmftestinit 00:08:42.237 15:52:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:42.237 15:52:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:42.237 15:52:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:42.237 15:52:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:42.237 15:52:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:42.237 15:52:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:42.237 15:52:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:42.237 15:52:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:42.237 15:52:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:42.237 15:52:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:42.237 15:52:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:42.237 15:52:31 -- common/autotest_common.sh@10 -- # set +x 00:08:44.141 15:52:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:44.141 15:52:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:44.141 15:52:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:44.141 15:52:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:44.141 15:52:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:44.141 15:52:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:44.141 15:52:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:44.141 15:52:33 -- nvmf/common.sh@294 -- # net_devs=() 00:08:44.141 15:52:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:44.141 15:52:33 -- nvmf/common.sh@295 -- # e810=() 00:08:44.141 15:52:33 -- nvmf/common.sh@295 -- # local -ga e810 00:08:44.141 15:52:33 -- nvmf/common.sh@296 -- # x722=() 00:08:44.141 15:52:33 -- nvmf/common.sh@296 -- # local -ga x722 00:08:44.141 15:52:33 -- nvmf/common.sh@297 -- # mlx=() 00:08:44.141 15:52:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:44.141 15:52:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:44.141 15:52:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:44.141 15:52:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:44.141 15:52:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:44.141 15:52:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:44.141 15:52:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:44.141 15:52:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:44.141 15:52:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:44.141 15:52:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:44.141 15:52:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:44.141 15:52:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:44.141 15:52:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:44.141 15:52:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:44.141 15:52:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:44.141 15:52:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:44.141 15:52:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:44.141 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:44.141 15:52:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:44.141 15:52:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:44.141 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:44.141 15:52:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:44.141 15:52:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:44.141 15:52:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:44.141 15:52:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:44.141 15:52:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:44.141 15:52:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:44.141 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:44.141 15:52:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:44.141 15:52:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:44.141 15:52:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:44.141 15:52:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:44.141 15:52:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:44.141 15:52:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:44.141 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:44.141 15:52:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:44.141 15:52:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:44.141 15:52:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:44.141 15:52:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:44.141 15:52:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:44.141 15:52:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:44.141 15:52:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:44.141 15:52:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:44.141 15:52:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:44.141 15:52:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:44.141 15:52:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:44.141 15:52:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:44.141 15:52:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:44.141 15:52:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:44.141 15:52:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:44.141 15:52:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:44.141 15:52:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:44.141 15:52:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:44.400 15:52:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:44.400 15:52:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:44.400 15:52:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:44.400 15:52:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:44.400 15:52:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:44.400 15:52:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:44.400 15:52:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:44.400 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:44.400 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.272 ms 00:08:44.400 00:08:44.400 --- 10.0.0.2 ping statistics --- 00:08:44.400 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:44.400 rtt min/avg/max/mdev = 0.272/0.272/0.272/0.000 ms 00:08:44.400 15:52:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:44.400 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:44.400 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:08:44.400 00:08:44.400 --- 10.0.0.1 ping statistics --- 00:08:44.400 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:44.400 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:08:44.400 15:52:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:44.400 15:52:34 -- nvmf/common.sh@410 -- # return 0 00:08:44.400 15:52:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:44.400 15:52:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:44.400 15:52:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:44.400 15:52:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:44.400 15:52:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:44.400 15:52:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:44.400 15:52:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:44.400 15:52:34 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:44.400 15:52:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:44.400 15:52:34 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:44.400 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:08:44.400 15:52:34 -- nvmf/common.sh@469 -- # nvmfpid=2326505 00:08:44.400 15:52:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:44.400 15:52:34 -- nvmf/common.sh@470 -- # waitforlisten 2326505 00:08:44.400 15:52:34 -- common/autotest_common.sh@819 -- # '[' -z 2326505 ']' 00:08:44.400 15:52:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:44.400 15:52:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:44.400 15:52:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:44.400 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:44.400 15:52:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:44.400 15:52:34 -- common/autotest_common.sh@10 -- # set +x 00:08:44.400 [2024-10-30 15:52:34.165117] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:08:44.400 [2024-10-30 15:52:34.165196] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:44.400 EAL: No free 2048 kB hugepages reported on node 1 00:08:44.400 [2024-10-30 15:52:34.233587] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:44.658 [2024-10-30 15:52:34.324385] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:44.658 [2024-10-30 15:52:34.324530] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:44.658 [2024-10-30 15:52:34.324546] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:44.658 [2024-10-30 15:52:34.324559] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:44.658 [2024-10-30 15:52:34.324631] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:44.658 [2024-10-30 15:52:34.324657] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:44.658 [2024-10-30 15:52:34.324717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:44.658 [2024-10-30 15:52:34.324720] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:45.592 15:52:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:45.592 15:52:35 -- common/autotest_common.sh@852 -- # return 0 00:08:45.592 15:52:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:45.592 15:52:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:45.592 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:45.592 15:52:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:45.592 15:52:35 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:45.592 15:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:45.592 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:45.592 [2024-10-30 15:52:35.170946] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:45.592 15:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:45.592 15:52:35 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:08:45.592 15:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:45.592 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:45.592 [2024-10-30 15:52:35.183172] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:08:45.592 15:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:45.592 15:52:35 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:08:45.592 15:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:45.592 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:45.592 15:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:45.592 15:52:35 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:08:45.592 15:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:45.592 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:45.592 15:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:45.592 15:52:35 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:08:45.592 15:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:45.592 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:45.592 15:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:45.592 15:52:35 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:45.592 15:52:35 -- target/referrals.sh@48 -- # jq length 00:08:45.592 15:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:45.592 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:45.592 15:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:45.592 15:52:35 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:45.592 15:52:35 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:45.592 15:52:35 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:45.592 15:52:35 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:45.592 15:52:35 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:45.592 15:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:45.592 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:45.592 15:52:35 -- target/referrals.sh@21 -- # sort 00:08:45.592 15:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:45.592 15:52:35 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:45.592 15:52:35 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:45.592 15:52:35 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:45.592 15:52:35 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:45.592 15:52:35 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:45.592 15:52:35 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:45.592 15:52:35 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:45.592 15:52:35 -- target/referrals.sh@26 -- # sort 00:08:45.592 15:52:35 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:45.850 15:52:35 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:45.850 15:52:35 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:08:45.850 15:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:45.850 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:45.850 15:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:45.850 15:52:35 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:08:45.850 15:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:45.850 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:45.850 15:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:45.850 15:52:35 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:08:45.850 15:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:45.850 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:45.850 15:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:45.850 15:52:35 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:45.850 15:52:35 -- target/referrals.sh@56 -- # jq length 00:08:45.850 15:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:45.850 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:45.850 15:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:45.850 15:52:35 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:45.850 15:52:35 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:45.850 15:52:35 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:45.850 15:52:35 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:45.850 15:52:35 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:45.850 15:52:35 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:45.851 15:52:35 -- target/referrals.sh@26 -- # sort 00:08:46.108 15:52:35 -- target/referrals.sh@26 -- # echo 00:08:46.108 15:52:35 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:46.108 15:52:35 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:08:46.108 15:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:46.108 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:46.109 15:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:46.109 15:52:35 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:46.109 15:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:46.109 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:46.109 15:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:46.109 15:52:35 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:46.109 15:52:35 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:46.109 15:52:35 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:46.109 15:52:35 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:46.109 15:52:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:46.109 15:52:35 -- common/autotest_common.sh@10 -- # set +x 00:08:46.109 15:52:35 -- target/referrals.sh@21 -- # sort 00:08:46.109 15:52:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:46.109 15:52:35 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:46.109 15:52:35 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:46.109 15:52:35 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:46.109 15:52:35 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:46.109 15:52:35 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:46.109 15:52:35 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:46.109 15:52:35 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:46.109 15:52:35 -- target/referrals.sh@26 -- # sort 00:08:46.109 15:52:35 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:46.109 15:52:35 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:46.109 15:52:35 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:46.109 15:52:35 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:46.109 15:52:35 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:46.109 15:52:35 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:46.109 15:52:35 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:46.367 15:52:36 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:46.368 15:52:36 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:46.368 15:52:36 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:46.368 15:52:36 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:46.368 15:52:36 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:46.368 15:52:36 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:46.626 15:52:36 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:46.626 15:52:36 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:46.626 15:52:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:46.626 15:52:36 -- common/autotest_common.sh@10 -- # set +x 00:08:46.626 15:52:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:46.626 15:52:36 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:46.626 15:52:36 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:46.626 15:52:36 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:46.626 15:52:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:46.626 15:52:36 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:46.626 15:52:36 -- common/autotest_common.sh@10 -- # set +x 00:08:46.626 15:52:36 -- target/referrals.sh@21 -- # sort 00:08:46.626 15:52:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:46.626 15:52:36 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:46.626 15:52:36 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:46.626 15:52:36 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:46.626 15:52:36 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:46.626 15:52:36 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:46.626 15:52:36 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:46.626 15:52:36 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:46.626 15:52:36 -- target/referrals.sh@26 -- # sort 00:08:46.884 15:52:36 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:46.884 15:52:36 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:46.884 15:52:36 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:46.884 15:52:36 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:46.884 15:52:36 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:46.884 15:52:36 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:46.884 15:52:36 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:47.142 15:52:36 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:47.142 15:52:36 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:47.142 15:52:36 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:47.142 15:52:36 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:47.142 15:52:36 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:47.142 15:52:36 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:47.142 15:52:36 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:47.142 15:52:36 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:47.142 15:52:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.142 15:52:36 -- common/autotest_common.sh@10 -- # set +x 00:08:47.142 15:52:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.142 15:52:36 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:47.142 15:52:36 -- target/referrals.sh@82 -- # jq length 00:08:47.142 15:52:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:47.142 15:52:36 -- common/autotest_common.sh@10 -- # set +x 00:08:47.142 15:52:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:47.142 15:52:36 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:47.142 15:52:36 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:47.142 15:52:36 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:47.142 15:52:36 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:47.142 15:52:36 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:47.142 15:52:36 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:47.142 15:52:36 -- target/referrals.sh@26 -- # sort 00:08:47.400 15:52:37 -- target/referrals.sh@26 -- # echo 00:08:47.400 15:52:37 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:47.400 15:52:37 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:47.400 15:52:37 -- target/referrals.sh@86 -- # nvmftestfini 00:08:47.400 15:52:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:47.400 15:52:37 -- nvmf/common.sh@116 -- # sync 00:08:47.400 15:52:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:47.400 15:52:37 -- nvmf/common.sh@119 -- # set +e 00:08:47.400 15:52:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:47.400 15:52:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:47.400 rmmod nvme_tcp 00:08:47.400 rmmod nvme_fabrics 00:08:47.400 rmmod nvme_keyring 00:08:47.400 15:52:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:47.400 15:52:37 -- nvmf/common.sh@123 -- # set -e 00:08:47.400 15:52:37 -- nvmf/common.sh@124 -- # return 0 00:08:47.400 15:52:37 -- nvmf/common.sh@477 -- # '[' -n 2326505 ']' 00:08:47.400 15:52:37 -- nvmf/common.sh@478 -- # killprocess 2326505 00:08:47.400 15:52:37 -- common/autotest_common.sh@926 -- # '[' -z 2326505 ']' 00:08:47.400 15:52:37 -- common/autotest_common.sh@930 -- # kill -0 2326505 00:08:47.400 15:52:37 -- common/autotest_common.sh@931 -- # uname 00:08:47.400 15:52:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:08:47.400 15:52:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2326505 00:08:47.659 15:52:37 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:08:47.659 15:52:37 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:08:47.659 15:52:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2326505' 00:08:47.659 killing process with pid 2326505 00:08:47.659 15:52:37 -- common/autotest_common.sh@945 -- # kill 2326505 00:08:47.659 15:52:37 -- common/autotest_common.sh@950 -- # wait 2326505 00:08:47.659 15:52:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:47.659 15:52:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:47.659 15:52:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:47.659 15:52:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:47.659 15:52:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:47.659 15:52:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:47.659 15:52:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:47.659 15:52:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:50.193 15:52:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:50.193 00:08:50.193 real 0m7.668s 00:08:50.193 user 0m14.337s 00:08:50.193 sys 0m2.198s 00:08:50.193 15:52:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:08:50.193 15:52:39 -- common/autotest_common.sh@10 -- # set +x 00:08:50.193 ************************************ 00:08:50.193 END TEST nvmf_referrals 00:08:50.193 ************************************ 00:08:50.193 15:52:39 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:50.193 15:52:39 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:08:50.193 15:52:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:08:50.193 15:52:39 -- common/autotest_common.sh@10 -- # set +x 00:08:50.193 ************************************ 00:08:50.193 START TEST nvmf_connect_disconnect 00:08:50.193 ************************************ 00:08:50.193 15:52:39 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:50.193 * Looking for test storage... 00:08:50.193 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:50.193 15:52:39 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:50.193 15:52:39 -- nvmf/common.sh@7 -- # uname -s 00:08:50.193 15:52:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:50.193 15:52:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:50.193 15:52:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:50.193 15:52:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:50.193 15:52:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:50.193 15:52:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:50.193 15:52:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:50.193 15:52:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:50.193 15:52:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:50.193 15:52:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:50.193 15:52:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:50.193 15:52:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:50.193 15:52:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:50.193 15:52:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:50.193 15:52:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:50.193 15:52:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:50.193 15:52:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:50.193 15:52:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:50.193 15:52:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:50.193 15:52:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.193 15:52:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.193 15:52:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.193 15:52:39 -- paths/export.sh@5 -- # export PATH 00:08:50.193 15:52:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:50.193 15:52:39 -- nvmf/common.sh@46 -- # : 0 00:08:50.193 15:52:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:50.193 15:52:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:50.193 15:52:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:50.193 15:52:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:50.193 15:52:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:50.193 15:52:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:50.193 15:52:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:50.193 15:52:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:50.193 15:52:39 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:50.193 15:52:39 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:50.193 15:52:39 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:50.193 15:52:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:50.193 15:52:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:50.193 15:52:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:50.193 15:52:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:50.193 15:52:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:50.193 15:52:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:50.193 15:52:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:50.193 15:52:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:50.193 15:52:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:50.193 15:52:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:50.193 15:52:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:50.193 15:52:39 -- common/autotest_common.sh@10 -- # set +x 00:08:52.093 15:52:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:52.093 15:52:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:52.093 15:52:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:52.093 15:52:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:52.093 15:52:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:52.093 15:52:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:52.093 15:52:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:52.093 15:52:41 -- nvmf/common.sh@294 -- # net_devs=() 00:08:52.093 15:52:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:52.093 15:52:41 -- nvmf/common.sh@295 -- # e810=() 00:08:52.093 15:52:41 -- nvmf/common.sh@295 -- # local -ga e810 00:08:52.093 15:52:41 -- nvmf/common.sh@296 -- # x722=() 00:08:52.093 15:52:41 -- nvmf/common.sh@296 -- # local -ga x722 00:08:52.093 15:52:41 -- nvmf/common.sh@297 -- # mlx=() 00:08:52.093 15:52:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:52.093 15:52:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:52.093 15:52:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:52.093 15:52:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:52.093 15:52:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:52.093 15:52:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:52.093 15:52:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:52.093 15:52:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:52.093 15:52:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:52.093 15:52:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:52.093 15:52:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:52.093 15:52:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:52.093 15:52:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:52.093 15:52:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:52.093 15:52:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:52.093 15:52:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:52.093 15:52:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:52.093 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:52.093 15:52:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:52.093 15:52:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:52.093 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:52.093 15:52:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:52.093 15:52:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:52.093 15:52:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:52.093 15:52:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:52.093 15:52:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:52.093 15:52:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:52.093 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:52.093 15:52:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:52.093 15:52:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:52.093 15:52:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:52.093 15:52:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:52.093 15:52:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:52.093 15:52:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:52.093 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:52.093 15:52:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:52.093 15:52:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:52.093 15:52:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:52.093 15:52:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:52.093 15:52:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:52.093 15:52:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:52.093 15:52:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:52.093 15:52:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:52.093 15:52:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:52.093 15:52:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:52.093 15:52:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:52.093 15:52:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:52.093 15:52:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:52.093 15:52:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:52.093 15:52:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:52.093 15:52:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:52.093 15:52:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:52.093 15:52:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:52.093 15:52:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:52.093 15:52:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:52.093 15:52:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:52.093 15:52:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:52.093 15:52:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:52.093 15:52:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:52.093 15:52:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:52.093 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:52.093 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:08:52.093 00:08:52.093 --- 10.0.0.2 ping statistics --- 00:08:52.093 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:52.093 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:08:52.093 15:52:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:52.093 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:52.093 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:08:52.093 00:08:52.093 --- 10.0.0.1 ping statistics --- 00:08:52.093 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:52.093 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:08:52.093 15:52:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:52.093 15:52:41 -- nvmf/common.sh@410 -- # return 0 00:08:52.093 15:52:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:52.094 15:52:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:52.094 15:52:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:52.094 15:52:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:52.094 15:52:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:52.094 15:52:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:52.094 15:52:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:52.094 15:52:41 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:08:52.094 15:52:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:52.094 15:52:41 -- common/autotest_common.sh@712 -- # xtrace_disable 00:08:52.094 15:52:41 -- common/autotest_common.sh@10 -- # set +x 00:08:52.094 15:52:41 -- nvmf/common.sh@469 -- # nvmfpid=2328952 00:08:52.094 15:52:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:52.094 15:52:41 -- nvmf/common.sh@470 -- # waitforlisten 2328952 00:08:52.094 15:52:41 -- common/autotest_common.sh@819 -- # '[' -z 2328952 ']' 00:08:52.094 15:52:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:52.094 15:52:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:08:52.094 15:52:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:52.094 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:52.094 15:52:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:08:52.094 15:52:41 -- common/autotest_common.sh@10 -- # set +x 00:08:52.094 [2024-10-30 15:52:41.792877] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:08:52.094 [2024-10-30 15:52:41.792960] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:52.094 EAL: No free 2048 kB hugepages reported on node 1 00:08:52.094 [2024-10-30 15:52:41.862792] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:52.094 [2024-10-30 15:52:41.959791] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:52.094 [2024-10-30 15:52:41.959942] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:52.094 [2024-10-30 15:52:41.959959] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:52.094 [2024-10-30 15:52:41.959970] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:52.094 [2024-10-30 15:52:41.960036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:52.094 [2024-10-30 15:52:41.960072] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:52.094 [2024-10-30 15:52:41.960130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:52.094 [2024-10-30 15:52:41.960133] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:53.027 15:52:42 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:08:53.027 15:52:42 -- common/autotest_common.sh@852 -- # return 0 00:08:53.027 15:52:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:53.027 15:52:42 -- common/autotest_common.sh@718 -- # xtrace_disable 00:08:53.027 15:52:42 -- common/autotest_common.sh@10 -- # set +x 00:08:53.027 15:52:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:53.027 15:52:42 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:53.027 15:52:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:53.027 15:52:42 -- common/autotest_common.sh@10 -- # set +x 00:08:53.027 [2024-10-30 15:52:42.843110] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:53.027 15:52:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:53.027 15:52:42 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:08:53.027 15:52:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:53.027 15:52:42 -- common/autotest_common.sh@10 -- # set +x 00:08:53.027 15:52:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:53.027 15:52:42 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:08:53.027 15:52:42 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:53.027 15:52:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:53.027 15:52:42 -- common/autotest_common.sh@10 -- # set +x 00:08:53.027 15:52:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:53.027 15:52:42 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:53.027 15:52:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:53.027 15:52:42 -- common/autotest_common.sh@10 -- # set +x 00:08:53.027 15:52:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:53.027 15:52:42 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:53.027 15:52:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:08:53.027 15:52:42 -- common/autotest_common.sh@10 -- # set +x 00:08:53.027 [2024-10-30 15:52:42.894313] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:53.027 15:52:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:08:53.027 15:52:42 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:08:53.027 15:52:42 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:08:53.027 15:52:42 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:08:53.027 15:52:42 -- target/connect_disconnect.sh@34 -- # set +x 00:08:55.607 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.132 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.028 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.555 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.084 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.984 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.511 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.035 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.563 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.461 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.990 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.517 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.415 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.966 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.499 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.398 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.925 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.453 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.349 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.941 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.495 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.391 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.917 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.438 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.332 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.856 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.384 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.281 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.808 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.336 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.234 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.764 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.291 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.183 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.710 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.240 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.137 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.658 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.561 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.154 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.680 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.577 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.104 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.629 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.527 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.053 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.580 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.480 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.036 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.564 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:51.459 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.986 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.884 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.412 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.940 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.466 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.363 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.890 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.851 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.376 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.272 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.799 [2024-10-30 15:55:06.401116] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1690e00 is same with the state(5) to be set 00:11:16.799 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:19.327 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.224 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.751 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.298 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.196 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.721 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.620 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.148 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.674 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.199 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.098 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.623 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.520 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.045 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:51.570 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:53.538 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:56.064 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:57.963 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:00.488 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:03.011 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.905 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.430 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.953 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.849 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.372 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.894 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:19.417 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:21.314 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.837 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.733 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:28.258 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.783 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:32.679 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:35.206 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:37.201 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:39.724 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:42.244 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.770 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.770 15:56:34 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:12:44.770 15:56:34 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:12:44.770 15:56:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:44.770 15:56:34 -- nvmf/common.sh@116 -- # sync 00:12:44.770 15:56:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:44.770 15:56:34 -- nvmf/common.sh@119 -- # set +e 00:12:44.770 15:56:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:44.770 15:56:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:44.770 rmmod nvme_tcp 00:12:44.770 rmmod nvme_fabrics 00:12:44.770 rmmod nvme_keyring 00:12:44.770 15:56:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:44.770 15:56:34 -- nvmf/common.sh@123 -- # set -e 00:12:44.770 15:56:34 -- nvmf/common.sh@124 -- # return 0 00:12:44.770 15:56:34 -- nvmf/common.sh@477 -- # '[' -n 2328952 ']' 00:12:44.770 15:56:34 -- nvmf/common.sh@478 -- # killprocess 2328952 00:12:44.770 15:56:34 -- common/autotest_common.sh@926 -- # '[' -z 2328952 ']' 00:12:44.770 15:56:34 -- common/autotest_common.sh@930 -- # kill -0 2328952 00:12:44.770 15:56:34 -- common/autotest_common.sh@931 -- # uname 00:12:44.770 15:56:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:44.770 15:56:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2328952 00:12:44.770 15:56:34 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:44.770 15:56:34 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:44.770 15:56:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2328952' 00:12:44.770 killing process with pid 2328952 00:12:44.770 15:56:34 -- common/autotest_common.sh@945 -- # kill 2328952 00:12:44.770 15:56:34 -- common/autotest_common.sh@950 -- # wait 2328952 00:12:44.770 15:56:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:44.770 15:56:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:44.770 15:56:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:44.770 15:56:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:44.770 15:56:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:44.770 15:56:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:44.770 15:56:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:44.770 15:56:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:46.672 15:56:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:46.672 00:12:46.672 real 3m56.899s 00:12:46.672 user 15m3.954s 00:12:46.672 sys 0m34.676s 00:12:46.672 15:56:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:46.672 15:56:36 -- common/autotest_common.sh@10 -- # set +x 00:12:46.672 ************************************ 00:12:46.672 END TEST nvmf_connect_disconnect 00:12:46.672 ************************************ 00:12:46.672 15:56:36 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:46.672 15:56:36 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:46.672 15:56:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:46.672 15:56:36 -- common/autotest_common.sh@10 -- # set +x 00:12:46.672 ************************************ 00:12:46.672 START TEST nvmf_multitarget 00:12:46.672 ************************************ 00:12:46.672 15:56:36 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:46.930 * Looking for test storage... 00:12:46.930 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:46.930 15:56:36 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:46.930 15:56:36 -- nvmf/common.sh@7 -- # uname -s 00:12:46.930 15:56:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:46.930 15:56:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:46.930 15:56:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:46.930 15:56:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:46.930 15:56:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:46.930 15:56:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:46.930 15:56:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:46.930 15:56:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:46.930 15:56:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:46.930 15:56:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:46.930 15:56:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:46.930 15:56:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:46.930 15:56:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:46.930 15:56:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:46.930 15:56:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:46.930 15:56:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:46.930 15:56:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:46.930 15:56:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:46.930 15:56:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:46.930 15:56:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:46.930 15:56:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:46.931 15:56:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:46.931 15:56:36 -- paths/export.sh@5 -- # export PATH 00:12:46.931 15:56:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:46.931 15:56:36 -- nvmf/common.sh@46 -- # : 0 00:12:46.931 15:56:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:46.931 15:56:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:46.931 15:56:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:46.931 15:56:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:46.931 15:56:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:46.931 15:56:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:46.931 15:56:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:46.931 15:56:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:46.931 15:56:36 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:46.931 15:56:36 -- target/multitarget.sh@15 -- # nvmftestinit 00:12:46.931 15:56:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:46.931 15:56:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:46.931 15:56:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:46.931 15:56:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:46.931 15:56:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:46.931 15:56:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:46.931 15:56:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:46.931 15:56:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:46.931 15:56:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:46.931 15:56:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:46.931 15:56:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:46.931 15:56:36 -- common/autotest_common.sh@10 -- # set +x 00:12:48.829 15:56:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:48.829 15:56:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:48.829 15:56:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:48.829 15:56:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:48.829 15:56:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:48.829 15:56:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:48.829 15:56:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:48.829 15:56:38 -- nvmf/common.sh@294 -- # net_devs=() 00:12:48.829 15:56:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:48.829 15:56:38 -- nvmf/common.sh@295 -- # e810=() 00:12:48.829 15:56:38 -- nvmf/common.sh@295 -- # local -ga e810 00:12:48.829 15:56:38 -- nvmf/common.sh@296 -- # x722=() 00:12:48.829 15:56:38 -- nvmf/common.sh@296 -- # local -ga x722 00:12:48.829 15:56:38 -- nvmf/common.sh@297 -- # mlx=() 00:12:48.829 15:56:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:48.829 15:56:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:48.829 15:56:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:48.829 15:56:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:48.829 15:56:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:48.829 15:56:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:48.829 15:56:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:48.829 15:56:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:48.829 15:56:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:48.829 15:56:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:48.829 15:56:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:48.829 15:56:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:48.829 15:56:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:48.829 15:56:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:48.829 15:56:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:48.829 15:56:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:48.829 15:56:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:48.829 15:56:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:48.829 15:56:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:48.829 15:56:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:48.830 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:48.830 15:56:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:48.830 15:56:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:48.830 15:56:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:48.830 15:56:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:48.830 15:56:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:48.830 15:56:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:48.830 15:56:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:48.830 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:48.830 15:56:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:48.830 15:56:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:48.830 15:56:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:48.830 15:56:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:48.830 15:56:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:48.830 15:56:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:48.830 15:56:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:48.830 15:56:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:48.830 15:56:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:48.830 15:56:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:48.830 15:56:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:48.830 15:56:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:48.830 15:56:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:48.830 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:48.830 15:56:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:48.830 15:56:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:48.830 15:56:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:48.830 15:56:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:48.830 15:56:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:48.830 15:56:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:48.830 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:48.830 15:56:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:48.830 15:56:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:48.830 15:56:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:48.830 15:56:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:48.830 15:56:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:48.830 15:56:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:48.830 15:56:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:48.830 15:56:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:48.830 15:56:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:48.830 15:56:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:48.830 15:56:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:48.830 15:56:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:48.830 15:56:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:48.830 15:56:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:48.830 15:56:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:48.830 15:56:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:48.830 15:56:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:48.830 15:56:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:48.830 15:56:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:48.830 15:56:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:48.830 15:56:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:49.089 15:56:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:49.089 15:56:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:49.089 15:56:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:49.089 15:56:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:49.089 15:56:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:49.089 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:49.089 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.308 ms 00:12:49.089 00:12:49.089 --- 10.0.0.2 ping statistics --- 00:12:49.089 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:49.089 rtt min/avg/max/mdev = 0.308/0.308/0.308/0.000 ms 00:12:49.089 15:56:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:49.089 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:49.089 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:12:49.089 00:12:49.089 --- 10.0.0.1 ping statistics --- 00:12:49.089 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:49.089 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:12:49.089 15:56:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:49.089 15:56:38 -- nvmf/common.sh@410 -- # return 0 00:12:49.089 15:56:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:49.089 15:56:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:49.089 15:56:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:49.089 15:56:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:49.089 15:56:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:49.089 15:56:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:49.089 15:56:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:49.089 15:56:38 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:12:49.089 15:56:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:49.089 15:56:38 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:49.089 15:56:38 -- common/autotest_common.sh@10 -- # set +x 00:12:49.089 15:56:38 -- nvmf/common.sh@469 -- # nvmfpid=2360984 00:12:49.089 15:56:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:49.089 15:56:38 -- nvmf/common.sh@470 -- # waitforlisten 2360984 00:12:49.089 15:56:38 -- common/autotest_common.sh@819 -- # '[' -z 2360984 ']' 00:12:49.089 15:56:38 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:49.089 15:56:38 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:49.089 15:56:38 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:49.089 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:49.089 15:56:38 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:49.089 15:56:38 -- common/autotest_common.sh@10 -- # set +x 00:12:49.089 [2024-10-30 15:56:38.848461] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:12:49.089 [2024-10-30 15:56:38.848539] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:49.089 EAL: No free 2048 kB hugepages reported on node 1 00:12:49.089 [2024-10-30 15:56:38.915640] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:49.347 [2024-10-30 15:56:39.005758] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:49.347 [2024-10-30 15:56:39.005891] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:49.347 [2024-10-30 15:56:39.005909] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:49.347 [2024-10-30 15:56:39.005922] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:49.347 [2024-10-30 15:56:39.005974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:49.347 [2024-10-30 15:56:39.006001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:49.347 [2024-10-30 15:56:39.006119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:49.348 [2024-10-30 15:56:39.006121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:50.281 15:56:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:50.281 15:56:39 -- common/autotest_common.sh@852 -- # return 0 00:12:50.281 15:56:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:50.281 15:56:39 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:50.281 15:56:39 -- common/autotest_common.sh@10 -- # set +x 00:12:50.281 15:56:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:50.281 15:56:39 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:50.281 15:56:39 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:50.281 15:56:39 -- target/multitarget.sh@21 -- # jq length 00:12:50.281 15:56:40 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:12:50.281 15:56:40 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:12:50.281 "nvmf_tgt_1" 00:12:50.281 15:56:40 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:12:50.538 "nvmf_tgt_2" 00:12:50.538 15:56:40 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:50.538 15:56:40 -- target/multitarget.sh@28 -- # jq length 00:12:50.538 15:56:40 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:12:50.538 15:56:40 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:12:50.796 true 00:12:50.796 15:56:40 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:12:50.796 true 00:12:50.796 15:56:40 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:50.796 15:56:40 -- target/multitarget.sh@35 -- # jq length 00:12:51.054 15:56:40 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:12:51.054 15:56:40 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:12:51.054 15:56:40 -- target/multitarget.sh@41 -- # nvmftestfini 00:12:51.054 15:56:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:51.054 15:56:40 -- nvmf/common.sh@116 -- # sync 00:12:51.054 15:56:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:51.054 15:56:40 -- nvmf/common.sh@119 -- # set +e 00:12:51.054 15:56:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:51.054 15:56:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:51.054 rmmod nvme_tcp 00:12:51.054 rmmod nvme_fabrics 00:12:51.054 rmmod nvme_keyring 00:12:51.054 15:56:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:51.054 15:56:40 -- nvmf/common.sh@123 -- # set -e 00:12:51.054 15:56:40 -- nvmf/common.sh@124 -- # return 0 00:12:51.054 15:56:40 -- nvmf/common.sh@477 -- # '[' -n 2360984 ']' 00:12:51.054 15:56:40 -- nvmf/common.sh@478 -- # killprocess 2360984 00:12:51.054 15:56:40 -- common/autotest_common.sh@926 -- # '[' -z 2360984 ']' 00:12:51.054 15:56:40 -- common/autotest_common.sh@930 -- # kill -0 2360984 00:12:51.054 15:56:40 -- common/autotest_common.sh@931 -- # uname 00:12:51.054 15:56:40 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:51.054 15:56:40 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2360984 00:12:51.054 15:56:40 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:12:51.054 15:56:40 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:12:51.054 15:56:40 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2360984' 00:12:51.054 killing process with pid 2360984 00:12:51.054 15:56:40 -- common/autotest_common.sh@945 -- # kill 2360984 00:12:51.054 15:56:40 -- common/autotest_common.sh@950 -- # wait 2360984 00:12:51.314 15:56:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:51.314 15:56:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:51.314 15:56:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:51.314 15:56:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:51.314 15:56:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:51.314 15:56:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:51.314 15:56:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:51.314 15:56:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:53.220 15:56:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:53.220 00:12:53.220 real 0m6.552s 00:12:53.220 user 0m9.726s 00:12:53.220 sys 0m2.013s 00:12:53.220 15:56:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:53.220 15:56:43 -- common/autotest_common.sh@10 -- # set +x 00:12:53.220 ************************************ 00:12:53.220 END TEST nvmf_multitarget 00:12:53.220 ************************************ 00:12:53.220 15:56:43 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:53.220 15:56:43 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:53.220 15:56:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:53.220 15:56:43 -- common/autotest_common.sh@10 -- # set +x 00:12:53.220 ************************************ 00:12:53.220 START TEST nvmf_rpc 00:12:53.220 ************************************ 00:12:53.220 15:56:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:53.479 * Looking for test storage... 00:12:53.479 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:53.479 15:56:43 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:53.479 15:56:43 -- nvmf/common.sh@7 -- # uname -s 00:12:53.479 15:56:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:53.479 15:56:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:53.479 15:56:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:53.479 15:56:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:53.479 15:56:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:53.479 15:56:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:53.479 15:56:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:53.479 15:56:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:53.479 15:56:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:53.479 15:56:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:53.479 15:56:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:53.479 15:56:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:53.479 15:56:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:53.479 15:56:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:53.479 15:56:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:53.479 15:56:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:53.479 15:56:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:53.479 15:56:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:53.479 15:56:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:53.479 15:56:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.479 15:56:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.479 15:56:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.479 15:56:43 -- paths/export.sh@5 -- # export PATH 00:12:53.479 15:56:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:53.479 15:56:43 -- nvmf/common.sh@46 -- # : 0 00:12:53.479 15:56:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:53.479 15:56:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:53.479 15:56:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:53.479 15:56:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:53.479 15:56:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:53.479 15:56:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:53.479 15:56:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:53.479 15:56:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:53.479 15:56:43 -- target/rpc.sh@11 -- # loops=5 00:12:53.479 15:56:43 -- target/rpc.sh@23 -- # nvmftestinit 00:12:53.479 15:56:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:53.479 15:56:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:53.479 15:56:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:53.480 15:56:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:53.480 15:56:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:53.480 15:56:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:53.480 15:56:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:53.480 15:56:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:53.480 15:56:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:53.480 15:56:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:53.480 15:56:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:53.480 15:56:43 -- common/autotest_common.sh@10 -- # set +x 00:12:55.383 15:56:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:55.383 15:56:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:55.383 15:56:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:55.383 15:56:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:55.383 15:56:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:55.383 15:56:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:55.383 15:56:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:55.383 15:56:45 -- nvmf/common.sh@294 -- # net_devs=() 00:12:55.383 15:56:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:55.383 15:56:45 -- nvmf/common.sh@295 -- # e810=() 00:12:55.383 15:56:45 -- nvmf/common.sh@295 -- # local -ga e810 00:12:55.383 15:56:45 -- nvmf/common.sh@296 -- # x722=() 00:12:55.383 15:56:45 -- nvmf/common.sh@296 -- # local -ga x722 00:12:55.383 15:56:45 -- nvmf/common.sh@297 -- # mlx=() 00:12:55.383 15:56:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:55.383 15:56:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:55.383 15:56:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:55.383 15:56:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:55.383 15:56:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:55.383 15:56:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:55.383 15:56:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:55.383 15:56:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:55.383 15:56:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:55.383 15:56:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:55.383 15:56:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:55.383 15:56:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:55.383 15:56:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:55.383 15:56:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:55.383 15:56:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:55.383 15:56:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:55.383 15:56:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:55.383 15:56:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:55.383 15:56:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:55.384 15:56:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:55.384 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:55.384 15:56:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:55.384 15:56:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:55.384 15:56:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:55.384 15:56:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:55.384 15:56:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:55.384 15:56:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:55.384 15:56:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:55.384 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:55.384 15:56:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:55.384 15:56:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:55.384 15:56:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:55.384 15:56:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:55.384 15:56:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:55.384 15:56:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:55.384 15:56:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:55.384 15:56:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:55.384 15:56:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:55.384 15:56:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:55.384 15:56:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:55.384 15:56:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:55.384 15:56:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:55.384 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:55.384 15:56:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:55.384 15:56:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:55.384 15:56:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:55.384 15:56:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:55.384 15:56:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:55.384 15:56:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:55.384 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:55.384 15:56:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:55.384 15:56:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:55.384 15:56:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:55.384 15:56:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:55.384 15:56:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:55.384 15:56:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:55.384 15:56:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:55.384 15:56:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:55.384 15:56:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:55.384 15:56:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:55.384 15:56:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:55.384 15:56:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:55.384 15:56:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:55.384 15:56:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:55.384 15:56:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:55.384 15:56:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:55.384 15:56:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:55.384 15:56:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:55.384 15:56:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:55.643 15:56:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:55.643 15:56:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:55.643 15:56:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:55.643 15:56:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:55.643 15:56:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:55.643 15:56:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:55.643 15:56:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:55.643 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:55.643 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.396 ms 00:12:55.643 00:12:55.643 --- 10.0.0.2 ping statistics --- 00:12:55.643 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:55.643 rtt min/avg/max/mdev = 0.396/0.396/0.396/0.000 ms 00:12:55.643 15:56:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:55.643 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:55.643 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.149 ms 00:12:55.643 00:12:55.643 --- 10.0.0.1 ping statistics --- 00:12:55.643 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:55.643 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:12:55.643 15:56:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:55.643 15:56:45 -- nvmf/common.sh@410 -- # return 0 00:12:55.643 15:56:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:55.643 15:56:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:55.643 15:56:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:55.643 15:56:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:55.643 15:56:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:55.643 15:56:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:55.643 15:56:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:55.643 15:56:45 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:55.643 15:56:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:55.643 15:56:45 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:55.643 15:56:45 -- common/autotest_common.sh@10 -- # set +x 00:12:55.643 15:56:45 -- nvmf/common.sh@469 -- # nvmfpid=2363113 00:12:55.643 15:56:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:55.643 15:56:45 -- nvmf/common.sh@470 -- # waitforlisten 2363113 00:12:55.643 15:56:45 -- common/autotest_common.sh@819 -- # '[' -z 2363113 ']' 00:12:55.643 15:56:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:55.643 15:56:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:55.643 15:56:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:55.643 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:55.643 15:56:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:55.643 15:56:45 -- common/autotest_common.sh@10 -- # set +x 00:12:55.643 [2024-10-30 15:56:45.411856] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:12:55.643 [2024-10-30 15:56:45.411920] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:55.643 EAL: No free 2048 kB hugepages reported on node 1 00:12:55.643 [2024-10-30 15:56:45.484592] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:55.901 [2024-10-30 15:56:45.576718] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:55.901 [2024-10-30 15:56:45.576891] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:55.901 [2024-10-30 15:56:45.576911] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:55.901 [2024-10-30 15:56:45.576925] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:55.901 [2024-10-30 15:56:45.577005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:55.901 [2024-10-30 15:56:45.577060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:55.901 [2024-10-30 15:56:45.577116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:55.901 [2024-10-30 15:56:45.577118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:56.833 15:56:46 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:56.833 15:56:46 -- common/autotest_common.sh@852 -- # return 0 00:12:56.833 15:56:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:56.833 15:56:46 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:56.833 15:56:46 -- common/autotest_common.sh@10 -- # set +x 00:12:56.833 15:56:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:56.833 15:56:46 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:56.833 15:56:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.833 15:56:46 -- common/autotest_common.sh@10 -- # set +x 00:12:56.833 15:56:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:56.833 15:56:46 -- target/rpc.sh@26 -- # stats='{ 00:12:56.833 "tick_rate": 2700000000, 00:12:56.833 "poll_groups": [ 00:12:56.833 { 00:12:56.833 "name": "nvmf_tgt_poll_group_0", 00:12:56.833 "admin_qpairs": 0, 00:12:56.833 "io_qpairs": 0, 00:12:56.833 "current_admin_qpairs": 0, 00:12:56.833 "current_io_qpairs": 0, 00:12:56.833 "pending_bdev_io": 0, 00:12:56.833 "completed_nvme_io": 0, 00:12:56.833 "transports": [] 00:12:56.833 }, 00:12:56.833 { 00:12:56.833 "name": "nvmf_tgt_poll_group_1", 00:12:56.833 "admin_qpairs": 0, 00:12:56.833 "io_qpairs": 0, 00:12:56.833 "current_admin_qpairs": 0, 00:12:56.833 "current_io_qpairs": 0, 00:12:56.833 "pending_bdev_io": 0, 00:12:56.833 "completed_nvme_io": 0, 00:12:56.833 "transports": [] 00:12:56.833 }, 00:12:56.833 { 00:12:56.833 "name": "nvmf_tgt_poll_group_2", 00:12:56.833 "admin_qpairs": 0, 00:12:56.833 "io_qpairs": 0, 00:12:56.833 "current_admin_qpairs": 0, 00:12:56.833 "current_io_qpairs": 0, 00:12:56.833 "pending_bdev_io": 0, 00:12:56.833 "completed_nvme_io": 0, 00:12:56.833 "transports": [] 00:12:56.833 }, 00:12:56.833 { 00:12:56.833 "name": "nvmf_tgt_poll_group_3", 00:12:56.833 "admin_qpairs": 0, 00:12:56.833 "io_qpairs": 0, 00:12:56.833 "current_admin_qpairs": 0, 00:12:56.833 "current_io_qpairs": 0, 00:12:56.833 "pending_bdev_io": 0, 00:12:56.833 "completed_nvme_io": 0, 00:12:56.833 "transports": [] 00:12:56.833 } 00:12:56.833 ] 00:12:56.833 }' 00:12:56.833 15:56:46 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:56.833 15:56:46 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:56.833 15:56:46 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:56.833 15:56:46 -- target/rpc.sh@15 -- # wc -l 00:12:56.833 15:56:46 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:56.833 15:56:46 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:56.833 15:56:46 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:56.833 15:56:46 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:56.833 15:56:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.833 15:56:46 -- common/autotest_common.sh@10 -- # set +x 00:12:56.833 [2024-10-30 15:56:46.478089] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:56.833 15:56:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:56.833 15:56:46 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:56.833 15:56:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.833 15:56:46 -- common/autotest_common.sh@10 -- # set +x 00:12:56.833 15:56:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:56.833 15:56:46 -- target/rpc.sh@33 -- # stats='{ 00:12:56.833 "tick_rate": 2700000000, 00:12:56.833 "poll_groups": [ 00:12:56.833 { 00:12:56.833 "name": "nvmf_tgt_poll_group_0", 00:12:56.833 "admin_qpairs": 0, 00:12:56.833 "io_qpairs": 0, 00:12:56.833 "current_admin_qpairs": 0, 00:12:56.833 "current_io_qpairs": 0, 00:12:56.833 "pending_bdev_io": 0, 00:12:56.833 "completed_nvme_io": 0, 00:12:56.833 "transports": [ 00:12:56.833 { 00:12:56.833 "trtype": "TCP" 00:12:56.833 } 00:12:56.833 ] 00:12:56.833 }, 00:12:56.833 { 00:12:56.833 "name": "nvmf_tgt_poll_group_1", 00:12:56.833 "admin_qpairs": 0, 00:12:56.833 "io_qpairs": 0, 00:12:56.833 "current_admin_qpairs": 0, 00:12:56.833 "current_io_qpairs": 0, 00:12:56.833 "pending_bdev_io": 0, 00:12:56.833 "completed_nvme_io": 0, 00:12:56.833 "transports": [ 00:12:56.833 { 00:12:56.833 "trtype": "TCP" 00:12:56.833 } 00:12:56.833 ] 00:12:56.833 }, 00:12:56.833 { 00:12:56.833 "name": "nvmf_tgt_poll_group_2", 00:12:56.833 "admin_qpairs": 0, 00:12:56.833 "io_qpairs": 0, 00:12:56.833 "current_admin_qpairs": 0, 00:12:56.833 "current_io_qpairs": 0, 00:12:56.833 "pending_bdev_io": 0, 00:12:56.833 "completed_nvme_io": 0, 00:12:56.833 "transports": [ 00:12:56.833 { 00:12:56.833 "trtype": "TCP" 00:12:56.833 } 00:12:56.833 ] 00:12:56.833 }, 00:12:56.833 { 00:12:56.833 "name": "nvmf_tgt_poll_group_3", 00:12:56.833 "admin_qpairs": 0, 00:12:56.833 "io_qpairs": 0, 00:12:56.833 "current_admin_qpairs": 0, 00:12:56.833 "current_io_qpairs": 0, 00:12:56.833 "pending_bdev_io": 0, 00:12:56.833 "completed_nvme_io": 0, 00:12:56.834 "transports": [ 00:12:56.834 { 00:12:56.834 "trtype": "TCP" 00:12:56.834 } 00:12:56.834 ] 00:12:56.834 } 00:12:56.834 ] 00:12:56.834 }' 00:12:56.834 15:56:46 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:56.834 15:56:46 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:56.834 15:56:46 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:56.834 15:56:46 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:56.834 15:56:46 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:56.834 15:56:46 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:56.834 15:56:46 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:56.834 15:56:46 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:56.834 15:56:46 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:56.834 15:56:46 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:56.834 15:56:46 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:12:56.834 15:56:46 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:56.834 15:56:46 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:56.834 15:56:46 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:56.834 15:56:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.834 15:56:46 -- common/autotest_common.sh@10 -- # set +x 00:12:56.834 Malloc1 00:12:56.834 15:56:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:56.834 15:56:46 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:56.834 15:56:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.834 15:56:46 -- common/autotest_common.sh@10 -- # set +x 00:12:56.834 15:56:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:56.834 15:56:46 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:56.834 15:56:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.834 15:56:46 -- common/autotest_common.sh@10 -- # set +x 00:12:56.834 15:56:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:56.834 15:56:46 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:56.834 15:56:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.834 15:56:46 -- common/autotest_common.sh@10 -- # set +x 00:12:56.834 15:56:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:56.834 15:56:46 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:56.834 15:56:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.834 15:56:46 -- common/autotest_common.sh@10 -- # set +x 00:12:56.834 [2024-10-30 15:56:46.627039] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:56.834 15:56:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:56.834 15:56:46 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:56.834 15:56:46 -- common/autotest_common.sh@640 -- # local es=0 00:12:56.834 15:56:46 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:56.834 15:56:46 -- common/autotest_common.sh@628 -- # local arg=nvme 00:12:56.834 15:56:46 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:56.834 15:56:46 -- common/autotest_common.sh@632 -- # type -t nvme 00:12:56.834 15:56:46 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:56.834 15:56:46 -- common/autotest_common.sh@634 -- # type -P nvme 00:12:56.834 15:56:46 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:56.834 15:56:46 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:12:56.834 15:56:46 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:12:56.834 15:56:46 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:56.834 [2024-10-30 15:56:46.649547] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:56.834 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:56.834 could not add new controller: failed to write to nvme-fabrics device 00:12:56.834 15:56:46 -- common/autotest_common.sh@643 -- # es=1 00:12:56.834 15:56:46 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:12:56.834 15:56:46 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:12:56.834 15:56:46 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:12:56.834 15:56:46 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:56.834 15:56:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:56.834 15:56:46 -- common/autotest_common.sh@10 -- # set +x 00:12:56.834 15:56:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:56.834 15:56:46 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:57.766 15:56:47 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:57.766 15:56:47 -- common/autotest_common.sh@1177 -- # local i=0 00:12:57.766 15:56:47 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:12:57.766 15:56:47 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:12:57.766 15:56:47 -- common/autotest_common.sh@1184 -- # sleep 2 00:12:59.663 15:56:49 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:12:59.663 15:56:49 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:12:59.663 15:56:49 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:12:59.663 15:56:49 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:12:59.663 15:56:49 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:12:59.663 15:56:49 -- common/autotest_common.sh@1187 -- # return 0 00:12:59.663 15:56:49 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:59.663 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:59.663 15:56:49 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:59.663 15:56:49 -- common/autotest_common.sh@1198 -- # local i=0 00:12:59.663 15:56:49 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:12:59.663 15:56:49 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:59.663 15:56:49 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:12:59.663 15:56:49 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:59.663 15:56:49 -- common/autotest_common.sh@1210 -- # return 0 00:12:59.663 15:56:49 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:59.663 15:56:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:59.663 15:56:49 -- common/autotest_common.sh@10 -- # set +x 00:12:59.663 15:56:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:59.663 15:56:49 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:59.663 15:56:49 -- common/autotest_common.sh@640 -- # local es=0 00:12:59.663 15:56:49 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:59.663 15:56:49 -- common/autotest_common.sh@628 -- # local arg=nvme 00:12:59.663 15:56:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:59.663 15:56:49 -- common/autotest_common.sh@632 -- # type -t nvme 00:12:59.663 15:56:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:59.663 15:56:49 -- common/autotest_common.sh@634 -- # type -P nvme 00:12:59.663 15:56:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:12:59.663 15:56:49 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:12:59.663 15:56:49 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:12:59.663 15:56:49 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:59.663 [2024-10-30 15:56:49.408545] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:59.663 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:59.663 could not add new controller: failed to write to nvme-fabrics device 00:12:59.663 15:56:49 -- common/autotest_common.sh@643 -- # es=1 00:12:59.663 15:56:49 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:12:59.663 15:56:49 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:12:59.663 15:56:49 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:12:59.663 15:56:49 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:59.664 15:56:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:59.664 15:56:49 -- common/autotest_common.sh@10 -- # set +x 00:12:59.664 15:56:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:59.664 15:56:49 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:00.229 15:56:50 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:00.229 15:56:50 -- common/autotest_common.sh@1177 -- # local i=0 00:13:00.229 15:56:50 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:00.229 15:56:50 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:00.229 15:56:50 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:02.753 15:56:52 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:02.753 15:56:52 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:02.753 15:56:52 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:02.753 15:56:52 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:02.753 15:56:52 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:02.753 15:56:52 -- common/autotest_common.sh@1187 -- # return 0 00:13:02.753 15:56:52 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:02.753 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:02.753 15:56:52 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:02.753 15:56:52 -- common/autotest_common.sh@1198 -- # local i=0 00:13:02.753 15:56:52 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:02.753 15:56:52 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:02.753 15:56:52 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:02.753 15:56:52 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:02.753 15:56:52 -- common/autotest_common.sh@1210 -- # return 0 00:13:02.753 15:56:52 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:02.753 15:56:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:02.753 15:56:52 -- common/autotest_common.sh@10 -- # set +x 00:13:02.753 15:56:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:02.753 15:56:52 -- target/rpc.sh@81 -- # seq 1 5 00:13:02.753 15:56:52 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:02.753 15:56:52 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:02.753 15:56:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:02.753 15:56:52 -- common/autotest_common.sh@10 -- # set +x 00:13:02.753 15:56:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:02.753 15:56:52 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:02.753 15:56:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:02.753 15:56:52 -- common/autotest_common.sh@10 -- # set +x 00:13:02.753 [2024-10-30 15:56:52.213708] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:02.753 15:56:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:02.753 15:56:52 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:02.753 15:56:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:02.753 15:56:52 -- common/autotest_common.sh@10 -- # set +x 00:13:02.753 15:56:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:02.753 15:56:52 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:02.753 15:56:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:02.753 15:56:52 -- common/autotest_common.sh@10 -- # set +x 00:13:02.753 15:56:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:02.753 15:56:52 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:03.318 15:56:52 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:03.318 15:56:52 -- common/autotest_common.sh@1177 -- # local i=0 00:13:03.318 15:56:52 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:03.318 15:56:52 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:03.318 15:56:52 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:05.215 15:56:54 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:05.215 15:56:54 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:05.215 15:56:54 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:05.215 15:56:54 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:05.215 15:56:54 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:05.215 15:56:54 -- common/autotest_common.sh@1187 -- # return 0 00:13:05.215 15:56:54 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:05.215 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:05.215 15:56:54 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:05.215 15:56:54 -- common/autotest_common.sh@1198 -- # local i=0 00:13:05.215 15:56:54 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:05.215 15:56:54 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:05.215 15:56:54 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:05.215 15:56:54 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:05.215 15:56:54 -- common/autotest_common.sh@1210 -- # return 0 00:13:05.215 15:56:54 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:05.215 15:56:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.215 15:56:54 -- common/autotest_common.sh@10 -- # set +x 00:13:05.215 15:56:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.215 15:56:55 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:05.215 15:56:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.215 15:56:55 -- common/autotest_common.sh@10 -- # set +x 00:13:05.215 15:56:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.215 15:56:55 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:05.215 15:56:55 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:05.215 15:56:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.215 15:56:55 -- common/autotest_common.sh@10 -- # set +x 00:13:05.215 15:56:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.215 15:56:55 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:05.215 15:56:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.215 15:56:55 -- common/autotest_common.sh@10 -- # set +x 00:13:05.215 [2024-10-30 15:56:55.025482] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:05.215 15:56:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.215 15:56:55 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:05.215 15:56:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.215 15:56:55 -- common/autotest_common.sh@10 -- # set +x 00:13:05.215 15:56:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.215 15:56:55 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:05.215 15:56:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.215 15:56:55 -- common/autotest_common.sh@10 -- # set +x 00:13:05.215 15:56:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.215 15:56:55 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:06.148 15:56:55 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:06.148 15:56:55 -- common/autotest_common.sh@1177 -- # local i=0 00:13:06.148 15:56:55 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:06.148 15:56:55 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:06.148 15:56:55 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:08.045 15:56:57 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:08.045 15:56:57 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:08.045 15:56:57 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:08.045 15:56:57 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:08.045 15:56:57 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:08.045 15:56:57 -- common/autotest_common.sh@1187 -- # return 0 00:13:08.045 15:56:57 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:08.045 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:08.045 15:56:57 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:08.045 15:56:57 -- common/autotest_common.sh@1198 -- # local i=0 00:13:08.045 15:56:57 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:08.045 15:56:57 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:08.303 15:56:57 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:08.303 15:56:57 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:08.303 15:56:57 -- common/autotest_common.sh@1210 -- # return 0 00:13:08.303 15:56:57 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:08.303 15:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.303 15:56:57 -- common/autotest_common.sh@10 -- # set +x 00:13:08.303 15:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.303 15:56:57 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:08.303 15:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.303 15:56:57 -- common/autotest_common.sh@10 -- # set +x 00:13:08.303 15:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.303 15:56:57 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:08.303 15:56:57 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:08.303 15:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.303 15:56:57 -- common/autotest_common.sh@10 -- # set +x 00:13:08.303 15:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.303 15:56:57 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:08.303 15:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.303 15:56:57 -- common/autotest_common.sh@10 -- # set +x 00:13:08.303 [2024-10-30 15:56:57.974119] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:08.303 15:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.303 15:56:57 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:08.303 15:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.303 15:56:57 -- common/autotest_common.sh@10 -- # set +x 00:13:08.303 15:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.303 15:56:57 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:08.303 15:56:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.303 15:56:57 -- common/autotest_common.sh@10 -- # set +x 00:13:08.303 15:56:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.303 15:56:57 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:08.868 15:56:58 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:08.868 15:56:58 -- common/autotest_common.sh@1177 -- # local i=0 00:13:08.868 15:56:58 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:08.868 15:56:58 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:08.868 15:56:58 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:11.394 15:57:00 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:11.394 15:57:00 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:11.394 15:57:00 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:11.394 15:57:00 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:11.394 15:57:00 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:11.394 15:57:00 -- common/autotest_common.sh@1187 -- # return 0 00:13:11.394 15:57:00 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:11.394 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:11.394 15:57:00 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:11.394 15:57:00 -- common/autotest_common.sh@1198 -- # local i=0 00:13:11.394 15:57:00 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:11.394 15:57:00 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:11.394 15:57:00 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:11.394 15:57:00 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:11.394 15:57:00 -- common/autotest_common.sh@1210 -- # return 0 00:13:11.394 15:57:00 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:11.394 15:57:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.394 15:57:00 -- common/autotest_common.sh@10 -- # set +x 00:13:11.394 15:57:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.394 15:57:00 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:11.394 15:57:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.394 15:57:00 -- common/autotest_common.sh@10 -- # set +x 00:13:11.394 15:57:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.394 15:57:00 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:11.394 15:57:00 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:11.394 15:57:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.394 15:57:00 -- common/autotest_common.sh@10 -- # set +x 00:13:11.394 15:57:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.394 15:57:00 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:11.394 15:57:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.394 15:57:00 -- common/autotest_common.sh@10 -- # set +x 00:13:11.394 [2024-10-30 15:57:00.794749] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:11.394 15:57:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.394 15:57:00 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:11.394 15:57:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.394 15:57:00 -- common/autotest_common.sh@10 -- # set +x 00:13:11.394 15:57:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.394 15:57:00 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:11.394 15:57:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:11.394 15:57:00 -- common/autotest_common.sh@10 -- # set +x 00:13:11.394 15:57:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:11.394 15:57:00 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:11.651 15:57:01 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:11.651 15:57:01 -- common/autotest_common.sh@1177 -- # local i=0 00:13:11.652 15:57:01 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:11.652 15:57:01 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:11.652 15:57:01 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:13.549 15:57:03 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:13.549 15:57:03 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:13.549 15:57:03 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:13.549 15:57:03 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:13.549 15:57:03 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:13.549 15:57:03 -- common/autotest_common.sh@1187 -- # return 0 00:13:13.549 15:57:03 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:13.807 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:13.807 15:57:03 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:13.807 15:57:03 -- common/autotest_common.sh@1198 -- # local i=0 00:13:13.807 15:57:03 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:13.807 15:57:03 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:13.807 15:57:03 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:13.807 15:57:03 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:13.807 15:57:03 -- common/autotest_common.sh@1210 -- # return 0 00:13:13.807 15:57:03 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:13.807 15:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.807 15:57:03 -- common/autotest_common.sh@10 -- # set +x 00:13:13.807 15:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.807 15:57:03 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:13.807 15:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.807 15:57:03 -- common/autotest_common.sh@10 -- # set +x 00:13:13.807 15:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.807 15:57:03 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:13.807 15:57:03 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:13.807 15:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.807 15:57:03 -- common/autotest_common.sh@10 -- # set +x 00:13:13.807 15:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.807 15:57:03 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:13.807 15:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.807 15:57:03 -- common/autotest_common.sh@10 -- # set +x 00:13:13.807 [2024-10-30 15:57:03.564023] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:13.807 15:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.807 15:57:03 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:13.807 15:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.807 15:57:03 -- common/autotest_common.sh@10 -- # set +x 00:13:13.807 15:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.807 15:57:03 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:13.807 15:57:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:13.807 15:57:03 -- common/autotest_common.sh@10 -- # set +x 00:13:13.807 15:57:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:13.807 15:57:03 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:14.372 15:57:04 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:14.372 15:57:04 -- common/autotest_common.sh@1177 -- # local i=0 00:13:14.372 15:57:04 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:14.372 15:57:04 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:13:14.372 15:57:04 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:16.325 15:57:06 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:16.325 15:57:06 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:16.325 15:57:06 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:16.325 15:57:06 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:13:16.325 15:57:06 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:16.325 15:57:06 -- common/autotest_common.sh@1187 -- # return 0 00:13:16.325 15:57:06 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:16.584 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:16.584 15:57:06 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:16.584 15:57:06 -- common/autotest_common.sh@1198 -- # local i=0 00:13:16.584 15:57:06 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:16.584 15:57:06 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:16.584 15:57:06 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:16.584 15:57:06 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:16.584 15:57:06 -- common/autotest_common.sh@1210 -- # return 0 00:13:16.584 15:57:06 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@99 -- # seq 1 5 00:13:16.584 15:57:06 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:16.584 15:57:06 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 [2024-10-30 15:57:06.338058] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:16.584 15:57:06 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 [2024-10-30 15:57:06.386106] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:16.584 15:57:06 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 [2024-10-30 15:57:06.434302] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.584 15:57:06 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.584 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.584 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.584 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.842 15:57:06 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:16.842 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.842 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.842 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.842 15:57:06 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:16.842 15:57:06 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:16.842 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.842 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.842 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.842 15:57:06 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:16.842 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.842 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.842 [2024-10-30 15:57:06.482457] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:16.842 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.842 15:57:06 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:16.842 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.842 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.842 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.842 15:57:06 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:16.842 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.842 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.842 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.842 15:57:06 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.842 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.842 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.842 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.842 15:57:06 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:16.842 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.843 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.843 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.843 15:57:06 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:16.843 15:57:06 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:16.843 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.843 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.843 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.843 15:57:06 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:16.843 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.843 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.843 [2024-10-30 15:57:06.530645] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:16.843 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.843 15:57:06 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:16.843 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.843 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.843 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.843 15:57:06 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:16.843 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.843 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.843 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.843 15:57:06 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.843 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.843 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.843 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.843 15:57:06 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:16.843 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.843 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.843 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.843 15:57:06 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:16.843 15:57:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:16.843 15:57:06 -- common/autotest_common.sh@10 -- # set +x 00:13:16.843 15:57:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:16.843 15:57:06 -- target/rpc.sh@110 -- # stats='{ 00:13:16.843 "tick_rate": 2700000000, 00:13:16.843 "poll_groups": [ 00:13:16.843 { 00:13:16.843 "name": "nvmf_tgt_poll_group_0", 00:13:16.843 "admin_qpairs": 2, 00:13:16.843 "io_qpairs": 84, 00:13:16.843 "current_admin_qpairs": 0, 00:13:16.843 "current_io_qpairs": 0, 00:13:16.843 "pending_bdev_io": 0, 00:13:16.843 "completed_nvme_io": 86, 00:13:16.843 "transports": [ 00:13:16.843 { 00:13:16.843 "trtype": "TCP" 00:13:16.843 } 00:13:16.843 ] 00:13:16.843 }, 00:13:16.843 { 00:13:16.843 "name": "nvmf_tgt_poll_group_1", 00:13:16.843 "admin_qpairs": 2, 00:13:16.843 "io_qpairs": 84, 00:13:16.843 "current_admin_qpairs": 0, 00:13:16.843 "current_io_qpairs": 0, 00:13:16.843 "pending_bdev_io": 0, 00:13:16.843 "completed_nvme_io": 235, 00:13:16.843 "transports": [ 00:13:16.843 { 00:13:16.843 "trtype": "TCP" 00:13:16.843 } 00:13:16.843 ] 00:13:16.843 }, 00:13:16.843 { 00:13:16.843 "name": "nvmf_tgt_poll_group_2", 00:13:16.843 "admin_qpairs": 1, 00:13:16.843 "io_qpairs": 84, 00:13:16.843 "current_admin_qpairs": 0, 00:13:16.843 "current_io_qpairs": 0, 00:13:16.843 "pending_bdev_io": 0, 00:13:16.843 "completed_nvme_io": 183, 00:13:16.843 "transports": [ 00:13:16.843 { 00:13:16.843 "trtype": "TCP" 00:13:16.843 } 00:13:16.843 ] 00:13:16.843 }, 00:13:16.843 { 00:13:16.843 "name": "nvmf_tgt_poll_group_3", 00:13:16.843 "admin_qpairs": 2, 00:13:16.843 "io_qpairs": 84, 00:13:16.843 "current_admin_qpairs": 0, 00:13:16.843 "current_io_qpairs": 0, 00:13:16.843 "pending_bdev_io": 0, 00:13:16.843 "completed_nvme_io": 182, 00:13:16.843 "transports": [ 00:13:16.843 { 00:13:16.843 "trtype": "TCP" 00:13:16.843 } 00:13:16.843 ] 00:13:16.843 } 00:13:16.843 ] 00:13:16.843 }' 00:13:16.843 15:57:06 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:16.843 15:57:06 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:16.843 15:57:06 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:16.843 15:57:06 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:16.843 15:57:06 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:16.843 15:57:06 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:16.843 15:57:06 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:16.843 15:57:06 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:16.843 15:57:06 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:16.843 15:57:06 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:16.843 15:57:06 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:16.843 15:57:06 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:16.843 15:57:06 -- target/rpc.sh@123 -- # nvmftestfini 00:13:16.843 15:57:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:16.843 15:57:06 -- nvmf/common.sh@116 -- # sync 00:13:16.843 15:57:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:16.843 15:57:06 -- nvmf/common.sh@119 -- # set +e 00:13:16.843 15:57:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:16.843 15:57:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:16.843 rmmod nvme_tcp 00:13:16.843 rmmod nvme_fabrics 00:13:16.843 rmmod nvme_keyring 00:13:16.843 15:57:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:16.843 15:57:06 -- nvmf/common.sh@123 -- # set -e 00:13:16.843 15:57:06 -- nvmf/common.sh@124 -- # return 0 00:13:16.843 15:57:06 -- nvmf/common.sh@477 -- # '[' -n 2363113 ']' 00:13:16.843 15:57:06 -- nvmf/common.sh@478 -- # killprocess 2363113 00:13:16.843 15:57:06 -- common/autotest_common.sh@926 -- # '[' -z 2363113 ']' 00:13:16.843 15:57:06 -- common/autotest_common.sh@930 -- # kill -0 2363113 00:13:16.843 15:57:06 -- common/autotest_common.sh@931 -- # uname 00:13:16.843 15:57:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:16.843 15:57:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2363113 00:13:17.102 15:57:06 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:13:17.102 15:57:06 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:13:17.102 15:57:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2363113' 00:13:17.102 killing process with pid 2363113 00:13:17.102 15:57:06 -- common/autotest_common.sh@945 -- # kill 2363113 00:13:17.102 15:57:06 -- common/autotest_common.sh@950 -- # wait 2363113 00:13:17.360 15:57:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:17.360 15:57:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:17.360 15:57:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:17.360 15:57:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:17.360 15:57:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:17.360 15:57:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:17.360 15:57:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:17.360 15:57:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:19.258 15:57:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:19.258 00:13:19.258 real 0m25.958s 00:13:19.258 user 1m24.959s 00:13:19.258 sys 0m4.256s 00:13:19.258 15:57:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:19.258 15:57:09 -- common/autotest_common.sh@10 -- # set +x 00:13:19.258 ************************************ 00:13:19.258 END TEST nvmf_rpc 00:13:19.258 ************************************ 00:13:19.258 15:57:09 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:19.258 15:57:09 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:19.258 15:57:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:19.258 15:57:09 -- common/autotest_common.sh@10 -- # set +x 00:13:19.258 ************************************ 00:13:19.258 START TEST nvmf_invalid 00:13:19.258 ************************************ 00:13:19.258 15:57:09 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:19.258 * Looking for test storage... 00:13:19.258 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:19.258 15:57:09 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:19.258 15:57:09 -- nvmf/common.sh@7 -- # uname -s 00:13:19.258 15:57:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:19.258 15:57:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:19.258 15:57:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:19.258 15:57:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:19.258 15:57:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:19.258 15:57:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:19.258 15:57:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:19.258 15:57:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:19.258 15:57:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:19.258 15:57:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:19.258 15:57:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:19.258 15:57:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:19.258 15:57:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:19.258 15:57:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:19.258 15:57:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:19.258 15:57:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:19.258 15:57:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:19.258 15:57:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:19.258 15:57:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:19.258 15:57:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.258 15:57:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.258 15:57:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.258 15:57:09 -- paths/export.sh@5 -- # export PATH 00:13:19.258 15:57:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.258 15:57:09 -- nvmf/common.sh@46 -- # : 0 00:13:19.258 15:57:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:19.258 15:57:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:19.258 15:57:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:19.258 15:57:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:19.258 15:57:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:19.258 15:57:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:19.258 15:57:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:19.258 15:57:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:19.516 15:57:09 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:19.516 15:57:09 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:19.516 15:57:09 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:19.516 15:57:09 -- target/invalid.sh@14 -- # target=foobar 00:13:19.516 15:57:09 -- target/invalid.sh@16 -- # RANDOM=0 00:13:19.516 15:57:09 -- target/invalid.sh@34 -- # nvmftestinit 00:13:19.516 15:57:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:19.516 15:57:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:19.516 15:57:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:19.516 15:57:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:19.516 15:57:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:19.516 15:57:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:19.516 15:57:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:19.516 15:57:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:19.516 15:57:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:19.516 15:57:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:19.516 15:57:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:19.516 15:57:09 -- common/autotest_common.sh@10 -- # set +x 00:13:21.418 15:57:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:21.418 15:57:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:21.418 15:57:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:21.418 15:57:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:21.418 15:57:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:21.418 15:57:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:21.418 15:57:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:21.418 15:57:11 -- nvmf/common.sh@294 -- # net_devs=() 00:13:21.418 15:57:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:21.418 15:57:11 -- nvmf/common.sh@295 -- # e810=() 00:13:21.418 15:57:11 -- nvmf/common.sh@295 -- # local -ga e810 00:13:21.418 15:57:11 -- nvmf/common.sh@296 -- # x722=() 00:13:21.418 15:57:11 -- nvmf/common.sh@296 -- # local -ga x722 00:13:21.418 15:57:11 -- nvmf/common.sh@297 -- # mlx=() 00:13:21.418 15:57:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:21.418 15:57:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:21.418 15:57:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:21.418 15:57:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:21.418 15:57:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:21.418 15:57:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:21.418 15:57:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:21.418 15:57:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:21.418 15:57:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:21.418 15:57:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:21.418 15:57:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:21.418 15:57:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:21.418 15:57:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:21.418 15:57:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:21.418 15:57:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:21.418 15:57:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:21.418 15:57:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:21.418 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:21.418 15:57:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:21.418 15:57:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:21.418 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:21.418 15:57:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:21.418 15:57:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:21.418 15:57:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:21.418 15:57:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:21.418 15:57:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:21.418 15:57:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:21.418 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:21.418 15:57:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:21.418 15:57:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:21.418 15:57:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:21.418 15:57:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:21.418 15:57:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:21.418 15:57:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:21.418 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:21.418 15:57:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:21.418 15:57:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:21.418 15:57:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:21.418 15:57:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:21.418 15:57:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:21.418 15:57:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:21.418 15:57:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:21.418 15:57:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:21.418 15:57:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:21.418 15:57:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:21.418 15:57:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:21.418 15:57:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:21.418 15:57:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:21.418 15:57:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:21.418 15:57:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:21.418 15:57:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:21.418 15:57:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:21.418 15:57:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:21.418 15:57:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:21.418 15:57:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:21.418 15:57:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:21.418 15:57:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:21.676 15:57:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:21.676 15:57:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:21.676 15:57:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:21.676 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:21.676 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:13:21.676 00:13:21.676 --- 10.0.0.2 ping statistics --- 00:13:21.676 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.676 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:13:21.676 15:57:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:21.676 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:21.676 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:13:21.676 00:13:21.676 --- 10.0.0.1 ping statistics --- 00:13:21.676 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.676 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:13:21.676 15:57:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:21.676 15:57:11 -- nvmf/common.sh@410 -- # return 0 00:13:21.676 15:57:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:21.676 15:57:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:21.676 15:57:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:21.676 15:57:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:21.676 15:57:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:21.676 15:57:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:21.676 15:57:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:21.676 15:57:11 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:21.676 15:57:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:21.676 15:57:11 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:21.676 15:57:11 -- common/autotest_common.sh@10 -- # set +x 00:13:21.676 15:57:11 -- nvmf/common.sh@469 -- # nvmfpid=2368435 00:13:21.676 15:57:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:21.676 15:57:11 -- nvmf/common.sh@470 -- # waitforlisten 2368435 00:13:21.676 15:57:11 -- common/autotest_common.sh@819 -- # '[' -z 2368435 ']' 00:13:21.676 15:57:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:21.676 15:57:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:21.676 15:57:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:21.676 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:21.676 15:57:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:21.676 15:57:11 -- common/autotest_common.sh@10 -- # set +x 00:13:21.676 [2024-10-30 15:57:11.397517] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:13:21.676 [2024-10-30 15:57:11.397606] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:21.676 EAL: No free 2048 kB hugepages reported on node 1 00:13:21.676 [2024-10-30 15:57:11.467221] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:21.932 [2024-10-30 15:57:11.558476] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:21.932 [2024-10-30 15:57:11.558624] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:21.932 [2024-10-30 15:57:11.558642] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:21.932 [2024-10-30 15:57:11.558655] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:21.932 [2024-10-30 15:57:11.558888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:21.932 [2024-10-30 15:57:11.558919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:21.932 [2024-10-30 15:57:11.558980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:21.932 [2024-10-30 15:57:11.558983] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:22.862 15:57:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:22.862 15:57:12 -- common/autotest_common.sh@852 -- # return 0 00:13:22.862 15:57:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:22.862 15:57:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:22.862 15:57:12 -- common/autotest_common.sh@10 -- # set +x 00:13:22.862 15:57:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:22.862 15:57:12 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:22.862 15:57:12 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode18998 00:13:22.862 [2024-10-30 15:57:12.653698] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:22.862 15:57:12 -- target/invalid.sh@40 -- # out='request: 00:13:22.862 { 00:13:22.862 "nqn": "nqn.2016-06.io.spdk:cnode18998", 00:13:22.862 "tgt_name": "foobar", 00:13:22.862 "method": "nvmf_create_subsystem", 00:13:22.862 "req_id": 1 00:13:22.862 } 00:13:22.862 Got JSON-RPC error response 00:13:22.862 response: 00:13:22.862 { 00:13:22.862 "code": -32603, 00:13:22.862 "message": "Unable to find target foobar" 00:13:22.862 }' 00:13:22.862 15:57:12 -- target/invalid.sh@41 -- # [[ request: 00:13:22.862 { 00:13:22.862 "nqn": "nqn.2016-06.io.spdk:cnode18998", 00:13:22.862 "tgt_name": "foobar", 00:13:22.862 "method": "nvmf_create_subsystem", 00:13:22.862 "req_id": 1 00:13:22.862 } 00:13:22.862 Got JSON-RPC error response 00:13:22.862 response: 00:13:22.862 { 00:13:22.862 "code": -32603, 00:13:22.862 "message": "Unable to find target foobar" 00:13:22.862 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:22.862 15:57:12 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:22.862 15:57:12 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode14334 00:13:23.118 [2024-10-30 15:57:12.922627] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14334: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:23.118 15:57:12 -- target/invalid.sh@45 -- # out='request: 00:13:23.118 { 00:13:23.118 "nqn": "nqn.2016-06.io.spdk:cnode14334", 00:13:23.118 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:23.118 "method": "nvmf_create_subsystem", 00:13:23.118 "req_id": 1 00:13:23.118 } 00:13:23.118 Got JSON-RPC error response 00:13:23.118 response: 00:13:23.118 { 00:13:23.118 "code": -32602, 00:13:23.118 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:23.118 }' 00:13:23.118 15:57:12 -- target/invalid.sh@46 -- # [[ request: 00:13:23.118 { 00:13:23.118 "nqn": "nqn.2016-06.io.spdk:cnode14334", 00:13:23.118 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:23.118 "method": "nvmf_create_subsystem", 00:13:23.118 "req_id": 1 00:13:23.118 } 00:13:23.118 Got JSON-RPC error response 00:13:23.118 response: 00:13:23.118 { 00:13:23.118 "code": -32602, 00:13:23.118 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:23.118 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:23.118 15:57:12 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:23.118 15:57:12 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode8098 00:13:23.375 [2024-10-30 15:57:13.227642] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8098: invalid model number 'SPDK_Controller' 00:13:23.375 15:57:13 -- target/invalid.sh@50 -- # out='request: 00:13:23.375 { 00:13:23.375 "nqn": "nqn.2016-06.io.spdk:cnode8098", 00:13:23.375 "model_number": "SPDK_Controller\u001f", 00:13:23.375 "method": "nvmf_create_subsystem", 00:13:23.375 "req_id": 1 00:13:23.375 } 00:13:23.375 Got JSON-RPC error response 00:13:23.375 response: 00:13:23.375 { 00:13:23.376 "code": -32602, 00:13:23.376 "message": "Invalid MN SPDK_Controller\u001f" 00:13:23.376 }' 00:13:23.376 15:57:13 -- target/invalid.sh@51 -- # [[ request: 00:13:23.376 { 00:13:23.376 "nqn": "nqn.2016-06.io.spdk:cnode8098", 00:13:23.376 "model_number": "SPDK_Controller\u001f", 00:13:23.376 "method": "nvmf_create_subsystem", 00:13:23.376 "req_id": 1 00:13:23.376 } 00:13:23.376 Got JSON-RPC error response 00:13:23.376 response: 00:13:23.376 { 00:13:23.376 "code": -32602, 00:13:23.376 "message": "Invalid MN SPDK_Controller\u001f" 00:13:23.376 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:23.376 15:57:13 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:23.376 15:57:13 -- target/invalid.sh@19 -- # local length=21 ll 00:13:23.376 15:57:13 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:23.376 15:57:13 -- target/invalid.sh@21 -- # local chars 00:13:23.376 15:57:13 -- target/invalid.sh@22 -- # local string 00:13:23.376 15:57:13 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:23.376 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.376 15:57:13 -- target/invalid.sh@25 -- # printf %x 35 00:13:23.376 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x23' 00:13:23.376 15:57:13 -- target/invalid.sh@25 -- # string+='#' 00:13:23.376 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.376 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.376 15:57:13 -- target/invalid.sh@25 -- # printf %x 44 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+=, 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 59 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+=';' 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 41 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x29' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+=')' 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 62 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+='>' 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 47 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+=/ 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 92 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+='\' 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 73 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x49' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+=I 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 120 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x78' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+=x 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 123 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+='{' 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 49 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x31' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+=1 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 114 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x72' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+=r 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 54 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+=6 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 72 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x48' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+=H 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 103 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x67' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+=g 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 45 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+=- 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 117 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # string+=u 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.633 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.633 15:57:13 -- target/invalid.sh@25 -- # printf %x 54 00:13:23.634 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:23.634 15:57:13 -- target/invalid.sh@25 -- # string+=6 00:13:23.634 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.634 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.634 15:57:13 -- target/invalid.sh@25 -- # printf %x 124 00:13:23.634 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:13:23.634 15:57:13 -- target/invalid.sh@25 -- # string+='|' 00:13:23.634 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.634 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.634 15:57:13 -- target/invalid.sh@25 -- # printf %x 60 00:13:23.634 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:23.634 15:57:13 -- target/invalid.sh@25 -- # string+='<' 00:13:23.634 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.634 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.634 15:57:13 -- target/invalid.sh@25 -- # printf %x 96 00:13:23.634 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:23.634 15:57:13 -- target/invalid.sh@25 -- # string+='`' 00:13:23.634 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.634 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.634 15:57:13 -- target/invalid.sh@28 -- # [[ # == \- ]] 00:13:23.634 15:57:13 -- target/invalid.sh@31 -- # echo '#,;)>/\Ix{1r6Hg-u6|<`' 00:13:23.634 15:57:13 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '#,;)>/\Ix{1r6Hg-u6|<`' nqn.2016-06.io.spdk:cnode9034 00:13:23.891 [2024-10-30 15:57:13.536634] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9034: invalid serial number '#,;)>/\Ix{1r6Hg-u6|<`' 00:13:23.891 15:57:13 -- target/invalid.sh@54 -- # out='request: 00:13:23.891 { 00:13:23.891 "nqn": "nqn.2016-06.io.spdk:cnode9034", 00:13:23.891 "serial_number": "#,;)>/\\Ix{1r6Hg-u6|<`", 00:13:23.891 "method": "nvmf_create_subsystem", 00:13:23.891 "req_id": 1 00:13:23.891 } 00:13:23.891 Got JSON-RPC error response 00:13:23.891 response: 00:13:23.891 { 00:13:23.891 "code": -32602, 00:13:23.891 "message": "Invalid SN #,;)>/\\Ix{1r6Hg-u6|<`" 00:13:23.891 }' 00:13:23.891 15:57:13 -- target/invalid.sh@55 -- # [[ request: 00:13:23.891 { 00:13:23.891 "nqn": "nqn.2016-06.io.spdk:cnode9034", 00:13:23.891 "serial_number": "#,;)>/\\Ix{1r6Hg-u6|<`", 00:13:23.891 "method": "nvmf_create_subsystem", 00:13:23.891 "req_id": 1 00:13:23.891 } 00:13:23.891 Got JSON-RPC error response 00:13:23.891 response: 00:13:23.891 { 00:13:23.891 "code": -32602, 00:13:23.891 "message": "Invalid SN #,;)>/\\Ix{1r6Hg-u6|<`" 00:13:23.891 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:23.891 15:57:13 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:23.891 15:57:13 -- target/invalid.sh@19 -- # local length=41 ll 00:13:23.891 15:57:13 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:23.891 15:57:13 -- target/invalid.sh@21 -- # local chars 00:13:23.891 15:57:13 -- target/invalid.sh@22 -- # local string 00:13:23.891 15:57:13 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:23.891 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.891 15:57:13 -- target/invalid.sh@25 -- # printf %x 46 00:13:23.891 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:13:23.891 15:57:13 -- target/invalid.sh@25 -- # string+=. 00:13:23.891 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.891 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.891 15:57:13 -- target/invalid.sh@25 -- # printf %x 82 00:13:23.891 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:23.891 15:57:13 -- target/invalid.sh@25 -- # string+=R 00:13:23.891 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.891 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.891 15:57:13 -- target/invalid.sh@25 -- # printf %x 117 00:13:23.891 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:23.891 15:57:13 -- target/invalid.sh@25 -- # string+=u 00:13:23.891 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.891 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.891 15:57:13 -- target/invalid.sh@25 -- # printf %x 69 00:13:23.891 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x45' 00:13:23.891 15:57:13 -- target/invalid.sh@25 -- # string+=E 00:13:23.891 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.891 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 78 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=N 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 93 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=']' 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 96 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+='`' 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 44 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=, 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 57 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x39' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=9 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 47 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=/ 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 106 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=j 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 71 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=G 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 116 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x74' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=t 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 99 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x63' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=c 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 111 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=o 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 43 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=+ 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 62 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+='>' 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 42 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+='*' 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 122 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=z 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 97 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=a 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 115 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=s 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 54 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=6 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 53 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x35' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=5 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 65 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x41' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=A 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 108 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=l 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 125 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+='}' 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 105 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x69' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=i 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 76 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=L 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 37 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x25' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=% 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 33 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x21' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+='!' 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 90 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=Z 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 95 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=_ 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 71 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=G 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 85 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=U 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 40 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x28' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+='(' 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 85 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=U 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 45 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=- 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 76 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=L 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 104 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x68' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=h 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # printf %x 75 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:13:23.892 15:57:13 -- target/invalid.sh@25 -- # string+=K 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.892 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.893 15:57:13 -- target/invalid.sh@25 -- # printf %x 127 00:13:23.893 15:57:13 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:13:23.893 15:57:13 -- target/invalid.sh@25 -- # string+=$'\177' 00:13:23.893 15:57:13 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:23.893 15:57:13 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:23.893 15:57:13 -- target/invalid.sh@28 -- # [[ . == \- ]] 00:13:23.893 15:57:13 -- target/invalid.sh@31 -- # echo '.RuEN]`,9/jGtco+>*zas65Al}iL%!Z_GU(U-LhK' 00:13:23.893 15:57:13 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d '.RuEN]`,9/jGtco+>*zas65Al}iL%!Z_GU(U-LhK' nqn.2016-06.io.spdk:cnode1772 00:13:24.149 [2024-10-30 15:57:13.929886] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode1772: invalid model number '.RuEN]`,9/jGtco+>*zas65Al}iL%!Z_GU(U-LhK' 00:13:24.149 15:57:13 -- target/invalid.sh@58 -- # out='request: 00:13:24.149 { 00:13:24.149 "nqn": "nqn.2016-06.io.spdk:cnode1772", 00:13:24.149 "model_number": ".RuEN]`,9/jGtco+>*zas65Al}iL%!Z_GU(U-LhK\u007f", 00:13:24.149 "method": "nvmf_create_subsystem", 00:13:24.149 "req_id": 1 00:13:24.149 } 00:13:24.149 Got JSON-RPC error response 00:13:24.149 response: 00:13:24.149 { 00:13:24.149 "code": -32602, 00:13:24.149 "message": "Invalid MN .RuEN]`,9/jGtco+>*zas65Al}iL%!Z_GU(U-LhK\u007f" 00:13:24.149 }' 00:13:24.149 15:57:13 -- target/invalid.sh@59 -- # [[ request: 00:13:24.149 { 00:13:24.149 "nqn": "nqn.2016-06.io.spdk:cnode1772", 00:13:24.149 "model_number": ".RuEN]`,9/jGtco+>*zas65Al}iL%!Z_GU(U-LhK\u007f", 00:13:24.149 "method": "nvmf_create_subsystem", 00:13:24.149 "req_id": 1 00:13:24.149 } 00:13:24.149 Got JSON-RPC error response 00:13:24.149 response: 00:13:24.149 { 00:13:24.149 "code": -32602, 00:13:24.149 "message": "Invalid MN .RuEN]`,9/jGtco+>*zas65Al}iL%!Z_GU(U-LhK\u007f" 00:13:24.149 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:24.149 15:57:13 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:13:24.406 [2024-10-30 15:57:14.178781] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:24.406 15:57:14 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:13:24.663 15:57:14 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:13:24.663 15:57:14 -- target/invalid.sh@67 -- # echo '' 00:13:24.663 15:57:14 -- target/invalid.sh@67 -- # head -n 1 00:13:24.663 15:57:14 -- target/invalid.sh@67 -- # IP= 00:13:24.663 15:57:14 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:13:24.920 [2024-10-30 15:57:14.712656] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:13:24.920 15:57:14 -- target/invalid.sh@69 -- # out='request: 00:13:24.920 { 00:13:24.920 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:24.920 "listen_address": { 00:13:24.920 "trtype": "tcp", 00:13:24.920 "traddr": "", 00:13:24.920 "trsvcid": "4421" 00:13:24.920 }, 00:13:24.920 "method": "nvmf_subsystem_remove_listener", 00:13:24.920 "req_id": 1 00:13:24.920 } 00:13:24.920 Got JSON-RPC error response 00:13:24.920 response: 00:13:24.920 { 00:13:24.920 "code": -32602, 00:13:24.920 "message": "Invalid parameters" 00:13:24.920 }' 00:13:24.920 15:57:14 -- target/invalid.sh@70 -- # [[ request: 00:13:24.920 { 00:13:24.920 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:24.920 "listen_address": { 00:13:24.920 "trtype": "tcp", 00:13:24.920 "traddr": "", 00:13:24.920 "trsvcid": "4421" 00:13:24.920 }, 00:13:24.920 "method": "nvmf_subsystem_remove_listener", 00:13:24.920 "req_id": 1 00:13:24.920 } 00:13:24.920 Got JSON-RPC error response 00:13:24.920 response: 00:13:24.920 { 00:13:24.920 "code": -32602, 00:13:24.920 "message": "Invalid parameters" 00:13:24.920 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:13:24.920 15:57:14 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2093 -i 0 00:13:25.178 [2024-10-30 15:57:14.973470] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2093: invalid cntlid range [0-65519] 00:13:25.178 15:57:14 -- target/invalid.sh@73 -- # out='request: 00:13:25.178 { 00:13:25.178 "nqn": "nqn.2016-06.io.spdk:cnode2093", 00:13:25.178 "min_cntlid": 0, 00:13:25.178 "method": "nvmf_create_subsystem", 00:13:25.178 "req_id": 1 00:13:25.178 } 00:13:25.178 Got JSON-RPC error response 00:13:25.178 response: 00:13:25.178 { 00:13:25.178 "code": -32602, 00:13:25.178 "message": "Invalid cntlid range [0-65519]" 00:13:25.178 }' 00:13:25.178 15:57:14 -- target/invalid.sh@74 -- # [[ request: 00:13:25.178 { 00:13:25.178 "nqn": "nqn.2016-06.io.spdk:cnode2093", 00:13:25.178 "min_cntlid": 0, 00:13:25.178 "method": "nvmf_create_subsystem", 00:13:25.178 "req_id": 1 00:13:25.178 } 00:13:25.178 Got JSON-RPC error response 00:13:25.178 response: 00:13:25.178 { 00:13:25.178 "code": -32602, 00:13:25.178 "message": "Invalid cntlid range [0-65519]" 00:13:25.178 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:25.178 15:57:14 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode27991 -i 65520 00:13:25.436 [2024-10-30 15:57:15.222277] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27991: invalid cntlid range [65520-65519] 00:13:25.436 15:57:15 -- target/invalid.sh@75 -- # out='request: 00:13:25.436 { 00:13:25.436 "nqn": "nqn.2016-06.io.spdk:cnode27991", 00:13:25.436 "min_cntlid": 65520, 00:13:25.436 "method": "nvmf_create_subsystem", 00:13:25.436 "req_id": 1 00:13:25.436 } 00:13:25.436 Got JSON-RPC error response 00:13:25.436 response: 00:13:25.436 { 00:13:25.436 "code": -32602, 00:13:25.436 "message": "Invalid cntlid range [65520-65519]" 00:13:25.436 }' 00:13:25.436 15:57:15 -- target/invalid.sh@76 -- # [[ request: 00:13:25.436 { 00:13:25.436 "nqn": "nqn.2016-06.io.spdk:cnode27991", 00:13:25.436 "min_cntlid": 65520, 00:13:25.436 "method": "nvmf_create_subsystem", 00:13:25.436 "req_id": 1 00:13:25.436 } 00:13:25.436 Got JSON-RPC error response 00:13:25.436 response: 00:13:25.436 { 00:13:25.436 "code": -32602, 00:13:25.436 "message": "Invalid cntlid range [65520-65519]" 00:13:25.436 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:25.436 15:57:15 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10060 -I 0 00:13:25.694 [2024-10-30 15:57:15.475117] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10060: invalid cntlid range [1-0] 00:13:25.694 15:57:15 -- target/invalid.sh@77 -- # out='request: 00:13:25.694 { 00:13:25.694 "nqn": "nqn.2016-06.io.spdk:cnode10060", 00:13:25.694 "max_cntlid": 0, 00:13:25.694 "method": "nvmf_create_subsystem", 00:13:25.694 "req_id": 1 00:13:25.694 } 00:13:25.694 Got JSON-RPC error response 00:13:25.694 response: 00:13:25.694 { 00:13:25.694 "code": -32602, 00:13:25.694 "message": "Invalid cntlid range [1-0]" 00:13:25.694 }' 00:13:25.694 15:57:15 -- target/invalid.sh@78 -- # [[ request: 00:13:25.694 { 00:13:25.694 "nqn": "nqn.2016-06.io.spdk:cnode10060", 00:13:25.694 "max_cntlid": 0, 00:13:25.694 "method": "nvmf_create_subsystem", 00:13:25.694 "req_id": 1 00:13:25.694 } 00:13:25.694 Got JSON-RPC error response 00:13:25.694 response: 00:13:25.694 { 00:13:25.694 "code": -32602, 00:13:25.694 "message": "Invalid cntlid range [1-0]" 00:13:25.694 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:25.694 15:57:15 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode13023 -I 65520 00:13:25.951 [2024-10-30 15:57:15.719961] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode13023: invalid cntlid range [1-65520] 00:13:25.951 15:57:15 -- target/invalid.sh@79 -- # out='request: 00:13:25.951 { 00:13:25.951 "nqn": "nqn.2016-06.io.spdk:cnode13023", 00:13:25.951 "max_cntlid": 65520, 00:13:25.951 "method": "nvmf_create_subsystem", 00:13:25.951 "req_id": 1 00:13:25.951 } 00:13:25.951 Got JSON-RPC error response 00:13:25.951 response: 00:13:25.951 { 00:13:25.951 "code": -32602, 00:13:25.951 "message": "Invalid cntlid range [1-65520]" 00:13:25.951 }' 00:13:25.951 15:57:15 -- target/invalid.sh@80 -- # [[ request: 00:13:25.951 { 00:13:25.951 "nqn": "nqn.2016-06.io.spdk:cnode13023", 00:13:25.951 "max_cntlid": 65520, 00:13:25.951 "method": "nvmf_create_subsystem", 00:13:25.951 "req_id": 1 00:13:25.951 } 00:13:25.951 Got JSON-RPC error response 00:13:25.951 response: 00:13:25.951 { 00:13:25.951 "code": -32602, 00:13:25.951 "message": "Invalid cntlid range [1-65520]" 00:13:25.951 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:25.951 15:57:15 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode24421 -i 6 -I 5 00:13:26.208 [2024-10-30 15:57:15.984880] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24421: invalid cntlid range [6-5] 00:13:26.208 15:57:16 -- target/invalid.sh@83 -- # out='request: 00:13:26.208 { 00:13:26.208 "nqn": "nqn.2016-06.io.spdk:cnode24421", 00:13:26.208 "min_cntlid": 6, 00:13:26.209 "max_cntlid": 5, 00:13:26.209 "method": "nvmf_create_subsystem", 00:13:26.209 "req_id": 1 00:13:26.209 } 00:13:26.209 Got JSON-RPC error response 00:13:26.209 response: 00:13:26.209 { 00:13:26.209 "code": -32602, 00:13:26.209 "message": "Invalid cntlid range [6-5]" 00:13:26.209 }' 00:13:26.209 15:57:16 -- target/invalid.sh@84 -- # [[ request: 00:13:26.209 { 00:13:26.209 "nqn": "nqn.2016-06.io.spdk:cnode24421", 00:13:26.209 "min_cntlid": 6, 00:13:26.209 "max_cntlid": 5, 00:13:26.209 "method": "nvmf_create_subsystem", 00:13:26.209 "req_id": 1 00:13:26.209 } 00:13:26.209 Got JSON-RPC error response 00:13:26.209 response: 00:13:26.209 { 00:13:26.209 "code": -32602, 00:13:26.209 "message": "Invalid cntlid range [6-5]" 00:13:26.209 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:26.209 15:57:16 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:13:26.467 15:57:16 -- target/invalid.sh@87 -- # out='request: 00:13:26.467 { 00:13:26.467 "name": "foobar", 00:13:26.467 "method": "nvmf_delete_target", 00:13:26.467 "req_id": 1 00:13:26.467 } 00:13:26.467 Got JSON-RPC error response 00:13:26.467 response: 00:13:26.467 { 00:13:26.467 "code": -32602, 00:13:26.467 "message": "The specified target doesn'\''t exist, cannot delete it." 00:13:26.467 }' 00:13:26.467 15:57:16 -- target/invalid.sh@88 -- # [[ request: 00:13:26.467 { 00:13:26.467 "name": "foobar", 00:13:26.467 "method": "nvmf_delete_target", 00:13:26.467 "req_id": 1 00:13:26.467 } 00:13:26.467 Got JSON-RPC error response 00:13:26.467 response: 00:13:26.467 { 00:13:26.467 "code": -32602, 00:13:26.467 "message": "The specified target doesn't exist, cannot delete it." 00:13:26.467 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:13:26.467 15:57:16 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:13:26.467 15:57:16 -- target/invalid.sh@91 -- # nvmftestfini 00:13:26.467 15:57:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:26.467 15:57:16 -- nvmf/common.sh@116 -- # sync 00:13:26.467 15:57:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:26.467 15:57:16 -- nvmf/common.sh@119 -- # set +e 00:13:26.467 15:57:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:26.467 15:57:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:26.467 rmmod nvme_tcp 00:13:26.467 rmmod nvme_fabrics 00:13:26.467 rmmod nvme_keyring 00:13:26.467 15:57:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:26.467 15:57:16 -- nvmf/common.sh@123 -- # set -e 00:13:26.467 15:57:16 -- nvmf/common.sh@124 -- # return 0 00:13:26.467 15:57:16 -- nvmf/common.sh@477 -- # '[' -n 2368435 ']' 00:13:26.467 15:57:16 -- nvmf/common.sh@478 -- # killprocess 2368435 00:13:26.467 15:57:16 -- common/autotest_common.sh@926 -- # '[' -z 2368435 ']' 00:13:26.467 15:57:16 -- common/autotest_common.sh@930 -- # kill -0 2368435 00:13:26.467 15:57:16 -- common/autotest_common.sh@931 -- # uname 00:13:26.467 15:57:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:26.467 15:57:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2368435 00:13:26.467 15:57:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:13:26.467 15:57:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:13:26.467 15:57:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2368435' 00:13:26.467 killing process with pid 2368435 00:13:26.467 15:57:16 -- common/autotest_common.sh@945 -- # kill 2368435 00:13:26.467 15:57:16 -- common/autotest_common.sh@950 -- # wait 2368435 00:13:26.725 15:57:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:26.725 15:57:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:26.725 15:57:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:26.725 15:57:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:26.725 15:57:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:26.726 15:57:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:26.726 15:57:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:26.726 15:57:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:28.629 15:57:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:28.629 00:13:28.629 real 0m9.406s 00:13:28.629 user 0m23.438s 00:13:28.629 sys 0m2.458s 00:13:28.629 15:57:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:28.629 15:57:18 -- common/autotest_common.sh@10 -- # set +x 00:13:28.629 ************************************ 00:13:28.629 END TEST nvmf_invalid 00:13:28.629 ************************************ 00:13:28.629 15:57:18 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:28.629 15:57:18 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:28.629 15:57:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:28.629 15:57:18 -- common/autotest_common.sh@10 -- # set +x 00:13:28.629 ************************************ 00:13:28.629 START TEST nvmf_abort 00:13:28.629 ************************************ 00:13:28.629 15:57:18 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:28.887 * Looking for test storage... 00:13:28.887 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:28.887 15:57:18 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:28.887 15:57:18 -- nvmf/common.sh@7 -- # uname -s 00:13:28.887 15:57:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:28.887 15:57:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:28.887 15:57:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:28.887 15:57:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:28.887 15:57:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:28.887 15:57:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:28.887 15:57:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:28.887 15:57:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:28.887 15:57:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:28.887 15:57:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:28.887 15:57:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:28.887 15:57:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:28.887 15:57:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:28.887 15:57:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:28.887 15:57:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:28.887 15:57:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:28.887 15:57:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:28.887 15:57:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:28.887 15:57:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:28.887 15:57:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.887 15:57:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.887 15:57:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.887 15:57:18 -- paths/export.sh@5 -- # export PATH 00:13:28.887 15:57:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:28.887 15:57:18 -- nvmf/common.sh@46 -- # : 0 00:13:28.887 15:57:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:28.887 15:57:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:28.887 15:57:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:28.887 15:57:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:28.887 15:57:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:28.887 15:57:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:28.887 15:57:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:28.887 15:57:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:28.887 15:57:18 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:28.887 15:57:18 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:28.887 15:57:18 -- target/abort.sh@14 -- # nvmftestinit 00:13:28.887 15:57:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:28.887 15:57:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:28.887 15:57:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:28.887 15:57:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:28.887 15:57:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:28.887 15:57:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:28.888 15:57:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:28.888 15:57:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:28.888 15:57:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:28.888 15:57:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:28.888 15:57:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:28.888 15:57:18 -- common/autotest_common.sh@10 -- # set +x 00:13:30.784 15:57:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:30.784 15:57:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:30.784 15:57:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:30.784 15:57:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:30.784 15:57:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:30.784 15:57:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:30.784 15:57:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:30.784 15:57:20 -- nvmf/common.sh@294 -- # net_devs=() 00:13:30.785 15:57:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:30.785 15:57:20 -- nvmf/common.sh@295 -- # e810=() 00:13:30.785 15:57:20 -- nvmf/common.sh@295 -- # local -ga e810 00:13:30.785 15:57:20 -- nvmf/common.sh@296 -- # x722=() 00:13:30.785 15:57:20 -- nvmf/common.sh@296 -- # local -ga x722 00:13:30.785 15:57:20 -- nvmf/common.sh@297 -- # mlx=() 00:13:30.785 15:57:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:30.785 15:57:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:30.785 15:57:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:30.785 15:57:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:30.785 15:57:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:30.785 15:57:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:30.785 15:57:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:30.785 15:57:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:30.785 15:57:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:30.785 15:57:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:30.785 15:57:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:30.785 15:57:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:30.785 15:57:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:30.785 15:57:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:30.785 15:57:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:30.785 15:57:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:30.785 15:57:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:30.785 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:30.785 15:57:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:30.785 15:57:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:30.785 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:30.785 15:57:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:30.785 15:57:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:30.785 15:57:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:30.785 15:57:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:30.785 15:57:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:30.785 15:57:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:30.785 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:30.785 15:57:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:30.785 15:57:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:30.785 15:57:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:30.785 15:57:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:30.785 15:57:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:30.785 15:57:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:30.785 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:30.785 15:57:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:30.785 15:57:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:30.785 15:57:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:30.785 15:57:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:30.785 15:57:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:30.785 15:57:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:30.785 15:57:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:30.785 15:57:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:30.785 15:57:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:30.785 15:57:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:31.043 15:57:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:31.043 15:57:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:31.043 15:57:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:31.043 15:57:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:31.043 15:57:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:31.043 15:57:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:31.043 15:57:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:31.043 15:57:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:31.043 15:57:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:31.043 15:57:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:31.043 15:57:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:31.043 15:57:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:31.043 15:57:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:31.043 15:57:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:31.043 15:57:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:31.043 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:31.043 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:13:31.043 00:13:31.043 --- 10.0.0.2 ping statistics --- 00:13:31.043 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:31.043 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:13:31.043 15:57:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:31.043 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:31.043 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:13:31.043 00:13:31.043 --- 10.0.0.1 ping statistics --- 00:13:31.043 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:31.043 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:13:31.043 15:57:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:31.043 15:57:20 -- nvmf/common.sh@410 -- # return 0 00:13:31.043 15:57:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:31.043 15:57:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:31.043 15:57:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:31.043 15:57:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:31.043 15:57:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:31.043 15:57:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:31.043 15:57:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:31.043 15:57:20 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:31.043 15:57:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:31.043 15:57:20 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:31.043 15:57:20 -- common/autotest_common.sh@10 -- # set +x 00:13:31.043 15:57:20 -- nvmf/common.sh@469 -- # nvmfpid=2371224 00:13:31.043 15:57:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:31.043 15:57:20 -- nvmf/common.sh@470 -- # waitforlisten 2371224 00:13:31.043 15:57:20 -- common/autotest_common.sh@819 -- # '[' -z 2371224 ']' 00:13:31.043 15:57:20 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:31.043 15:57:20 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:31.043 15:57:20 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:31.043 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:31.043 15:57:20 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:31.043 15:57:20 -- common/autotest_common.sh@10 -- # set +x 00:13:31.301 [2024-10-30 15:57:20.937460] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:13:31.301 [2024-10-30 15:57:20.937536] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:31.301 EAL: No free 2048 kB hugepages reported on node 1 00:13:31.301 [2024-10-30 15:57:21.008935] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:31.301 [2024-10-30 15:57:21.100645] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:31.301 [2024-10-30 15:57:21.100814] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:31.301 [2024-10-30 15:57:21.100834] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:31.301 [2024-10-30 15:57:21.100849] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:31.301 [2024-10-30 15:57:21.100935] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:31.301 [2024-10-30 15:57:21.100993] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:31.301 [2024-10-30 15:57:21.100996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:32.233 15:57:21 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:32.233 15:57:21 -- common/autotest_common.sh@852 -- # return 0 00:13:32.233 15:57:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:32.233 15:57:21 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:32.233 15:57:21 -- common/autotest_common.sh@10 -- # set +x 00:13:32.233 15:57:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:32.233 15:57:21 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:32.233 15:57:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.233 15:57:21 -- common/autotest_common.sh@10 -- # set +x 00:13:32.233 [2024-10-30 15:57:21.937147] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:32.233 15:57:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.233 15:57:21 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:32.233 15:57:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.233 15:57:21 -- common/autotest_common.sh@10 -- # set +x 00:13:32.233 Malloc0 00:13:32.233 15:57:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.233 15:57:21 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:32.233 15:57:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.233 15:57:21 -- common/autotest_common.sh@10 -- # set +x 00:13:32.233 Delay0 00:13:32.233 15:57:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.233 15:57:21 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:32.233 15:57:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.233 15:57:21 -- common/autotest_common.sh@10 -- # set +x 00:13:32.233 15:57:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.233 15:57:21 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:32.233 15:57:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.233 15:57:21 -- common/autotest_common.sh@10 -- # set +x 00:13:32.233 15:57:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.233 15:57:22 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:32.233 15:57:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.233 15:57:22 -- common/autotest_common.sh@10 -- # set +x 00:13:32.233 [2024-10-30 15:57:22.008361] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:32.233 15:57:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.233 15:57:22 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:32.233 15:57:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:32.233 15:57:22 -- common/autotest_common.sh@10 -- # set +x 00:13:32.233 15:57:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:32.233 15:57:22 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:32.233 EAL: No free 2048 kB hugepages reported on node 1 00:13:32.490 [2024-10-30 15:57:22.154342] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:34.388 Initializing NVMe Controllers 00:13:34.388 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:34.388 controller IO queue size 128 less than required 00:13:34.388 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:34.388 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:34.388 Initialization complete. Launching workers. 00:13:34.388 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 32759 00:13:34.388 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 32820, failed to submit 62 00:13:34.388 success 32759, unsuccess 61, failed 0 00:13:34.388 15:57:24 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:34.388 15:57:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:34.388 15:57:24 -- common/autotest_common.sh@10 -- # set +x 00:13:34.388 15:57:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:34.388 15:57:24 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:34.388 15:57:24 -- target/abort.sh@38 -- # nvmftestfini 00:13:34.388 15:57:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:34.388 15:57:24 -- nvmf/common.sh@116 -- # sync 00:13:34.388 15:57:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:34.388 15:57:24 -- nvmf/common.sh@119 -- # set +e 00:13:34.388 15:57:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:34.388 15:57:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:34.388 rmmod nvme_tcp 00:13:34.388 rmmod nvme_fabrics 00:13:34.388 rmmod nvme_keyring 00:13:34.388 15:57:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:34.388 15:57:24 -- nvmf/common.sh@123 -- # set -e 00:13:34.388 15:57:24 -- nvmf/common.sh@124 -- # return 0 00:13:34.388 15:57:24 -- nvmf/common.sh@477 -- # '[' -n 2371224 ']' 00:13:34.388 15:57:24 -- nvmf/common.sh@478 -- # killprocess 2371224 00:13:34.388 15:57:24 -- common/autotest_common.sh@926 -- # '[' -z 2371224 ']' 00:13:34.388 15:57:24 -- common/autotest_common.sh@930 -- # kill -0 2371224 00:13:34.388 15:57:24 -- common/autotest_common.sh@931 -- # uname 00:13:34.388 15:57:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:34.388 15:57:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2371224 00:13:34.647 15:57:24 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:34.647 15:57:24 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:34.647 15:57:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2371224' 00:13:34.647 killing process with pid 2371224 00:13:34.647 15:57:24 -- common/autotest_common.sh@945 -- # kill 2371224 00:13:34.647 15:57:24 -- common/autotest_common.sh@950 -- # wait 2371224 00:13:34.647 15:57:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:34.647 15:57:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:34.647 15:57:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:34.647 15:57:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:34.648 15:57:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:34.648 15:57:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:34.648 15:57:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:34.648 15:57:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:37.181 15:57:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:37.181 00:13:37.181 real 0m8.048s 00:13:37.181 user 0m12.567s 00:13:37.181 sys 0m2.728s 00:13:37.181 15:57:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:37.181 15:57:26 -- common/autotest_common.sh@10 -- # set +x 00:13:37.181 ************************************ 00:13:37.181 END TEST nvmf_abort 00:13:37.181 ************************************ 00:13:37.181 15:57:26 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:37.181 15:57:26 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:37.181 15:57:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:37.181 15:57:26 -- common/autotest_common.sh@10 -- # set +x 00:13:37.181 ************************************ 00:13:37.181 START TEST nvmf_ns_hotplug_stress 00:13:37.181 ************************************ 00:13:37.181 15:57:26 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:37.181 * Looking for test storage... 00:13:37.181 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:37.181 15:57:26 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:37.181 15:57:26 -- nvmf/common.sh@7 -- # uname -s 00:13:37.181 15:57:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:37.181 15:57:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:37.181 15:57:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:37.181 15:57:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:37.181 15:57:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:37.181 15:57:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:37.181 15:57:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:37.181 15:57:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:37.181 15:57:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:37.181 15:57:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:37.181 15:57:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:37.181 15:57:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:37.181 15:57:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:37.181 15:57:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:37.181 15:57:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:37.181 15:57:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:37.181 15:57:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:37.181 15:57:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:37.181 15:57:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:37.181 15:57:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.181 15:57:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.181 15:57:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.181 15:57:26 -- paths/export.sh@5 -- # export PATH 00:13:37.181 15:57:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.181 15:57:26 -- nvmf/common.sh@46 -- # : 0 00:13:37.181 15:57:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:37.181 15:57:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:37.181 15:57:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:37.181 15:57:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:37.181 15:57:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:37.181 15:57:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:37.181 15:57:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:37.181 15:57:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:37.181 15:57:26 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:37.181 15:57:26 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:13:37.181 15:57:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:37.181 15:57:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:37.181 15:57:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:37.181 15:57:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:37.181 15:57:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:37.181 15:57:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:37.181 15:57:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:37.181 15:57:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:37.181 15:57:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:37.181 15:57:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:37.181 15:57:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:37.181 15:57:26 -- common/autotest_common.sh@10 -- # set +x 00:13:39.082 15:57:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:39.082 15:57:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:39.082 15:57:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:39.082 15:57:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:39.082 15:57:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:39.082 15:57:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:39.082 15:57:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:39.082 15:57:28 -- nvmf/common.sh@294 -- # net_devs=() 00:13:39.082 15:57:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:39.082 15:57:28 -- nvmf/common.sh@295 -- # e810=() 00:13:39.082 15:57:28 -- nvmf/common.sh@295 -- # local -ga e810 00:13:39.082 15:57:28 -- nvmf/common.sh@296 -- # x722=() 00:13:39.082 15:57:28 -- nvmf/common.sh@296 -- # local -ga x722 00:13:39.082 15:57:28 -- nvmf/common.sh@297 -- # mlx=() 00:13:39.082 15:57:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:39.082 15:57:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:39.082 15:57:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:39.082 15:57:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:39.082 15:57:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:39.082 15:57:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:39.082 15:57:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:39.082 15:57:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:39.082 15:57:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:39.082 15:57:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:39.082 15:57:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:39.082 15:57:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:39.082 15:57:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:39.082 15:57:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:39.082 15:57:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:39.082 15:57:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:39.082 15:57:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:39.082 15:57:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:39.082 15:57:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:39.082 15:57:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:39.082 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:39.082 15:57:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:39.082 15:57:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:39.082 15:57:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:39.082 15:57:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:39.082 15:57:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:39.082 15:57:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:39.082 15:57:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:39.082 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:39.082 15:57:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:39.083 15:57:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:39.083 15:57:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:39.083 15:57:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:39.083 15:57:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:39.083 15:57:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:39.083 15:57:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:39.083 15:57:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:39.083 15:57:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:39.083 15:57:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:39.083 15:57:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:39.083 15:57:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:39.083 15:57:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:39.083 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:39.083 15:57:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:39.083 15:57:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:39.083 15:57:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:39.083 15:57:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:39.083 15:57:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:39.083 15:57:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:39.083 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:39.083 15:57:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:39.083 15:57:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:39.083 15:57:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:39.083 15:57:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:39.083 15:57:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:39.083 15:57:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:39.083 15:57:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:39.083 15:57:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:39.083 15:57:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:39.083 15:57:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:39.083 15:57:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:39.083 15:57:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:39.083 15:57:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:39.083 15:57:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:39.083 15:57:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:39.083 15:57:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:39.083 15:57:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:39.083 15:57:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:39.083 15:57:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:39.083 15:57:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:39.083 15:57:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:39.083 15:57:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:39.083 15:57:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:39.341 15:57:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:39.341 15:57:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:39.341 15:57:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:39.341 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:39.341 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.381 ms 00:13:39.341 00:13:39.341 --- 10.0.0.2 ping statistics --- 00:13:39.341 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:39.341 rtt min/avg/max/mdev = 0.381/0.381/0.381/0.000 ms 00:13:39.341 15:57:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:39.341 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:39.341 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.157 ms 00:13:39.341 00:13:39.341 --- 10.0.0.1 ping statistics --- 00:13:39.341 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:39.341 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:13:39.341 15:57:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:39.341 15:57:28 -- nvmf/common.sh@410 -- # return 0 00:13:39.341 15:57:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:39.341 15:57:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:39.341 15:57:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:39.341 15:57:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:39.341 15:57:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:39.341 15:57:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:39.341 15:57:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:39.341 15:57:29 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:13:39.341 15:57:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:39.341 15:57:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:39.341 15:57:29 -- common/autotest_common.sh@10 -- # set +x 00:13:39.341 15:57:29 -- nvmf/common.sh@469 -- # nvmfpid=2373599 00:13:39.341 15:57:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:39.341 15:57:29 -- nvmf/common.sh@470 -- # waitforlisten 2373599 00:13:39.341 15:57:29 -- common/autotest_common.sh@819 -- # '[' -z 2373599 ']' 00:13:39.341 15:57:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:39.341 15:57:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:39.341 15:57:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:39.341 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:39.341 15:57:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:39.341 15:57:29 -- common/autotest_common.sh@10 -- # set +x 00:13:39.341 [2024-10-30 15:57:29.065373] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:13:39.341 [2024-10-30 15:57:29.065456] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:39.341 EAL: No free 2048 kB hugepages reported on node 1 00:13:39.341 [2024-10-30 15:57:29.130652] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:39.599 [2024-10-30 15:57:29.220670] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:39.599 [2024-10-30 15:57:29.220823] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:39.599 [2024-10-30 15:57:29.220841] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:39.599 [2024-10-30 15:57:29.220854] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:39.599 [2024-10-30 15:57:29.220937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:39.599 [2024-10-30 15:57:29.220991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:39.599 [2024-10-30 15:57:29.220993] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:40.194 15:57:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:40.194 15:57:30 -- common/autotest_common.sh@852 -- # return 0 00:13:40.194 15:57:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:40.194 15:57:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:40.194 15:57:30 -- common/autotest_common.sh@10 -- # set +x 00:13:40.194 15:57:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:40.194 15:57:30 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:13:40.194 15:57:30 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:40.451 [2024-10-30 15:57:30.294207] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:40.451 15:57:30 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:40.709 15:57:30 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:40.967 [2024-10-30 15:57:30.813198] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:40.967 15:57:30 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:41.226 15:57:31 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:41.484 Malloc0 00:13:41.484 15:57:31 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:41.742 Delay0 00:13:41.742 15:57:31 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:42.000 15:57:31 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:42.257 NULL1 00:13:42.257 15:57:32 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:42.515 15:57:32 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=2374033 00:13:42.515 15:57:32 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:42.515 15:57:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:42.515 15:57:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:42.773 EAL: No free 2048 kB hugepages reported on node 1 00:13:43.712 Read completed with error (sct=0, sc=11) 00:13:43.712 15:57:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:43.712 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.712 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.969 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.969 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.969 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.969 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.969 15:57:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:13:43.969 15:57:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:13:44.226 true 00:13:44.226 15:57:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:44.226 15:57:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:45.158 15:57:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:45.415 15:57:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:13:45.415 15:57:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:13:45.672 true 00:13:45.672 15:57:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:45.672 15:57:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:45.928 15:57:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:46.185 15:57:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:13:46.185 15:57:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:13:46.442 true 00:13:46.442 15:57:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:46.442 15:57:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:46.700 15:57:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:46.957 15:57:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:13:46.957 15:57:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:13:47.216 true 00:13:47.216 15:57:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:47.216 15:57:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:48.202 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:48.202 15:57:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:48.202 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:48.459 15:57:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:13:48.459 15:57:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:13:48.716 true 00:13:48.716 15:57:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:48.716 15:57:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:48.974 15:57:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:49.233 15:57:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:13:49.233 15:57:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:13:49.490 true 00:13:49.490 15:57:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:49.490 15:57:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:50.421 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:50.421 15:57:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:50.421 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:50.421 15:57:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:13:50.421 15:57:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:13:50.677 true 00:13:50.677 15:57:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:50.677 15:57:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:50.934 15:57:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:51.191 15:57:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:13:51.191 15:57:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:13:51.448 true 00:13:51.448 15:57:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:51.448 15:57:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:52.380 15:57:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:52.381 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:52.381 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:52.381 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:52.638 15:57:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:13:52.638 15:57:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:13:52.897 true 00:13:52.897 15:57:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:52.897 15:57:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:53.155 15:57:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:53.413 15:57:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:13:53.413 15:57:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:13:53.672 true 00:13:53.672 15:57:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:53.672 15:57:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:54.606 15:57:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:54.606 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:54.606 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:54.864 15:57:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:13:54.864 15:57:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:13:55.122 true 00:13:55.122 15:57:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:55.122 15:57:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:55.380 15:57:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:55.638 15:57:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:13:55.638 15:57:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:55.896 true 00:13:55.896 15:57:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:55.896 15:57:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.829 15:57:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:57.087 15:57:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:13:57.087 15:57:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:57.345 true 00:13:57.345 15:57:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:57.345 15:57:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:57.603 15:57:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:57.861 15:57:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:13:57.861 15:57:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:58.118 true 00:13:58.118 15:57:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:58.119 15:57:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:58.376 15:57:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:58.646 15:57:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:13:58.646 15:57:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:58.903 true 00:13:58.903 15:57:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:13:58.903 15:57:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:59.835 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:59.835 15:57:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.091 15:57:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:14:00.091 15:57:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:14:00.399 true 00:14:00.399 15:57:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:14:00.399 15:57:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:00.656 15:57:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.914 15:57:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:14:00.914 15:57:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:01.171 true 00:14:01.171 15:57:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:14:01.171 15:57:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:01.428 15:57:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:01.684 15:57:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:01.685 15:57:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:01.942 true 00:14:01.942 15:57:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:14:01.942 15:57:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.316 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:03.316 15:57:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:03.316 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:03.316 15:57:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:03.316 15:57:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:03.574 true 00:14:03.574 15:57:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:14:03.574 15:57:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.832 15:57:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:04.089 15:57:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:04.089 15:57:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:04.348 true 00:14:04.348 15:57:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:14:04.348 15:57:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:05.276 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:05.276 15:57:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:05.276 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:05.276 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:05.533 15:57:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:05.533 15:57:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:05.790 true 00:14:05.790 15:57:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:14:05.790 15:57:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:06.047 15:57:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:06.304 15:57:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:06.304 15:57:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:06.562 true 00:14:06.562 15:57:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:14:06.562 15:57:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.492 15:57:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:07.749 15:57:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:07.749 15:57:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:08.006 true 00:14:08.006 15:57:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:14:08.006 15:57:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:08.263 15:57:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:08.521 15:57:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:08.521 15:57:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:08.779 true 00:14:08.779 15:57:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:14:08.779 15:57:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.037 15:57:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:09.295 15:57:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:09.295 15:57:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:09.552 true 00:14:09.552 15:57:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:14:09.552 15:57:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:10.483 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.483 15:58:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:10.483 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.740 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.740 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.740 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.740 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.740 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.740 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.740 15:58:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:10.740 15:58:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:10.997 true 00:14:10.997 15:58:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:14:10.997 15:58:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:11.930 15:58:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:11.930 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.187 15:58:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:12.187 15:58:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:12.445 true 00:14:12.445 15:58:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:14:12.445 15:58:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.703 15:58:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:12.961 Initializing NVMe Controllers 00:14:12.961 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:12.961 Controller IO queue size 128, less than required. 00:14:12.961 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:12.961 Controller IO queue size 128, less than required. 00:14:12.961 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:12.961 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:12.961 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:12.961 Initialization complete. Launching workers. 00:14:12.961 ======================================================== 00:14:12.961 Latency(us) 00:14:12.961 Device Information : IOPS MiB/s Average min max 00:14:12.961 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1068.84 0.52 59415.65 2346.70 1026783.50 00:14:12.961 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11411.12 5.57 11217.55 1587.80 357625.78 00:14:12.961 ======================================================== 00:14:12.961 Total : 12479.96 6.09 15345.46 1587.80 1026783.50 00:14:12.961 00:14:12.961 15:58:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:12.961 15:58:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:13.218 true 00:14:13.218 15:58:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2374033 00:14:13.218 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (2374033) - No such process 00:14:13.218 15:58:02 -- target/ns_hotplug_stress.sh@53 -- # wait 2374033 00:14:13.218 15:58:02 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:13.476 15:58:03 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:13.734 15:58:03 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:13.735 15:58:03 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:13.735 15:58:03 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:13.735 15:58:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:13.735 15:58:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:13.992 null0 00:14:13.992 15:58:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:13.992 15:58:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:13.992 15:58:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:14.250 null1 00:14:14.250 15:58:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:14.250 15:58:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:14.250 15:58:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:14.511 null2 00:14:14.511 15:58:04 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:14.511 15:58:04 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:14.511 15:58:04 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:14.769 null3 00:14:14.769 15:58:04 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:14.769 15:58:04 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:14.769 15:58:04 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:15.026 null4 00:14:15.026 15:58:04 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:15.026 15:58:04 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:15.026 15:58:04 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:15.284 null5 00:14:15.284 15:58:04 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:15.284 15:58:04 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:15.284 15:58:04 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:15.542 null6 00:14:15.542 15:58:05 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:15.542 15:58:05 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:15.542 15:58:05 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:15.800 null7 00:14:15.800 15:58:05 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:15.800 15:58:05 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:15.800 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:15.800 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:15.800 15:58:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:15.800 15:58:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:15.800 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:15.800 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:15.800 15:58:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:15.800 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@66 -- # wait 2378074 2378075 2378077 2378079 2378081 2378083 2378085 2378087 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.801 15:58:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:16.059 15:58:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:16.059 15:58:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:16.059 15:58:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:16.059 15:58:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:16.059 15:58:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:16.059 15:58:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:16.059 15:58:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.059 15:58:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:16.317 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.317 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.317 15:58:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:16.317 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.317 15:58:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.317 15:58:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.317 15:58:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:16.575 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:16.575 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:16.575 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:16.575 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:16.575 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:16.575 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:16.575 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:16.575 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.865 15:58:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:17.148 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:17.148 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:17.148 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:17.148 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:17.148 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:17.148 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:17.148 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:17.148 15:58:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.405 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.406 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:17.406 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.406 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.406 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:17.663 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:17.664 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:17.664 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:17.664 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:17.664 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:17.664 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:17.664 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.664 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.922 15:58:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:18.180 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:18.180 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:18.180 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:18.180 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:18.180 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:18.180 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.180 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:18.180 15:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.439 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:18.697 15:58:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:18.697 15:58:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:18.697 15:58:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:18.697 15:58:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:18.697 15:58:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:18.697 15:58:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:18.697 15:58:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:18.697 15:58:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:18.956 15:58:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:19.215 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:19.215 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:19.473 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:19.473 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:19.473 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:19.473 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:19.473 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:19.473 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:19.732 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:19.989 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:19.989 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:19.989 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:19.989 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:19.989 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:19.989 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:19.989 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:19.989 15:58:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.247 15:58:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:20.505 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:20.505 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:20.505 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:20.505 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.505 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:20.505 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:20.505 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:20.505 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:20.763 15:58:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:21.021 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:21.021 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:21.022 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:21.022 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:21.022 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:21.022 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:21.022 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:21.022 15:58:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:21.280 15:58:11 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:21.280 15:58:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:21.280 15:58:11 -- nvmf/common.sh@116 -- # sync 00:14:21.280 15:58:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:21.280 15:58:11 -- nvmf/common.sh@119 -- # set +e 00:14:21.280 15:58:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:21.280 15:58:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:21.280 rmmod nvme_tcp 00:14:21.280 rmmod nvme_fabrics 00:14:21.280 rmmod nvme_keyring 00:14:21.280 15:58:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:21.540 15:58:11 -- nvmf/common.sh@123 -- # set -e 00:14:21.540 15:58:11 -- nvmf/common.sh@124 -- # return 0 00:14:21.540 15:58:11 -- nvmf/common.sh@477 -- # '[' -n 2373599 ']' 00:14:21.540 15:58:11 -- nvmf/common.sh@478 -- # killprocess 2373599 00:14:21.540 15:58:11 -- common/autotest_common.sh@926 -- # '[' -z 2373599 ']' 00:14:21.540 15:58:11 -- common/autotest_common.sh@930 -- # kill -0 2373599 00:14:21.540 15:58:11 -- common/autotest_common.sh@931 -- # uname 00:14:21.540 15:58:11 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:21.540 15:58:11 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2373599 00:14:21.540 15:58:11 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:21.540 15:58:11 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:21.540 15:58:11 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2373599' 00:14:21.540 killing process with pid 2373599 00:14:21.540 15:58:11 -- common/autotest_common.sh@945 -- # kill 2373599 00:14:21.540 15:58:11 -- common/autotest_common.sh@950 -- # wait 2373599 00:14:21.801 15:58:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:21.801 15:58:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:21.801 15:58:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:21.801 15:58:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:21.801 15:58:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:21.801 15:58:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:21.801 15:58:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:21.801 15:58:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:23.705 15:58:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:23.705 00:14:23.705 real 0m46.899s 00:14:23.705 user 3m33.746s 00:14:23.705 sys 0m15.441s 00:14:23.705 15:58:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:23.705 15:58:13 -- common/autotest_common.sh@10 -- # set +x 00:14:23.705 ************************************ 00:14:23.705 END TEST nvmf_ns_hotplug_stress 00:14:23.705 ************************************ 00:14:23.705 15:58:13 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:23.705 15:58:13 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:23.705 15:58:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:23.705 15:58:13 -- common/autotest_common.sh@10 -- # set +x 00:14:23.705 ************************************ 00:14:23.705 START TEST nvmf_connect_stress 00:14:23.705 ************************************ 00:14:23.705 15:58:13 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:23.705 * Looking for test storage... 00:14:23.705 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:23.705 15:58:13 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:23.705 15:58:13 -- nvmf/common.sh@7 -- # uname -s 00:14:23.705 15:58:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:23.705 15:58:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:23.705 15:58:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:23.705 15:58:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:23.705 15:58:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:23.705 15:58:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:23.705 15:58:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:23.705 15:58:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:23.705 15:58:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:23.705 15:58:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:23.705 15:58:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:23.705 15:58:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:23.705 15:58:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:23.705 15:58:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:23.705 15:58:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:23.705 15:58:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:23.705 15:58:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:23.705 15:58:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:23.705 15:58:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:23.705 15:58:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:23.705 15:58:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:23.705 15:58:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:23.705 15:58:13 -- paths/export.sh@5 -- # export PATH 00:14:23.705 15:58:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:23.705 15:58:13 -- nvmf/common.sh@46 -- # : 0 00:14:23.705 15:58:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:23.705 15:58:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:23.705 15:58:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:23.705 15:58:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:23.705 15:58:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:23.705 15:58:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:23.705 15:58:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:23.705 15:58:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:23.705 15:58:13 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:23.705 15:58:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:23.705 15:58:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:23.705 15:58:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:23.705 15:58:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:23.705 15:58:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:23.705 15:58:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:23.705 15:58:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:23.705 15:58:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:23.705 15:58:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:23.705 15:58:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:23.705 15:58:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:23.705 15:58:13 -- common/autotest_common.sh@10 -- # set +x 00:14:26.235 15:58:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:26.235 15:58:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:26.235 15:58:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:26.235 15:58:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:26.235 15:58:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:26.235 15:58:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:26.235 15:58:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:26.235 15:58:15 -- nvmf/common.sh@294 -- # net_devs=() 00:14:26.235 15:58:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:26.235 15:58:15 -- nvmf/common.sh@295 -- # e810=() 00:14:26.235 15:58:15 -- nvmf/common.sh@295 -- # local -ga e810 00:14:26.235 15:58:15 -- nvmf/common.sh@296 -- # x722=() 00:14:26.235 15:58:15 -- nvmf/common.sh@296 -- # local -ga x722 00:14:26.235 15:58:15 -- nvmf/common.sh@297 -- # mlx=() 00:14:26.235 15:58:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:26.235 15:58:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:26.235 15:58:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:26.235 15:58:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:26.235 15:58:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:26.235 15:58:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:26.235 15:58:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:26.235 15:58:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:26.235 15:58:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:26.235 15:58:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:26.235 15:58:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:26.235 15:58:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:26.235 15:58:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:26.235 15:58:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:26.235 15:58:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:26.235 15:58:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:26.235 15:58:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:26.235 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:26.235 15:58:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:26.235 15:58:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:26.235 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:26.235 15:58:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:26.235 15:58:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:26.235 15:58:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:26.235 15:58:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:26.235 15:58:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:26.235 15:58:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:26.235 15:58:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:26.235 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:26.235 15:58:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:26.235 15:58:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:26.235 15:58:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:26.235 15:58:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:26.235 15:58:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:26.235 15:58:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:26.235 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:26.236 15:58:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:26.236 15:58:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:26.236 15:58:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:26.236 15:58:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:26.236 15:58:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:26.236 15:58:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:26.236 15:58:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:26.236 15:58:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:26.236 15:58:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:26.236 15:58:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:26.236 15:58:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:26.236 15:58:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:26.236 15:58:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:26.236 15:58:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:26.236 15:58:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:26.236 15:58:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:26.236 15:58:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:26.236 15:58:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:26.236 15:58:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:26.236 15:58:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:26.236 15:58:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:26.236 15:58:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:26.236 15:58:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:26.236 15:58:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:26.236 15:58:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:26.236 15:58:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:26.236 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:26.236 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:14:26.236 00:14:26.236 --- 10.0.0.2 ping statistics --- 00:14:26.236 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:26.236 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:14:26.236 15:58:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:26.236 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:26.236 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.049 ms 00:14:26.236 00:14:26.236 --- 10.0.0.1 ping statistics --- 00:14:26.236 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:26.236 rtt min/avg/max/mdev = 0.049/0.049/0.049/0.000 ms 00:14:26.236 15:58:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:26.236 15:58:15 -- nvmf/common.sh@410 -- # return 0 00:14:26.236 15:58:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:26.236 15:58:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:26.236 15:58:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:26.236 15:58:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:26.236 15:58:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:26.236 15:58:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:26.236 15:58:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:26.236 15:58:15 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:26.236 15:58:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:26.236 15:58:15 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:26.236 15:58:15 -- common/autotest_common.sh@10 -- # set +x 00:14:26.236 15:58:15 -- nvmf/common.sh@469 -- # nvmfpid=2380964 00:14:26.236 15:58:15 -- nvmf/common.sh@470 -- # waitforlisten 2380964 00:14:26.236 15:58:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:26.236 15:58:15 -- common/autotest_common.sh@819 -- # '[' -z 2380964 ']' 00:14:26.236 15:58:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:26.236 15:58:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:26.236 15:58:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:26.236 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:26.236 15:58:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:26.236 15:58:15 -- common/autotest_common.sh@10 -- # set +x 00:14:26.236 [2024-10-30 15:58:15.735022] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:14:26.236 [2024-10-30 15:58:15.735119] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:26.236 EAL: No free 2048 kB hugepages reported on node 1 00:14:26.236 [2024-10-30 15:58:15.802021] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:26.236 [2024-10-30 15:58:15.890537] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:26.236 [2024-10-30 15:58:15.890700] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:26.236 [2024-10-30 15:58:15.890732] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:26.236 [2024-10-30 15:58:15.890746] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:26.236 [2024-10-30 15:58:15.890893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:26.236 [2024-10-30 15:58:15.890968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:26.236 [2024-10-30 15:58:15.890971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:27.173 15:58:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:27.173 15:58:16 -- common/autotest_common.sh@852 -- # return 0 00:14:27.173 15:58:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:27.173 15:58:16 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:27.173 15:58:16 -- common/autotest_common.sh@10 -- # set +x 00:14:27.173 15:58:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:27.173 15:58:16 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:27.173 15:58:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:27.173 15:58:16 -- common/autotest_common.sh@10 -- # set +x 00:14:27.173 [2024-10-30 15:58:16.727134] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:27.173 15:58:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:27.173 15:58:16 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:27.173 15:58:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:27.173 15:58:16 -- common/autotest_common.sh@10 -- # set +x 00:14:27.173 15:58:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:27.173 15:58:16 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:27.173 15:58:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:27.173 15:58:16 -- common/autotest_common.sh@10 -- # set +x 00:14:27.173 [2024-10-30 15:58:16.756414] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:27.173 15:58:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:27.173 15:58:16 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:27.173 15:58:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:27.173 15:58:16 -- common/autotest_common.sh@10 -- # set +x 00:14:27.173 NULL1 00:14:27.173 15:58:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:27.173 15:58:16 -- target/connect_stress.sh@21 -- # PERF_PID=2381070 00:14:27.173 15:58:16 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:27.173 15:58:16 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:27.173 15:58:16 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:27.173 15:58:16 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:27.173 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.173 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.173 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.173 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.173 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.173 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.173 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.173 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.173 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.173 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.173 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.173 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.173 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.173 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.173 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.173 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.173 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.173 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.173 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.174 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.174 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.174 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.174 EAL: No free 2048 kB hugepages reported on node 1 00:14:27.174 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.174 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.174 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.174 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.174 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.174 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.174 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.174 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.174 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.174 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.174 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.174 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.174 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.174 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.174 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.174 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.174 15:58:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:27.174 15:58:16 -- target/connect_stress.sh@28 -- # cat 00:14:27.174 15:58:16 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:27.174 15:58:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:27.174 15:58:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:27.174 15:58:16 -- common/autotest_common.sh@10 -- # set +x 00:14:27.433 15:58:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:27.433 15:58:17 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:27.433 15:58:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:27.433 15:58:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:27.433 15:58:17 -- common/autotest_common.sh@10 -- # set +x 00:14:27.692 15:58:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:27.692 15:58:17 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:27.692 15:58:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:27.693 15:58:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:27.693 15:58:17 -- common/autotest_common.sh@10 -- # set +x 00:14:27.951 15:58:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:27.951 15:58:17 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:27.951 15:58:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:27.951 15:58:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:27.951 15:58:17 -- common/autotest_common.sh@10 -- # set +x 00:14:28.519 15:58:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:28.519 15:58:18 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:28.519 15:58:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:28.519 15:58:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:28.519 15:58:18 -- common/autotest_common.sh@10 -- # set +x 00:14:28.778 15:58:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:28.778 15:58:18 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:28.778 15:58:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:28.778 15:58:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:28.778 15:58:18 -- common/autotest_common.sh@10 -- # set +x 00:14:29.038 15:58:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:29.038 15:58:18 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:29.038 15:58:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:29.038 15:58:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:29.038 15:58:18 -- common/autotest_common.sh@10 -- # set +x 00:14:29.297 15:58:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:29.297 15:58:19 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:29.297 15:58:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:29.297 15:58:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:29.297 15:58:19 -- common/autotest_common.sh@10 -- # set +x 00:14:29.556 15:58:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:29.556 15:58:19 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:29.556 15:58:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:29.556 15:58:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:29.556 15:58:19 -- common/autotest_common.sh@10 -- # set +x 00:14:30.125 15:58:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:30.125 15:58:19 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:30.125 15:58:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:30.125 15:58:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:30.125 15:58:19 -- common/autotest_common.sh@10 -- # set +x 00:14:30.383 15:58:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:30.383 15:58:20 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:30.383 15:58:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:30.383 15:58:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:30.383 15:58:20 -- common/autotest_common.sh@10 -- # set +x 00:14:30.640 15:58:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:30.640 15:58:20 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:30.640 15:58:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:30.640 15:58:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:30.640 15:58:20 -- common/autotest_common.sh@10 -- # set +x 00:14:30.899 15:58:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:30.899 15:58:20 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:30.899 15:58:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:30.899 15:58:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:30.899 15:58:20 -- common/autotest_common.sh@10 -- # set +x 00:14:31.159 15:58:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:31.159 15:58:20 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:31.159 15:58:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:31.159 15:58:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:31.159 15:58:20 -- common/autotest_common.sh@10 -- # set +x 00:14:31.726 15:58:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:31.726 15:58:21 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:31.726 15:58:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:31.726 15:58:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:31.726 15:58:21 -- common/autotest_common.sh@10 -- # set +x 00:14:31.983 15:58:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:31.983 15:58:21 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:31.983 15:58:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:31.983 15:58:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:31.983 15:58:21 -- common/autotest_common.sh@10 -- # set +x 00:14:32.241 15:58:21 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.241 15:58:21 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:32.241 15:58:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:32.241 15:58:21 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.241 15:58:21 -- common/autotest_common.sh@10 -- # set +x 00:14:32.499 15:58:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.499 15:58:22 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:32.499 15:58:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:32.499 15:58:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.499 15:58:22 -- common/autotest_common.sh@10 -- # set +x 00:14:32.758 15:58:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:32.759 15:58:22 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:32.759 15:58:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:32.759 15:58:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:32.759 15:58:22 -- common/autotest_common.sh@10 -- # set +x 00:14:33.326 15:58:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:33.327 15:58:22 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:33.327 15:58:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:33.327 15:58:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:33.327 15:58:22 -- common/autotest_common.sh@10 -- # set +x 00:14:33.584 15:58:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:33.584 15:58:23 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:33.584 15:58:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:33.584 15:58:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:33.584 15:58:23 -- common/autotest_common.sh@10 -- # set +x 00:14:33.842 15:58:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:33.843 15:58:23 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:33.843 15:58:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:33.843 15:58:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:33.843 15:58:23 -- common/autotest_common.sh@10 -- # set +x 00:14:34.102 15:58:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:34.102 15:58:23 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:34.102 15:58:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:34.102 15:58:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:34.102 15:58:23 -- common/autotest_common.sh@10 -- # set +x 00:14:34.362 15:58:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:34.362 15:58:24 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:34.362 15:58:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:34.362 15:58:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:34.362 15:58:24 -- common/autotest_common.sh@10 -- # set +x 00:14:34.928 15:58:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:34.928 15:58:24 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:34.928 15:58:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:34.928 15:58:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:34.928 15:58:24 -- common/autotest_common.sh@10 -- # set +x 00:14:35.187 15:58:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:35.187 15:58:24 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:35.187 15:58:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:35.187 15:58:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:35.187 15:58:24 -- common/autotest_common.sh@10 -- # set +x 00:14:35.446 15:58:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:35.446 15:58:25 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:35.446 15:58:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:35.446 15:58:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:35.446 15:58:25 -- common/autotest_common.sh@10 -- # set +x 00:14:35.706 15:58:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:35.706 15:58:25 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:35.706 15:58:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:35.706 15:58:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:35.706 15:58:25 -- common/autotest_common.sh@10 -- # set +x 00:14:35.964 15:58:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:35.964 15:58:25 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:35.964 15:58:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:35.964 15:58:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:35.964 15:58:25 -- common/autotest_common.sh@10 -- # set +x 00:14:36.531 15:58:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:36.531 15:58:26 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:36.531 15:58:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:36.531 15:58:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:36.531 15:58:26 -- common/autotest_common.sh@10 -- # set +x 00:14:36.790 15:58:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:36.790 15:58:26 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:36.790 15:58:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:36.790 15:58:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:36.790 15:58:26 -- common/autotest_common.sh@10 -- # set +x 00:14:37.048 15:58:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:37.048 15:58:26 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:37.048 15:58:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:37.048 15:58:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:37.048 15:58:26 -- common/autotest_common.sh@10 -- # set +x 00:14:37.048 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:37.306 15:58:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:37.306 15:58:27 -- target/connect_stress.sh@34 -- # kill -0 2381070 00:14:37.306 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (2381070) - No such process 00:14:37.306 15:58:27 -- target/connect_stress.sh@38 -- # wait 2381070 00:14:37.306 15:58:27 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:37.306 15:58:27 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:37.306 15:58:27 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:37.306 15:58:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:37.306 15:58:27 -- nvmf/common.sh@116 -- # sync 00:14:37.306 15:58:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:37.306 15:58:27 -- nvmf/common.sh@119 -- # set +e 00:14:37.306 15:58:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:37.306 15:58:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:37.306 rmmod nvme_tcp 00:14:37.306 rmmod nvme_fabrics 00:14:37.306 rmmod nvme_keyring 00:14:37.306 15:58:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:37.306 15:58:27 -- nvmf/common.sh@123 -- # set -e 00:14:37.306 15:58:27 -- nvmf/common.sh@124 -- # return 0 00:14:37.306 15:58:27 -- nvmf/common.sh@477 -- # '[' -n 2380964 ']' 00:14:37.306 15:58:27 -- nvmf/common.sh@478 -- # killprocess 2380964 00:14:37.306 15:58:27 -- common/autotest_common.sh@926 -- # '[' -z 2380964 ']' 00:14:37.306 15:58:27 -- common/autotest_common.sh@930 -- # kill -0 2380964 00:14:37.306 15:58:27 -- common/autotest_common.sh@931 -- # uname 00:14:37.306 15:58:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:37.306 15:58:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2380964 00:14:37.564 15:58:27 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:37.564 15:58:27 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:37.564 15:58:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2380964' 00:14:37.564 killing process with pid 2380964 00:14:37.564 15:58:27 -- common/autotest_common.sh@945 -- # kill 2380964 00:14:37.564 15:58:27 -- common/autotest_common.sh@950 -- # wait 2380964 00:14:37.564 15:58:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:37.564 15:58:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:37.564 15:58:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:37.564 15:58:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:37.564 15:58:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:37.564 15:58:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:37.564 15:58:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:37.564 15:58:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:40.100 15:58:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:40.100 00:14:40.100 real 0m15.943s 00:14:40.100 user 0m40.872s 00:14:40.100 sys 0m5.598s 00:14:40.100 15:58:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:40.100 15:58:29 -- common/autotest_common.sh@10 -- # set +x 00:14:40.100 ************************************ 00:14:40.100 END TEST nvmf_connect_stress 00:14:40.100 ************************************ 00:14:40.100 15:58:29 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:40.100 15:58:29 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:40.100 15:58:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:40.100 15:58:29 -- common/autotest_common.sh@10 -- # set +x 00:14:40.100 ************************************ 00:14:40.100 START TEST nvmf_fused_ordering 00:14:40.100 ************************************ 00:14:40.100 15:58:29 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:40.100 * Looking for test storage... 00:14:40.100 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:40.100 15:58:29 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:40.100 15:58:29 -- nvmf/common.sh@7 -- # uname -s 00:14:40.100 15:58:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:40.100 15:58:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:40.100 15:58:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:40.100 15:58:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:40.100 15:58:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:40.100 15:58:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:40.100 15:58:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:40.100 15:58:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:40.100 15:58:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:40.100 15:58:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:40.100 15:58:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:40.100 15:58:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:40.100 15:58:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:40.100 15:58:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:40.100 15:58:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:40.100 15:58:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:40.100 15:58:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:40.100 15:58:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:40.100 15:58:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:40.100 15:58:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:40.100 15:58:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:40.100 15:58:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:40.100 15:58:29 -- paths/export.sh@5 -- # export PATH 00:14:40.100 15:58:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:40.100 15:58:29 -- nvmf/common.sh@46 -- # : 0 00:14:40.100 15:58:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:40.100 15:58:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:40.100 15:58:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:40.100 15:58:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:40.100 15:58:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:40.100 15:58:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:40.100 15:58:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:40.100 15:58:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:40.100 15:58:29 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:40.100 15:58:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:40.100 15:58:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:40.100 15:58:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:40.100 15:58:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:40.100 15:58:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:40.100 15:58:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:40.100 15:58:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:40.100 15:58:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:40.100 15:58:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:40.100 15:58:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:40.100 15:58:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:40.100 15:58:29 -- common/autotest_common.sh@10 -- # set +x 00:14:42.003 15:58:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:42.003 15:58:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:42.003 15:58:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:42.003 15:58:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:42.003 15:58:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:42.003 15:58:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:42.003 15:58:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:42.003 15:58:31 -- nvmf/common.sh@294 -- # net_devs=() 00:14:42.003 15:58:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:42.003 15:58:31 -- nvmf/common.sh@295 -- # e810=() 00:14:42.003 15:58:31 -- nvmf/common.sh@295 -- # local -ga e810 00:14:42.003 15:58:31 -- nvmf/common.sh@296 -- # x722=() 00:14:42.003 15:58:31 -- nvmf/common.sh@296 -- # local -ga x722 00:14:42.003 15:58:31 -- nvmf/common.sh@297 -- # mlx=() 00:14:42.003 15:58:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:42.003 15:58:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:42.003 15:58:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:42.003 15:58:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:42.003 15:58:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:42.003 15:58:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:42.003 15:58:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:42.003 15:58:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:42.003 15:58:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:42.003 15:58:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:42.003 15:58:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:42.003 15:58:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:42.003 15:58:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:42.003 15:58:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:42.003 15:58:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:42.003 15:58:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:42.003 15:58:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:42.003 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:42.003 15:58:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:42.003 15:58:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:42.003 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:42.003 15:58:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:42.003 15:58:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:42.003 15:58:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:42.003 15:58:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:42.003 15:58:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:42.003 15:58:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:42.003 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:42.003 15:58:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:42.003 15:58:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:42.003 15:58:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:42.003 15:58:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:42.003 15:58:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:42.003 15:58:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:42.003 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:42.003 15:58:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:42.003 15:58:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:42.003 15:58:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:42.003 15:58:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:42.003 15:58:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:42.003 15:58:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:42.003 15:58:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:42.003 15:58:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:42.003 15:58:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:42.003 15:58:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:42.003 15:58:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:42.003 15:58:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:42.003 15:58:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:42.003 15:58:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:42.003 15:58:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:42.003 15:58:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:42.003 15:58:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:42.003 15:58:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:42.003 15:58:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:42.003 15:58:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:42.003 15:58:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:42.003 15:58:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:42.003 15:58:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:42.003 15:58:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:42.003 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:42.003 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:14:42.003 00:14:42.003 --- 10.0.0.2 ping statistics --- 00:14:42.003 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:42.003 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:14:42.003 15:58:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:42.003 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:42.003 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.125 ms 00:14:42.003 00:14:42.003 --- 10.0.0.1 ping statistics --- 00:14:42.003 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:42.003 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:14:42.003 15:58:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:42.003 15:58:31 -- nvmf/common.sh@410 -- # return 0 00:14:42.003 15:58:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:42.003 15:58:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:42.003 15:58:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:42.003 15:58:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:42.003 15:58:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:42.003 15:58:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:42.003 15:58:31 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:42.003 15:58:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:42.003 15:58:31 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:42.003 15:58:31 -- common/autotest_common.sh@10 -- # set +x 00:14:42.003 15:58:31 -- nvmf/common.sh@469 -- # nvmfpid=2384287 00:14:42.003 15:58:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:42.003 15:58:31 -- nvmf/common.sh@470 -- # waitforlisten 2384287 00:14:42.003 15:58:31 -- common/autotest_common.sh@819 -- # '[' -z 2384287 ']' 00:14:42.003 15:58:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:42.003 15:58:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:42.003 15:58:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:42.003 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:42.003 15:58:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:42.003 15:58:31 -- common/autotest_common.sh@10 -- # set +x 00:14:42.003 [2024-10-30 15:58:31.602470] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:14:42.003 [2024-10-30 15:58:31.602571] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:42.004 EAL: No free 2048 kB hugepages reported on node 1 00:14:42.004 [2024-10-30 15:58:31.666140] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:42.004 [2024-10-30 15:58:31.749294] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:42.004 [2024-10-30 15:58:31.749461] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:42.004 [2024-10-30 15:58:31.749479] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:42.004 [2024-10-30 15:58:31.749491] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:42.004 [2024-10-30 15:58:31.749520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:42.936 15:58:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:42.936 15:58:32 -- common/autotest_common.sh@852 -- # return 0 00:14:42.936 15:58:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:42.936 15:58:32 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:42.936 15:58:32 -- common/autotest_common.sh@10 -- # set +x 00:14:42.936 15:58:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:42.936 15:58:32 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:42.936 15:58:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:42.936 15:58:32 -- common/autotest_common.sh@10 -- # set +x 00:14:42.936 [2024-10-30 15:58:32.585470] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:42.936 15:58:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:42.936 15:58:32 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:42.936 15:58:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:42.936 15:58:32 -- common/autotest_common.sh@10 -- # set +x 00:14:42.936 15:58:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:42.936 15:58:32 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:42.936 15:58:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:42.936 15:58:32 -- common/autotest_common.sh@10 -- # set +x 00:14:42.936 [2024-10-30 15:58:32.601666] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:42.936 15:58:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:42.936 15:58:32 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:42.936 15:58:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:42.936 15:58:32 -- common/autotest_common.sh@10 -- # set +x 00:14:42.936 NULL1 00:14:42.936 15:58:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:42.936 15:58:32 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:14:42.936 15:58:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:42.936 15:58:32 -- common/autotest_common.sh@10 -- # set +x 00:14:42.936 15:58:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:42.936 15:58:32 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:42.936 15:58:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:42.936 15:58:32 -- common/autotest_common.sh@10 -- # set +x 00:14:42.936 15:58:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:42.936 15:58:32 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:14:42.936 [2024-10-30 15:58:32.646332] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:14:42.936 [2024-10-30 15:58:32.646368] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2384386 ] 00:14:42.936 EAL: No free 2048 kB hugepages reported on node 1 00:14:43.502 Attached to nqn.2016-06.io.spdk:cnode1 00:14:43.502 Namespace ID: 1 size: 1GB 00:14:43.502 fused_ordering(0) 00:14:43.502 fused_ordering(1) 00:14:43.502 fused_ordering(2) 00:14:43.502 fused_ordering(3) 00:14:43.502 fused_ordering(4) 00:14:43.502 fused_ordering(5) 00:14:43.502 fused_ordering(6) 00:14:43.502 fused_ordering(7) 00:14:43.502 fused_ordering(8) 00:14:43.502 fused_ordering(9) 00:14:43.502 fused_ordering(10) 00:14:43.502 fused_ordering(11) 00:14:43.502 fused_ordering(12) 00:14:43.502 fused_ordering(13) 00:14:43.502 fused_ordering(14) 00:14:43.502 fused_ordering(15) 00:14:43.502 fused_ordering(16) 00:14:43.502 fused_ordering(17) 00:14:43.502 fused_ordering(18) 00:14:43.502 fused_ordering(19) 00:14:43.502 fused_ordering(20) 00:14:43.502 fused_ordering(21) 00:14:43.502 fused_ordering(22) 00:14:43.502 fused_ordering(23) 00:14:43.502 fused_ordering(24) 00:14:43.502 fused_ordering(25) 00:14:43.502 fused_ordering(26) 00:14:43.502 fused_ordering(27) 00:14:43.502 fused_ordering(28) 00:14:43.502 fused_ordering(29) 00:14:43.502 fused_ordering(30) 00:14:43.502 fused_ordering(31) 00:14:43.502 fused_ordering(32) 00:14:43.502 fused_ordering(33) 00:14:43.502 fused_ordering(34) 00:14:43.502 fused_ordering(35) 00:14:43.502 fused_ordering(36) 00:14:43.502 fused_ordering(37) 00:14:43.502 fused_ordering(38) 00:14:43.502 fused_ordering(39) 00:14:43.502 fused_ordering(40) 00:14:43.502 fused_ordering(41) 00:14:43.502 fused_ordering(42) 00:14:43.502 fused_ordering(43) 00:14:43.502 fused_ordering(44) 00:14:43.502 fused_ordering(45) 00:14:43.502 fused_ordering(46) 00:14:43.502 fused_ordering(47) 00:14:43.502 fused_ordering(48) 00:14:43.502 fused_ordering(49) 00:14:43.502 fused_ordering(50) 00:14:43.502 fused_ordering(51) 00:14:43.502 fused_ordering(52) 00:14:43.502 fused_ordering(53) 00:14:43.502 fused_ordering(54) 00:14:43.502 fused_ordering(55) 00:14:43.502 fused_ordering(56) 00:14:43.502 fused_ordering(57) 00:14:43.502 fused_ordering(58) 00:14:43.502 fused_ordering(59) 00:14:43.502 fused_ordering(60) 00:14:43.502 fused_ordering(61) 00:14:43.502 fused_ordering(62) 00:14:43.502 fused_ordering(63) 00:14:43.502 fused_ordering(64) 00:14:43.502 fused_ordering(65) 00:14:43.502 fused_ordering(66) 00:14:43.502 fused_ordering(67) 00:14:43.502 fused_ordering(68) 00:14:43.502 fused_ordering(69) 00:14:43.502 fused_ordering(70) 00:14:43.502 fused_ordering(71) 00:14:43.502 fused_ordering(72) 00:14:43.502 fused_ordering(73) 00:14:43.502 fused_ordering(74) 00:14:43.502 fused_ordering(75) 00:14:43.502 fused_ordering(76) 00:14:43.502 fused_ordering(77) 00:14:43.502 fused_ordering(78) 00:14:43.502 fused_ordering(79) 00:14:43.502 fused_ordering(80) 00:14:43.502 fused_ordering(81) 00:14:43.502 fused_ordering(82) 00:14:43.502 fused_ordering(83) 00:14:43.502 fused_ordering(84) 00:14:43.502 fused_ordering(85) 00:14:43.502 fused_ordering(86) 00:14:43.502 fused_ordering(87) 00:14:43.502 fused_ordering(88) 00:14:43.502 fused_ordering(89) 00:14:43.502 fused_ordering(90) 00:14:43.502 fused_ordering(91) 00:14:43.502 fused_ordering(92) 00:14:43.502 fused_ordering(93) 00:14:43.502 fused_ordering(94) 00:14:43.502 fused_ordering(95) 00:14:43.502 fused_ordering(96) 00:14:43.502 fused_ordering(97) 00:14:43.502 fused_ordering(98) 00:14:43.502 fused_ordering(99) 00:14:43.502 fused_ordering(100) 00:14:43.502 fused_ordering(101) 00:14:43.502 fused_ordering(102) 00:14:43.502 fused_ordering(103) 00:14:43.502 fused_ordering(104) 00:14:43.502 fused_ordering(105) 00:14:43.502 fused_ordering(106) 00:14:43.502 fused_ordering(107) 00:14:43.502 fused_ordering(108) 00:14:43.502 fused_ordering(109) 00:14:43.502 fused_ordering(110) 00:14:43.502 fused_ordering(111) 00:14:43.502 fused_ordering(112) 00:14:43.502 fused_ordering(113) 00:14:43.502 fused_ordering(114) 00:14:43.502 fused_ordering(115) 00:14:43.502 fused_ordering(116) 00:14:43.502 fused_ordering(117) 00:14:43.502 fused_ordering(118) 00:14:43.502 fused_ordering(119) 00:14:43.502 fused_ordering(120) 00:14:43.502 fused_ordering(121) 00:14:43.502 fused_ordering(122) 00:14:43.502 fused_ordering(123) 00:14:43.502 fused_ordering(124) 00:14:43.502 fused_ordering(125) 00:14:43.502 fused_ordering(126) 00:14:43.502 fused_ordering(127) 00:14:43.502 fused_ordering(128) 00:14:43.502 fused_ordering(129) 00:14:43.502 fused_ordering(130) 00:14:43.502 fused_ordering(131) 00:14:43.502 fused_ordering(132) 00:14:43.502 fused_ordering(133) 00:14:43.502 fused_ordering(134) 00:14:43.502 fused_ordering(135) 00:14:43.502 fused_ordering(136) 00:14:43.502 fused_ordering(137) 00:14:43.502 fused_ordering(138) 00:14:43.502 fused_ordering(139) 00:14:43.502 fused_ordering(140) 00:14:43.502 fused_ordering(141) 00:14:43.502 fused_ordering(142) 00:14:43.502 fused_ordering(143) 00:14:43.502 fused_ordering(144) 00:14:43.502 fused_ordering(145) 00:14:43.502 fused_ordering(146) 00:14:43.502 fused_ordering(147) 00:14:43.502 fused_ordering(148) 00:14:43.502 fused_ordering(149) 00:14:43.502 fused_ordering(150) 00:14:43.502 fused_ordering(151) 00:14:43.502 fused_ordering(152) 00:14:43.502 fused_ordering(153) 00:14:43.502 fused_ordering(154) 00:14:43.502 fused_ordering(155) 00:14:43.502 fused_ordering(156) 00:14:43.502 fused_ordering(157) 00:14:43.502 fused_ordering(158) 00:14:43.502 fused_ordering(159) 00:14:43.502 fused_ordering(160) 00:14:43.502 fused_ordering(161) 00:14:43.502 fused_ordering(162) 00:14:43.502 fused_ordering(163) 00:14:43.502 fused_ordering(164) 00:14:43.502 fused_ordering(165) 00:14:43.502 fused_ordering(166) 00:14:43.502 fused_ordering(167) 00:14:43.502 fused_ordering(168) 00:14:43.502 fused_ordering(169) 00:14:43.502 fused_ordering(170) 00:14:43.502 fused_ordering(171) 00:14:43.502 fused_ordering(172) 00:14:43.502 fused_ordering(173) 00:14:43.502 fused_ordering(174) 00:14:43.502 fused_ordering(175) 00:14:43.502 fused_ordering(176) 00:14:43.502 fused_ordering(177) 00:14:43.502 fused_ordering(178) 00:14:43.502 fused_ordering(179) 00:14:43.502 fused_ordering(180) 00:14:43.502 fused_ordering(181) 00:14:43.502 fused_ordering(182) 00:14:43.502 fused_ordering(183) 00:14:43.502 fused_ordering(184) 00:14:43.502 fused_ordering(185) 00:14:43.502 fused_ordering(186) 00:14:43.502 fused_ordering(187) 00:14:43.502 fused_ordering(188) 00:14:43.502 fused_ordering(189) 00:14:43.502 fused_ordering(190) 00:14:43.502 fused_ordering(191) 00:14:43.502 fused_ordering(192) 00:14:43.502 fused_ordering(193) 00:14:43.502 fused_ordering(194) 00:14:43.502 fused_ordering(195) 00:14:43.502 fused_ordering(196) 00:14:43.502 fused_ordering(197) 00:14:43.502 fused_ordering(198) 00:14:43.502 fused_ordering(199) 00:14:43.502 fused_ordering(200) 00:14:43.502 fused_ordering(201) 00:14:43.502 fused_ordering(202) 00:14:43.502 fused_ordering(203) 00:14:43.502 fused_ordering(204) 00:14:43.502 fused_ordering(205) 00:14:43.762 fused_ordering(206) 00:14:43.762 fused_ordering(207) 00:14:43.762 fused_ordering(208) 00:14:43.762 fused_ordering(209) 00:14:43.762 fused_ordering(210) 00:14:43.762 fused_ordering(211) 00:14:43.762 fused_ordering(212) 00:14:43.762 fused_ordering(213) 00:14:43.762 fused_ordering(214) 00:14:43.762 fused_ordering(215) 00:14:43.762 fused_ordering(216) 00:14:43.762 fused_ordering(217) 00:14:43.762 fused_ordering(218) 00:14:43.762 fused_ordering(219) 00:14:43.762 fused_ordering(220) 00:14:43.762 fused_ordering(221) 00:14:43.762 fused_ordering(222) 00:14:43.762 fused_ordering(223) 00:14:43.762 fused_ordering(224) 00:14:43.762 fused_ordering(225) 00:14:43.762 fused_ordering(226) 00:14:43.762 fused_ordering(227) 00:14:43.762 fused_ordering(228) 00:14:43.762 fused_ordering(229) 00:14:43.762 fused_ordering(230) 00:14:43.762 fused_ordering(231) 00:14:43.762 fused_ordering(232) 00:14:43.762 fused_ordering(233) 00:14:43.762 fused_ordering(234) 00:14:43.762 fused_ordering(235) 00:14:43.762 fused_ordering(236) 00:14:43.762 fused_ordering(237) 00:14:43.762 fused_ordering(238) 00:14:43.762 fused_ordering(239) 00:14:43.762 fused_ordering(240) 00:14:43.762 fused_ordering(241) 00:14:43.762 fused_ordering(242) 00:14:43.762 fused_ordering(243) 00:14:43.762 fused_ordering(244) 00:14:43.762 fused_ordering(245) 00:14:43.762 fused_ordering(246) 00:14:43.762 fused_ordering(247) 00:14:43.762 fused_ordering(248) 00:14:43.763 fused_ordering(249) 00:14:43.763 fused_ordering(250) 00:14:43.763 fused_ordering(251) 00:14:43.763 fused_ordering(252) 00:14:43.763 fused_ordering(253) 00:14:43.763 fused_ordering(254) 00:14:43.763 fused_ordering(255) 00:14:43.763 fused_ordering(256) 00:14:43.763 fused_ordering(257) 00:14:43.763 fused_ordering(258) 00:14:43.763 fused_ordering(259) 00:14:43.763 fused_ordering(260) 00:14:43.763 fused_ordering(261) 00:14:43.763 fused_ordering(262) 00:14:43.763 fused_ordering(263) 00:14:43.763 fused_ordering(264) 00:14:43.763 fused_ordering(265) 00:14:43.763 fused_ordering(266) 00:14:43.763 fused_ordering(267) 00:14:43.763 fused_ordering(268) 00:14:43.763 fused_ordering(269) 00:14:43.763 fused_ordering(270) 00:14:43.763 fused_ordering(271) 00:14:43.763 fused_ordering(272) 00:14:43.763 fused_ordering(273) 00:14:43.763 fused_ordering(274) 00:14:43.763 fused_ordering(275) 00:14:43.763 fused_ordering(276) 00:14:43.763 fused_ordering(277) 00:14:43.763 fused_ordering(278) 00:14:43.763 fused_ordering(279) 00:14:43.763 fused_ordering(280) 00:14:43.763 fused_ordering(281) 00:14:43.763 fused_ordering(282) 00:14:43.763 fused_ordering(283) 00:14:43.763 fused_ordering(284) 00:14:43.763 fused_ordering(285) 00:14:43.763 fused_ordering(286) 00:14:43.763 fused_ordering(287) 00:14:43.763 fused_ordering(288) 00:14:43.763 fused_ordering(289) 00:14:43.763 fused_ordering(290) 00:14:43.763 fused_ordering(291) 00:14:43.763 fused_ordering(292) 00:14:43.763 fused_ordering(293) 00:14:43.763 fused_ordering(294) 00:14:43.763 fused_ordering(295) 00:14:43.763 fused_ordering(296) 00:14:43.763 fused_ordering(297) 00:14:43.763 fused_ordering(298) 00:14:43.763 fused_ordering(299) 00:14:43.763 fused_ordering(300) 00:14:43.763 fused_ordering(301) 00:14:43.763 fused_ordering(302) 00:14:43.763 fused_ordering(303) 00:14:43.763 fused_ordering(304) 00:14:43.763 fused_ordering(305) 00:14:43.763 fused_ordering(306) 00:14:43.763 fused_ordering(307) 00:14:43.763 fused_ordering(308) 00:14:43.763 fused_ordering(309) 00:14:43.763 fused_ordering(310) 00:14:43.763 fused_ordering(311) 00:14:43.763 fused_ordering(312) 00:14:43.763 fused_ordering(313) 00:14:43.763 fused_ordering(314) 00:14:43.763 fused_ordering(315) 00:14:43.763 fused_ordering(316) 00:14:43.763 fused_ordering(317) 00:14:43.763 fused_ordering(318) 00:14:43.763 fused_ordering(319) 00:14:43.763 fused_ordering(320) 00:14:43.763 fused_ordering(321) 00:14:43.763 fused_ordering(322) 00:14:43.763 fused_ordering(323) 00:14:43.763 fused_ordering(324) 00:14:43.763 fused_ordering(325) 00:14:43.763 fused_ordering(326) 00:14:43.763 fused_ordering(327) 00:14:43.763 fused_ordering(328) 00:14:43.763 fused_ordering(329) 00:14:43.763 fused_ordering(330) 00:14:43.763 fused_ordering(331) 00:14:43.763 fused_ordering(332) 00:14:43.763 fused_ordering(333) 00:14:43.763 fused_ordering(334) 00:14:43.763 fused_ordering(335) 00:14:43.763 fused_ordering(336) 00:14:43.763 fused_ordering(337) 00:14:43.763 fused_ordering(338) 00:14:43.763 fused_ordering(339) 00:14:43.763 fused_ordering(340) 00:14:43.763 fused_ordering(341) 00:14:43.763 fused_ordering(342) 00:14:43.763 fused_ordering(343) 00:14:43.763 fused_ordering(344) 00:14:43.763 fused_ordering(345) 00:14:43.763 fused_ordering(346) 00:14:43.763 fused_ordering(347) 00:14:43.763 fused_ordering(348) 00:14:43.763 fused_ordering(349) 00:14:43.763 fused_ordering(350) 00:14:43.763 fused_ordering(351) 00:14:43.763 fused_ordering(352) 00:14:43.763 fused_ordering(353) 00:14:43.763 fused_ordering(354) 00:14:43.763 fused_ordering(355) 00:14:43.763 fused_ordering(356) 00:14:43.763 fused_ordering(357) 00:14:43.763 fused_ordering(358) 00:14:43.763 fused_ordering(359) 00:14:43.763 fused_ordering(360) 00:14:43.763 fused_ordering(361) 00:14:43.763 fused_ordering(362) 00:14:43.763 fused_ordering(363) 00:14:43.763 fused_ordering(364) 00:14:43.763 fused_ordering(365) 00:14:43.763 fused_ordering(366) 00:14:43.763 fused_ordering(367) 00:14:43.763 fused_ordering(368) 00:14:43.763 fused_ordering(369) 00:14:43.763 fused_ordering(370) 00:14:43.763 fused_ordering(371) 00:14:43.763 fused_ordering(372) 00:14:43.763 fused_ordering(373) 00:14:43.763 fused_ordering(374) 00:14:43.763 fused_ordering(375) 00:14:43.763 fused_ordering(376) 00:14:43.763 fused_ordering(377) 00:14:43.763 fused_ordering(378) 00:14:43.763 fused_ordering(379) 00:14:43.763 fused_ordering(380) 00:14:43.763 fused_ordering(381) 00:14:43.763 fused_ordering(382) 00:14:43.763 fused_ordering(383) 00:14:43.763 fused_ordering(384) 00:14:43.763 fused_ordering(385) 00:14:43.763 fused_ordering(386) 00:14:43.763 fused_ordering(387) 00:14:43.763 fused_ordering(388) 00:14:43.763 fused_ordering(389) 00:14:43.763 fused_ordering(390) 00:14:43.763 fused_ordering(391) 00:14:43.763 fused_ordering(392) 00:14:43.763 fused_ordering(393) 00:14:43.763 fused_ordering(394) 00:14:43.763 fused_ordering(395) 00:14:43.763 fused_ordering(396) 00:14:43.763 fused_ordering(397) 00:14:43.763 fused_ordering(398) 00:14:43.763 fused_ordering(399) 00:14:43.763 fused_ordering(400) 00:14:43.763 fused_ordering(401) 00:14:43.763 fused_ordering(402) 00:14:43.763 fused_ordering(403) 00:14:43.763 fused_ordering(404) 00:14:43.763 fused_ordering(405) 00:14:43.763 fused_ordering(406) 00:14:43.763 fused_ordering(407) 00:14:43.763 fused_ordering(408) 00:14:43.763 fused_ordering(409) 00:14:43.763 fused_ordering(410) 00:14:44.333 fused_ordering(411) 00:14:44.333 fused_ordering(412) 00:14:44.333 fused_ordering(413) 00:14:44.333 fused_ordering(414) 00:14:44.333 fused_ordering(415) 00:14:44.333 fused_ordering(416) 00:14:44.333 fused_ordering(417) 00:14:44.333 fused_ordering(418) 00:14:44.333 fused_ordering(419) 00:14:44.333 fused_ordering(420) 00:14:44.333 fused_ordering(421) 00:14:44.334 fused_ordering(422) 00:14:44.334 fused_ordering(423) 00:14:44.334 fused_ordering(424) 00:14:44.334 fused_ordering(425) 00:14:44.334 fused_ordering(426) 00:14:44.334 fused_ordering(427) 00:14:44.334 fused_ordering(428) 00:14:44.334 fused_ordering(429) 00:14:44.334 fused_ordering(430) 00:14:44.334 fused_ordering(431) 00:14:44.334 fused_ordering(432) 00:14:44.334 fused_ordering(433) 00:14:44.334 fused_ordering(434) 00:14:44.334 fused_ordering(435) 00:14:44.334 fused_ordering(436) 00:14:44.334 fused_ordering(437) 00:14:44.334 fused_ordering(438) 00:14:44.334 fused_ordering(439) 00:14:44.334 fused_ordering(440) 00:14:44.334 fused_ordering(441) 00:14:44.334 fused_ordering(442) 00:14:44.334 fused_ordering(443) 00:14:44.334 fused_ordering(444) 00:14:44.334 fused_ordering(445) 00:14:44.334 fused_ordering(446) 00:14:44.334 fused_ordering(447) 00:14:44.334 fused_ordering(448) 00:14:44.334 fused_ordering(449) 00:14:44.334 fused_ordering(450) 00:14:44.334 fused_ordering(451) 00:14:44.334 fused_ordering(452) 00:14:44.334 fused_ordering(453) 00:14:44.334 fused_ordering(454) 00:14:44.334 fused_ordering(455) 00:14:44.334 fused_ordering(456) 00:14:44.334 fused_ordering(457) 00:14:44.334 fused_ordering(458) 00:14:44.334 fused_ordering(459) 00:14:44.334 fused_ordering(460) 00:14:44.334 fused_ordering(461) 00:14:44.334 fused_ordering(462) 00:14:44.334 fused_ordering(463) 00:14:44.334 fused_ordering(464) 00:14:44.334 fused_ordering(465) 00:14:44.334 fused_ordering(466) 00:14:44.334 fused_ordering(467) 00:14:44.334 fused_ordering(468) 00:14:44.334 fused_ordering(469) 00:14:44.334 fused_ordering(470) 00:14:44.334 fused_ordering(471) 00:14:44.334 fused_ordering(472) 00:14:44.334 fused_ordering(473) 00:14:44.334 fused_ordering(474) 00:14:44.334 fused_ordering(475) 00:14:44.334 fused_ordering(476) 00:14:44.334 fused_ordering(477) 00:14:44.334 fused_ordering(478) 00:14:44.334 fused_ordering(479) 00:14:44.334 fused_ordering(480) 00:14:44.334 fused_ordering(481) 00:14:44.334 fused_ordering(482) 00:14:44.334 fused_ordering(483) 00:14:44.334 fused_ordering(484) 00:14:44.334 fused_ordering(485) 00:14:44.334 fused_ordering(486) 00:14:44.334 fused_ordering(487) 00:14:44.334 fused_ordering(488) 00:14:44.334 fused_ordering(489) 00:14:44.334 fused_ordering(490) 00:14:44.334 fused_ordering(491) 00:14:44.334 fused_ordering(492) 00:14:44.334 fused_ordering(493) 00:14:44.334 fused_ordering(494) 00:14:44.334 fused_ordering(495) 00:14:44.334 fused_ordering(496) 00:14:44.334 fused_ordering(497) 00:14:44.334 fused_ordering(498) 00:14:44.334 fused_ordering(499) 00:14:44.334 fused_ordering(500) 00:14:44.334 fused_ordering(501) 00:14:44.334 fused_ordering(502) 00:14:44.334 fused_ordering(503) 00:14:44.334 fused_ordering(504) 00:14:44.334 fused_ordering(505) 00:14:44.334 fused_ordering(506) 00:14:44.334 fused_ordering(507) 00:14:44.334 fused_ordering(508) 00:14:44.334 fused_ordering(509) 00:14:44.334 fused_ordering(510) 00:14:44.334 fused_ordering(511) 00:14:44.334 fused_ordering(512) 00:14:44.334 fused_ordering(513) 00:14:44.334 fused_ordering(514) 00:14:44.334 fused_ordering(515) 00:14:44.334 fused_ordering(516) 00:14:44.334 fused_ordering(517) 00:14:44.334 fused_ordering(518) 00:14:44.334 fused_ordering(519) 00:14:44.334 fused_ordering(520) 00:14:44.334 fused_ordering(521) 00:14:44.334 fused_ordering(522) 00:14:44.334 fused_ordering(523) 00:14:44.334 fused_ordering(524) 00:14:44.334 fused_ordering(525) 00:14:44.334 fused_ordering(526) 00:14:44.334 fused_ordering(527) 00:14:44.334 fused_ordering(528) 00:14:44.334 fused_ordering(529) 00:14:44.334 fused_ordering(530) 00:14:44.334 fused_ordering(531) 00:14:44.334 fused_ordering(532) 00:14:44.334 fused_ordering(533) 00:14:44.334 fused_ordering(534) 00:14:44.334 fused_ordering(535) 00:14:44.334 fused_ordering(536) 00:14:44.334 fused_ordering(537) 00:14:44.334 fused_ordering(538) 00:14:44.334 fused_ordering(539) 00:14:44.334 fused_ordering(540) 00:14:44.334 fused_ordering(541) 00:14:44.334 fused_ordering(542) 00:14:44.334 fused_ordering(543) 00:14:44.334 fused_ordering(544) 00:14:44.334 fused_ordering(545) 00:14:44.334 fused_ordering(546) 00:14:44.334 fused_ordering(547) 00:14:44.334 fused_ordering(548) 00:14:44.334 fused_ordering(549) 00:14:44.334 fused_ordering(550) 00:14:44.334 fused_ordering(551) 00:14:44.334 fused_ordering(552) 00:14:44.334 fused_ordering(553) 00:14:44.334 fused_ordering(554) 00:14:44.334 fused_ordering(555) 00:14:44.334 fused_ordering(556) 00:14:44.334 fused_ordering(557) 00:14:44.334 fused_ordering(558) 00:14:44.334 fused_ordering(559) 00:14:44.334 fused_ordering(560) 00:14:44.334 fused_ordering(561) 00:14:44.334 fused_ordering(562) 00:14:44.334 fused_ordering(563) 00:14:44.334 fused_ordering(564) 00:14:44.334 fused_ordering(565) 00:14:44.335 fused_ordering(566) 00:14:44.335 fused_ordering(567) 00:14:44.335 fused_ordering(568) 00:14:44.335 fused_ordering(569) 00:14:44.335 fused_ordering(570) 00:14:44.335 fused_ordering(571) 00:14:44.335 fused_ordering(572) 00:14:44.335 fused_ordering(573) 00:14:44.335 fused_ordering(574) 00:14:44.335 fused_ordering(575) 00:14:44.335 fused_ordering(576) 00:14:44.335 fused_ordering(577) 00:14:44.335 fused_ordering(578) 00:14:44.335 fused_ordering(579) 00:14:44.335 fused_ordering(580) 00:14:44.335 fused_ordering(581) 00:14:44.335 fused_ordering(582) 00:14:44.335 fused_ordering(583) 00:14:44.335 fused_ordering(584) 00:14:44.335 fused_ordering(585) 00:14:44.335 fused_ordering(586) 00:14:44.335 fused_ordering(587) 00:14:44.335 fused_ordering(588) 00:14:44.335 fused_ordering(589) 00:14:44.335 fused_ordering(590) 00:14:44.335 fused_ordering(591) 00:14:44.335 fused_ordering(592) 00:14:44.335 fused_ordering(593) 00:14:44.335 fused_ordering(594) 00:14:44.335 fused_ordering(595) 00:14:44.335 fused_ordering(596) 00:14:44.335 fused_ordering(597) 00:14:44.335 fused_ordering(598) 00:14:44.335 fused_ordering(599) 00:14:44.335 fused_ordering(600) 00:14:44.335 fused_ordering(601) 00:14:44.335 fused_ordering(602) 00:14:44.335 fused_ordering(603) 00:14:44.335 fused_ordering(604) 00:14:44.335 fused_ordering(605) 00:14:44.335 fused_ordering(606) 00:14:44.335 fused_ordering(607) 00:14:44.335 fused_ordering(608) 00:14:44.335 fused_ordering(609) 00:14:44.335 fused_ordering(610) 00:14:44.335 fused_ordering(611) 00:14:44.335 fused_ordering(612) 00:14:44.335 fused_ordering(613) 00:14:44.335 fused_ordering(614) 00:14:44.335 fused_ordering(615) 00:14:44.908 fused_ordering(616) 00:14:44.908 fused_ordering(617) 00:14:44.908 fused_ordering(618) 00:14:44.908 fused_ordering(619) 00:14:44.908 fused_ordering(620) 00:14:44.908 fused_ordering(621) 00:14:44.908 fused_ordering(622) 00:14:44.908 fused_ordering(623) 00:14:44.908 fused_ordering(624) 00:14:44.908 fused_ordering(625) 00:14:44.908 fused_ordering(626) 00:14:44.908 fused_ordering(627) 00:14:44.908 fused_ordering(628) 00:14:44.908 fused_ordering(629) 00:14:44.908 fused_ordering(630) 00:14:44.908 fused_ordering(631) 00:14:44.908 fused_ordering(632) 00:14:44.908 fused_ordering(633) 00:14:44.908 fused_ordering(634) 00:14:44.908 fused_ordering(635) 00:14:44.908 fused_ordering(636) 00:14:44.908 fused_ordering(637) 00:14:44.908 fused_ordering(638) 00:14:44.908 fused_ordering(639) 00:14:44.908 fused_ordering(640) 00:14:44.908 fused_ordering(641) 00:14:44.908 fused_ordering(642) 00:14:44.908 fused_ordering(643) 00:14:44.908 fused_ordering(644) 00:14:44.908 fused_ordering(645) 00:14:44.908 fused_ordering(646) 00:14:44.908 fused_ordering(647) 00:14:44.908 fused_ordering(648) 00:14:44.908 fused_ordering(649) 00:14:44.908 fused_ordering(650) 00:14:44.908 fused_ordering(651) 00:14:44.908 fused_ordering(652) 00:14:44.908 fused_ordering(653) 00:14:44.908 fused_ordering(654) 00:14:44.908 fused_ordering(655) 00:14:44.908 fused_ordering(656) 00:14:44.908 fused_ordering(657) 00:14:44.908 fused_ordering(658) 00:14:44.908 fused_ordering(659) 00:14:44.908 fused_ordering(660) 00:14:44.908 fused_ordering(661) 00:14:44.908 fused_ordering(662) 00:14:44.908 fused_ordering(663) 00:14:44.908 fused_ordering(664) 00:14:44.908 fused_ordering(665) 00:14:44.908 fused_ordering(666) 00:14:44.908 fused_ordering(667) 00:14:44.908 fused_ordering(668) 00:14:44.908 fused_ordering(669) 00:14:44.908 fused_ordering(670) 00:14:44.908 fused_ordering(671) 00:14:44.908 fused_ordering(672) 00:14:44.908 fused_ordering(673) 00:14:44.908 fused_ordering(674) 00:14:44.908 fused_ordering(675) 00:14:44.908 fused_ordering(676) 00:14:44.908 fused_ordering(677) 00:14:44.908 fused_ordering(678) 00:14:44.908 fused_ordering(679) 00:14:44.908 fused_ordering(680) 00:14:44.908 fused_ordering(681) 00:14:44.908 fused_ordering(682) 00:14:44.908 fused_ordering(683) 00:14:44.908 fused_ordering(684) 00:14:44.908 fused_ordering(685) 00:14:44.908 fused_ordering(686) 00:14:44.908 fused_ordering(687) 00:14:44.908 fused_ordering(688) 00:14:44.908 fused_ordering(689) 00:14:44.908 fused_ordering(690) 00:14:44.908 fused_ordering(691) 00:14:44.908 fused_ordering(692) 00:14:44.908 fused_ordering(693) 00:14:44.908 fused_ordering(694) 00:14:44.908 fused_ordering(695) 00:14:44.908 fused_ordering(696) 00:14:44.908 fused_ordering(697) 00:14:44.908 fused_ordering(698) 00:14:44.908 fused_ordering(699) 00:14:44.908 fused_ordering(700) 00:14:44.908 fused_ordering(701) 00:14:44.908 fused_ordering(702) 00:14:44.908 fused_ordering(703) 00:14:44.908 fused_ordering(704) 00:14:44.908 fused_ordering(705) 00:14:44.908 fused_ordering(706) 00:14:44.908 fused_ordering(707) 00:14:44.908 fused_ordering(708) 00:14:44.908 fused_ordering(709) 00:14:44.908 fused_ordering(710) 00:14:44.908 fused_ordering(711) 00:14:44.908 fused_ordering(712) 00:14:44.908 fused_ordering(713) 00:14:44.908 fused_ordering(714) 00:14:44.908 fused_ordering(715) 00:14:44.908 fused_ordering(716) 00:14:44.908 fused_ordering(717) 00:14:44.908 fused_ordering(718) 00:14:44.908 fused_ordering(719) 00:14:44.908 fused_ordering(720) 00:14:44.908 fused_ordering(721) 00:14:44.908 fused_ordering(722) 00:14:44.908 fused_ordering(723) 00:14:44.908 fused_ordering(724) 00:14:44.908 fused_ordering(725) 00:14:44.908 fused_ordering(726) 00:14:44.908 fused_ordering(727) 00:14:44.908 fused_ordering(728) 00:14:44.908 fused_ordering(729) 00:14:44.908 fused_ordering(730) 00:14:44.908 fused_ordering(731) 00:14:44.908 fused_ordering(732) 00:14:44.908 fused_ordering(733) 00:14:44.908 fused_ordering(734) 00:14:44.908 fused_ordering(735) 00:14:44.908 fused_ordering(736) 00:14:44.908 fused_ordering(737) 00:14:44.908 fused_ordering(738) 00:14:44.908 fused_ordering(739) 00:14:44.908 fused_ordering(740) 00:14:44.908 fused_ordering(741) 00:14:44.908 fused_ordering(742) 00:14:44.908 fused_ordering(743) 00:14:44.908 fused_ordering(744) 00:14:44.908 fused_ordering(745) 00:14:44.908 fused_ordering(746) 00:14:44.908 fused_ordering(747) 00:14:44.908 fused_ordering(748) 00:14:44.908 fused_ordering(749) 00:14:44.908 fused_ordering(750) 00:14:44.908 fused_ordering(751) 00:14:44.908 fused_ordering(752) 00:14:44.908 fused_ordering(753) 00:14:44.908 fused_ordering(754) 00:14:44.908 fused_ordering(755) 00:14:44.908 fused_ordering(756) 00:14:44.908 fused_ordering(757) 00:14:44.908 fused_ordering(758) 00:14:44.908 fused_ordering(759) 00:14:44.908 fused_ordering(760) 00:14:44.908 fused_ordering(761) 00:14:44.908 fused_ordering(762) 00:14:44.908 fused_ordering(763) 00:14:44.908 fused_ordering(764) 00:14:44.908 fused_ordering(765) 00:14:44.908 fused_ordering(766) 00:14:44.908 fused_ordering(767) 00:14:44.908 fused_ordering(768) 00:14:44.908 fused_ordering(769) 00:14:44.908 fused_ordering(770) 00:14:44.908 fused_ordering(771) 00:14:44.908 fused_ordering(772) 00:14:44.908 fused_ordering(773) 00:14:44.908 fused_ordering(774) 00:14:44.908 fused_ordering(775) 00:14:44.908 fused_ordering(776) 00:14:44.908 fused_ordering(777) 00:14:44.908 fused_ordering(778) 00:14:44.908 fused_ordering(779) 00:14:44.908 fused_ordering(780) 00:14:44.908 fused_ordering(781) 00:14:44.908 fused_ordering(782) 00:14:44.908 fused_ordering(783) 00:14:44.908 fused_ordering(784) 00:14:44.908 fused_ordering(785) 00:14:44.908 fused_ordering(786) 00:14:44.908 fused_ordering(787) 00:14:44.908 fused_ordering(788) 00:14:44.908 fused_ordering(789) 00:14:44.908 fused_ordering(790) 00:14:44.908 fused_ordering(791) 00:14:44.908 fused_ordering(792) 00:14:44.908 fused_ordering(793) 00:14:44.908 fused_ordering(794) 00:14:44.908 fused_ordering(795) 00:14:44.908 fused_ordering(796) 00:14:44.908 fused_ordering(797) 00:14:44.908 fused_ordering(798) 00:14:44.908 fused_ordering(799) 00:14:44.908 fused_ordering(800) 00:14:44.908 fused_ordering(801) 00:14:44.908 fused_ordering(802) 00:14:44.908 fused_ordering(803) 00:14:44.908 fused_ordering(804) 00:14:44.908 fused_ordering(805) 00:14:44.908 fused_ordering(806) 00:14:44.908 fused_ordering(807) 00:14:44.908 fused_ordering(808) 00:14:44.908 fused_ordering(809) 00:14:44.908 fused_ordering(810) 00:14:44.908 fused_ordering(811) 00:14:44.908 fused_ordering(812) 00:14:44.908 fused_ordering(813) 00:14:44.908 fused_ordering(814) 00:14:44.908 fused_ordering(815) 00:14:44.908 fused_ordering(816) 00:14:44.908 fused_ordering(817) 00:14:44.908 fused_ordering(818) 00:14:44.908 fused_ordering(819) 00:14:44.908 fused_ordering(820) 00:14:45.476 fused_ordering(821) 00:14:45.476 fused_ordering(822) 00:14:45.476 fused_ordering(823) 00:14:45.476 fused_ordering(824) 00:14:45.476 fused_ordering(825) 00:14:45.476 fused_ordering(826) 00:14:45.476 fused_ordering(827) 00:14:45.476 fused_ordering(828) 00:14:45.476 fused_ordering(829) 00:14:45.476 fused_ordering(830) 00:14:45.476 fused_ordering(831) 00:14:45.476 fused_ordering(832) 00:14:45.476 fused_ordering(833) 00:14:45.476 fused_ordering(834) 00:14:45.476 fused_ordering(835) 00:14:45.476 fused_ordering(836) 00:14:45.476 fused_ordering(837) 00:14:45.476 fused_ordering(838) 00:14:45.476 fused_ordering(839) 00:14:45.476 fused_ordering(840) 00:14:45.476 fused_ordering(841) 00:14:45.476 fused_ordering(842) 00:14:45.476 fused_ordering(843) 00:14:45.476 fused_ordering(844) 00:14:45.476 fused_ordering(845) 00:14:45.476 fused_ordering(846) 00:14:45.476 fused_ordering(847) 00:14:45.476 fused_ordering(848) 00:14:45.476 fused_ordering(849) 00:14:45.476 fused_ordering(850) 00:14:45.476 fused_ordering(851) 00:14:45.476 fused_ordering(852) 00:14:45.476 fused_ordering(853) 00:14:45.476 fused_ordering(854) 00:14:45.476 fused_ordering(855) 00:14:45.476 fused_ordering(856) 00:14:45.476 fused_ordering(857) 00:14:45.476 fused_ordering(858) 00:14:45.476 fused_ordering(859) 00:14:45.476 fused_ordering(860) 00:14:45.476 fused_ordering(861) 00:14:45.476 fused_ordering(862) 00:14:45.476 fused_ordering(863) 00:14:45.476 fused_ordering(864) 00:14:45.476 fused_ordering(865) 00:14:45.476 fused_ordering(866) 00:14:45.476 fused_ordering(867) 00:14:45.476 fused_ordering(868) 00:14:45.476 fused_ordering(869) 00:14:45.476 fused_ordering(870) 00:14:45.476 fused_ordering(871) 00:14:45.476 fused_ordering(872) 00:14:45.476 fused_ordering(873) 00:14:45.476 fused_ordering(874) 00:14:45.476 fused_ordering(875) 00:14:45.476 fused_ordering(876) 00:14:45.476 fused_ordering(877) 00:14:45.476 fused_ordering(878) 00:14:45.476 fused_ordering(879) 00:14:45.476 fused_ordering(880) 00:14:45.476 fused_ordering(881) 00:14:45.476 fused_ordering(882) 00:14:45.476 fused_ordering(883) 00:14:45.476 fused_ordering(884) 00:14:45.476 fused_ordering(885) 00:14:45.476 fused_ordering(886) 00:14:45.476 fused_ordering(887) 00:14:45.476 fused_ordering(888) 00:14:45.476 fused_ordering(889) 00:14:45.476 fused_ordering(890) 00:14:45.476 fused_ordering(891) 00:14:45.476 fused_ordering(892) 00:14:45.476 fused_ordering(893) 00:14:45.476 fused_ordering(894) 00:14:45.476 fused_ordering(895) 00:14:45.476 fused_ordering(896) 00:14:45.476 fused_ordering(897) 00:14:45.476 fused_ordering(898) 00:14:45.476 fused_ordering(899) 00:14:45.476 fused_ordering(900) 00:14:45.476 fused_ordering(901) 00:14:45.476 fused_ordering(902) 00:14:45.476 fused_ordering(903) 00:14:45.476 fused_ordering(904) 00:14:45.476 fused_ordering(905) 00:14:45.476 fused_ordering(906) 00:14:45.476 fused_ordering(907) 00:14:45.476 fused_ordering(908) 00:14:45.476 fused_ordering(909) 00:14:45.476 fused_ordering(910) 00:14:45.476 fused_ordering(911) 00:14:45.476 fused_ordering(912) 00:14:45.476 fused_ordering(913) 00:14:45.476 fused_ordering(914) 00:14:45.476 fused_ordering(915) 00:14:45.476 fused_ordering(916) 00:14:45.476 fused_ordering(917) 00:14:45.476 fused_ordering(918) 00:14:45.476 fused_ordering(919) 00:14:45.476 fused_ordering(920) 00:14:45.476 fused_ordering(921) 00:14:45.476 fused_ordering(922) 00:14:45.476 fused_ordering(923) 00:14:45.476 fused_ordering(924) 00:14:45.476 fused_ordering(925) 00:14:45.476 fused_ordering(926) 00:14:45.476 fused_ordering(927) 00:14:45.476 fused_ordering(928) 00:14:45.476 fused_ordering(929) 00:14:45.476 fused_ordering(930) 00:14:45.476 fused_ordering(931) 00:14:45.476 fused_ordering(932) 00:14:45.476 fused_ordering(933) 00:14:45.476 fused_ordering(934) 00:14:45.476 fused_ordering(935) 00:14:45.476 fused_ordering(936) 00:14:45.476 fused_ordering(937) 00:14:45.476 fused_ordering(938) 00:14:45.476 fused_ordering(939) 00:14:45.476 fused_ordering(940) 00:14:45.476 fused_ordering(941) 00:14:45.476 fused_ordering(942) 00:14:45.476 fused_ordering(943) 00:14:45.476 fused_ordering(944) 00:14:45.476 fused_ordering(945) 00:14:45.476 fused_ordering(946) 00:14:45.476 fused_ordering(947) 00:14:45.476 fused_ordering(948) 00:14:45.476 fused_ordering(949) 00:14:45.476 fused_ordering(950) 00:14:45.476 fused_ordering(951) 00:14:45.476 fused_ordering(952) 00:14:45.476 fused_ordering(953) 00:14:45.476 fused_ordering(954) 00:14:45.476 fused_ordering(955) 00:14:45.476 fused_ordering(956) 00:14:45.476 fused_ordering(957) 00:14:45.476 fused_ordering(958) 00:14:45.476 fused_ordering(959) 00:14:45.476 fused_ordering(960) 00:14:45.476 fused_ordering(961) 00:14:45.476 fused_ordering(962) 00:14:45.476 fused_ordering(963) 00:14:45.476 fused_ordering(964) 00:14:45.476 fused_ordering(965) 00:14:45.476 fused_ordering(966) 00:14:45.476 fused_ordering(967) 00:14:45.476 fused_ordering(968) 00:14:45.476 fused_ordering(969) 00:14:45.476 fused_ordering(970) 00:14:45.476 fused_ordering(971) 00:14:45.476 fused_ordering(972) 00:14:45.476 fused_ordering(973) 00:14:45.476 fused_ordering(974) 00:14:45.476 fused_ordering(975) 00:14:45.476 fused_ordering(976) 00:14:45.476 fused_ordering(977) 00:14:45.476 fused_ordering(978) 00:14:45.476 fused_ordering(979) 00:14:45.476 fused_ordering(980) 00:14:45.476 fused_ordering(981) 00:14:45.476 fused_ordering(982) 00:14:45.476 fused_ordering(983) 00:14:45.476 fused_ordering(984) 00:14:45.476 fused_ordering(985) 00:14:45.476 fused_ordering(986) 00:14:45.476 fused_ordering(987) 00:14:45.476 fused_ordering(988) 00:14:45.476 fused_ordering(989) 00:14:45.477 fused_ordering(990) 00:14:45.477 fused_ordering(991) 00:14:45.477 fused_ordering(992) 00:14:45.477 fused_ordering(993) 00:14:45.477 fused_ordering(994) 00:14:45.477 fused_ordering(995) 00:14:45.477 fused_ordering(996) 00:14:45.477 fused_ordering(997) 00:14:45.477 fused_ordering(998) 00:14:45.477 fused_ordering(999) 00:14:45.477 fused_ordering(1000) 00:14:45.477 fused_ordering(1001) 00:14:45.477 fused_ordering(1002) 00:14:45.477 fused_ordering(1003) 00:14:45.477 fused_ordering(1004) 00:14:45.477 fused_ordering(1005) 00:14:45.477 fused_ordering(1006) 00:14:45.477 fused_ordering(1007) 00:14:45.477 fused_ordering(1008) 00:14:45.477 fused_ordering(1009) 00:14:45.477 fused_ordering(1010) 00:14:45.477 fused_ordering(1011) 00:14:45.477 fused_ordering(1012) 00:14:45.477 fused_ordering(1013) 00:14:45.477 fused_ordering(1014) 00:14:45.477 fused_ordering(1015) 00:14:45.477 fused_ordering(1016) 00:14:45.477 fused_ordering(1017) 00:14:45.477 fused_ordering(1018) 00:14:45.477 fused_ordering(1019) 00:14:45.477 fused_ordering(1020) 00:14:45.477 fused_ordering(1021) 00:14:45.477 fused_ordering(1022) 00:14:45.477 fused_ordering(1023) 00:14:45.477 15:58:35 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:14:45.477 15:58:35 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:14:45.477 15:58:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:45.477 15:58:35 -- nvmf/common.sh@116 -- # sync 00:14:45.477 15:58:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:45.477 15:58:35 -- nvmf/common.sh@119 -- # set +e 00:14:45.477 15:58:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:45.477 15:58:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:45.477 rmmod nvme_tcp 00:14:45.477 rmmod nvme_fabrics 00:14:45.477 rmmod nvme_keyring 00:14:45.477 15:58:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:45.477 15:58:35 -- nvmf/common.sh@123 -- # set -e 00:14:45.477 15:58:35 -- nvmf/common.sh@124 -- # return 0 00:14:45.477 15:58:35 -- nvmf/common.sh@477 -- # '[' -n 2384287 ']' 00:14:45.477 15:58:35 -- nvmf/common.sh@478 -- # killprocess 2384287 00:14:45.477 15:58:35 -- common/autotest_common.sh@926 -- # '[' -z 2384287 ']' 00:14:45.477 15:58:35 -- common/autotest_common.sh@930 -- # kill -0 2384287 00:14:45.477 15:58:35 -- common/autotest_common.sh@931 -- # uname 00:14:45.477 15:58:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:45.477 15:58:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2384287 00:14:45.477 15:58:35 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:45.477 15:58:35 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:45.477 15:58:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2384287' 00:14:45.477 killing process with pid 2384287 00:14:45.477 15:58:35 -- common/autotest_common.sh@945 -- # kill 2384287 00:14:45.477 15:58:35 -- common/autotest_common.sh@950 -- # wait 2384287 00:14:45.735 15:58:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:45.735 15:58:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:45.735 15:58:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:45.735 15:58:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:45.735 15:58:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:45.735 15:58:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:45.736 15:58:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:45.736 15:58:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:48.270 15:58:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:48.270 00:14:48.270 real 0m8.065s 00:14:48.270 user 0m5.811s 00:14:48.270 sys 0m3.190s 00:14:48.270 15:58:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:48.270 15:58:37 -- common/autotest_common.sh@10 -- # set +x 00:14:48.270 ************************************ 00:14:48.270 END TEST nvmf_fused_ordering 00:14:48.270 ************************************ 00:14:48.270 15:58:37 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:48.270 15:58:37 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:48.270 15:58:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:48.270 15:58:37 -- common/autotest_common.sh@10 -- # set +x 00:14:48.270 ************************************ 00:14:48.270 START TEST nvmf_delete_subsystem 00:14:48.270 ************************************ 00:14:48.270 15:58:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:48.270 * Looking for test storage... 00:14:48.270 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:48.270 15:58:37 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:48.270 15:58:37 -- nvmf/common.sh@7 -- # uname -s 00:14:48.270 15:58:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:48.270 15:58:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:48.270 15:58:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:48.270 15:58:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:48.270 15:58:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:48.270 15:58:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:48.270 15:58:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:48.270 15:58:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:48.270 15:58:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:48.270 15:58:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:48.270 15:58:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:48.270 15:58:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:48.270 15:58:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:48.270 15:58:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:48.270 15:58:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:48.270 15:58:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:48.270 15:58:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:48.270 15:58:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:48.270 15:58:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:48.270 15:58:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:48.270 15:58:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:48.270 15:58:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:48.270 15:58:37 -- paths/export.sh@5 -- # export PATH 00:14:48.270 15:58:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:48.270 15:58:37 -- nvmf/common.sh@46 -- # : 0 00:14:48.270 15:58:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:48.270 15:58:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:48.270 15:58:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:48.270 15:58:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:48.270 15:58:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:48.270 15:58:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:48.270 15:58:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:48.270 15:58:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:48.270 15:58:37 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:14:48.270 15:58:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:48.270 15:58:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:48.270 15:58:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:48.270 15:58:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:48.270 15:58:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:48.270 15:58:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:48.270 15:58:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:48.270 15:58:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:48.270 15:58:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:48.270 15:58:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:48.270 15:58:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:48.270 15:58:37 -- common/autotest_common.sh@10 -- # set +x 00:14:49.754 15:58:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:49.754 15:58:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:49.754 15:58:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:49.754 15:58:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:49.754 15:58:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:49.754 15:58:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:49.754 15:58:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:49.754 15:58:39 -- nvmf/common.sh@294 -- # net_devs=() 00:14:49.754 15:58:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:49.754 15:58:39 -- nvmf/common.sh@295 -- # e810=() 00:14:49.754 15:58:39 -- nvmf/common.sh@295 -- # local -ga e810 00:14:49.754 15:58:39 -- nvmf/common.sh@296 -- # x722=() 00:14:49.754 15:58:39 -- nvmf/common.sh@296 -- # local -ga x722 00:14:49.754 15:58:39 -- nvmf/common.sh@297 -- # mlx=() 00:14:49.754 15:58:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:49.754 15:58:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:49.754 15:58:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:49.754 15:58:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:49.754 15:58:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:49.754 15:58:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:49.754 15:58:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:49.754 15:58:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:49.754 15:58:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:49.754 15:58:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:49.754 15:58:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:49.754 15:58:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:49.754 15:58:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:49.754 15:58:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:49.754 15:58:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:49.754 15:58:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:49.754 15:58:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:49.754 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:49.754 15:58:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:49.754 15:58:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:49.754 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:49.754 15:58:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:49.754 15:58:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:49.754 15:58:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:49.754 15:58:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:49.754 15:58:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:49.754 15:58:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:49.754 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:49.754 15:58:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:49.754 15:58:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:49.754 15:58:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:49.754 15:58:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:49.754 15:58:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:49.754 15:58:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:49.754 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:49.754 15:58:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:49.754 15:58:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:49.754 15:58:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:49.754 15:58:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:49.754 15:58:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:49.754 15:58:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:49.754 15:58:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:49.754 15:58:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:49.754 15:58:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:49.754 15:58:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:49.754 15:58:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:49.754 15:58:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:49.754 15:58:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:49.754 15:58:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:49.754 15:58:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:49.754 15:58:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:49.754 15:58:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:49.754 15:58:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:49.754 15:58:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:49.754 15:58:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:49.754 15:58:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:49.754 15:58:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:50.012 15:58:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:50.012 15:58:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:50.012 15:58:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:50.012 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:50.012 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:14:50.012 00:14:50.012 --- 10.0.0.2 ping statistics --- 00:14:50.012 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:50.012 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:14:50.012 15:58:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:50.012 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:50.012 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.066 ms 00:14:50.012 00:14:50.012 --- 10.0.0.1 ping statistics --- 00:14:50.012 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:50.012 rtt min/avg/max/mdev = 0.066/0.066/0.066/0.000 ms 00:14:50.012 15:58:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:50.012 15:58:39 -- nvmf/common.sh@410 -- # return 0 00:14:50.012 15:58:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:50.012 15:58:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:50.012 15:58:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:50.012 15:58:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:50.012 15:58:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:50.012 15:58:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:50.012 15:58:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:50.012 15:58:39 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:14:50.012 15:58:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:50.012 15:58:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:50.012 15:58:39 -- common/autotest_common.sh@10 -- # set +x 00:14:50.012 15:58:39 -- nvmf/common.sh@469 -- # nvmfpid=2386707 00:14:50.012 15:58:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:14:50.012 15:58:39 -- nvmf/common.sh@470 -- # waitforlisten 2386707 00:14:50.012 15:58:39 -- common/autotest_common.sh@819 -- # '[' -z 2386707 ']' 00:14:50.012 15:58:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:50.012 15:58:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:50.012 15:58:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:50.012 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:50.012 15:58:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:50.012 15:58:39 -- common/autotest_common.sh@10 -- # set +x 00:14:50.012 [2024-10-30 15:58:39.726868] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:14:50.012 [2024-10-30 15:58:39.726962] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:50.012 EAL: No free 2048 kB hugepages reported on node 1 00:14:50.012 [2024-10-30 15:58:39.797338] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:14:50.012 [2024-10-30 15:58:39.886316] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:50.012 [2024-10-30 15:58:39.886496] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:50.012 [2024-10-30 15:58:39.886516] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:50.012 [2024-10-30 15:58:39.886529] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:50.012 [2024-10-30 15:58:39.886610] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:50.012 [2024-10-30 15:58:39.886616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:50.947 15:58:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:50.947 15:58:40 -- common/autotest_common.sh@852 -- # return 0 00:14:50.947 15:58:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:50.947 15:58:40 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:50.947 15:58:40 -- common/autotest_common.sh@10 -- # set +x 00:14:50.947 15:58:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:50.947 15:58:40 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:50.947 15:58:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:50.947 15:58:40 -- common/autotest_common.sh@10 -- # set +x 00:14:50.947 [2024-10-30 15:58:40.717663] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:50.947 15:58:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:50.947 15:58:40 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:50.947 15:58:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:50.947 15:58:40 -- common/autotest_common.sh@10 -- # set +x 00:14:50.947 15:58:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:50.947 15:58:40 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:50.947 15:58:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:50.947 15:58:40 -- common/autotest_common.sh@10 -- # set +x 00:14:50.947 [2024-10-30 15:58:40.733972] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:50.947 15:58:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:50.947 15:58:40 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:50.947 15:58:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:50.947 15:58:40 -- common/autotest_common.sh@10 -- # set +x 00:14:50.947 NULL1 00:14:50.947 15:58:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:50.947 15:58:40 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:50.947 15:58:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:50.947 15:58:40 -- common/autotest_common.sh@10 -- # set +x 00:14:50.947 Delay0 00:14:50.947 15:58:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:50.947 15:58:40 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:50.947 15:58:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:50.947 15:58:40 -- common/autotest_common.sh@10 -- # set +x 00:14:50.947 15:58:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:50.947 15:58:40 -- target/delete_subsystem.sh@28 -- # perf_pid=2386867 00:14:50.947 15:58:40 -- target/delete_subsystem.sh@30 -- # sleep 2 00:14:50.947 15:58:40 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:50.947 EAL: No free 2048 kB hugepages reported on node 1 00:14:50.947 [2024-10-30 15:58:40.808523] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:53.486 15:58:42 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:53.486 15:58:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:53.486 15:58:42 -- common/autotest_common.sh@10 -- # set +x 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 starting I/O failed: -6 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 starting I/O failed: -6 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 starting I/O failed: -6 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 starting I/O failed: -6 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 starting I/O failed: -6 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 starting I/O failed: -6 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 starting I/O failed: -6 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 starting I/O failed: -6 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 starting I/O failed: -6 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 starting I/O failed: -6 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 [2024-10-30 15:58:42.887689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f872c00c480 is same with the state(5) to be set 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 [2024-10-30 15:58:42.889389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f872c00bf20 is same with the state(5) to be set 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Write completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.486 Read completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 [2024-10-30 15:58:42.889699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f872c000c00 is same with the state(5) to be set 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 starting I/O failed: -6 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 starting I/O failed: -6 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 starting I/O failed: -6 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 starting I/O failed: -6 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 starting I/O failed: -6 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 starting I/O failed: -6 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 starting I/O failed: -6 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 starting I/O failed: -6 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 starting I/O failed: -6 00:14:53.487 Read completed with error (sct=0, sc=8) 00:14:53.487 Write completed with error (sct=0, sc=8) 00:14:53.487 [2024-10-30 15:58:42.890111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2220c90 is same with the state(5) to be set 00:14:54.056 [2024-10-30 15:58:43.864028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2220a40 is same with the state(5) to be set 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 [2024-10-30 15:58:43.888013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x221f810 is same with the state(5) to be set 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 [2024-10-30 15:58:43.888209] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x221f690 is same with the state(5) to be set 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 [2024-10-30 15:58:43.888464] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2220e10 is same with the state(5) to be set 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Write completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 Read completed with error (sct=0, sc=8) 00:14:54.056 [2024-10-30 15:58:43.891511] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f872c00c1d0 is same with the state(5) to be set 00:14:54.056 [2024-10-30 15:58:43.891927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2220a40 (9): Bad file descriptor 00:14:54.056 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:54.056 15:58:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:54.056 15:58:43 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:54.056 15:58:43 -- target/delete_subsystem.sh@35 -- # kill -0 2386867 00:14:54.056 15:58:43 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:54.056 Initializing NVMe Controllers 00:14:54.056 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:54.056 Controller IO queue size 128, less than required. 00:14:54.056 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:54.056 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:54.056 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:54.056 Initialization complete. Launching workers. 00:14:54.056 ======================================================== 00:14:54.056 Latency(us) 00:14:54.056 Device Information : IOPS MiB/s Average min max 00:14:54.056 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 150.89 0.07 1188911.70 5005.04 2001252.95 00:14:54.056 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 156.84 0.08 869512.33 1346.77 1010668.05 00:14:54.056 ======================================================== 00:14:54.056 Total : 307.73 0.15 1026121.06 1346.77 2001252.95 00:14:54.056 00:14:54.622 15:58:44 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:54.622 15:58:44 -- target/delete_subsystem.sh@35 -- # kill -0 2386867 00:14:54.622 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (2386867) - No such process 00:14:54.622 15:58:44 -- target/delete_subsystem.sh@45 -- # NOT wait 2386867 00:14:54.622 15:58:44 -- common/autotest_common.sh@640 -- # local es=0 00:14:54.622 15:58:44 -- common/autotest_common.sh@642 -- # valid_exec_arg wait 2386867 00:14:54.622 15:58:44 -- common/autotest_common.sh@628 -- # local arg=wait 00:14:54.622 15:58:44 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:54.622 15:58:44 -- common/autotest_common.sh@632 -- # type -t wait 00:14:54.622 15:58:44 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:54.622 15:58:44 -- common/autotest_common.sh@643 -- # wait 2386867 00:14:54.622 15:58:44 -- common/autotest_common.sh@643 -- # es=1 00:14:54.622 15:58:44 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:14:54.622 15:58:44 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:14:54.622 15:58:44 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:14:54.622 15:58:44 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:54.622 15:58:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:54.622 15:58:44 -- common/autotest_common.sh@10 -- # set +x 00:14:54.622 15:58:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:54.622 15:58:44 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:54.622 15:58:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:54.622 15:58:44 -- common/autotest_common.sh@10 -- # set +x 00:14:54.622 [2024-10-30 15:58:44.410062] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:54.622 15:58:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:54.622 15:58:44 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:54.622 15:58:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:54.622 15:58:44 -- common/autotest_common.sh@10 -- # set +x 00:14:54.622 15:58:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:54.622 15:58:44 -- target/delete_subsystem.sh@54 -- # perf_pid=2387285 00:14:54.622 15:58:44 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:54.622 15:58:44 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:54.622 15:58:44 -- target/delete_subsystem.sh@57 -- # kill -0 2387285 00:14:54.622 15:58:44 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:54.622 EAL: No free 2048 kB hugepages reported on node 1 00:14:54.622 [2024-10-30 15:58:44.470160] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:55.191 15:58:44 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:55.191 15:58:44 -- target/delete_subsystem.sh@57 -- # kill -0 2387285 00:14:55.191 15:58:44 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:55.759 15:58:45 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:55.759 15:58:45 -- target/delete_subsystem.sh@57 -- # kill -0 2387285 00:14:55.759 15:58:45 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:56.326 15:58:45 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:56.326 15:58:45 -- target/delete_subsystem.sh@57 -- # kill -0 2387285 00:14:56.326 15:58:45 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:56.585 15:58:46 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:56.585 15:58:46 -- target/delete_subsystem.sh@57 -- # kill -0 2387285 00:14:56.585 15:58:46 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:57.154 15:58:46 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:57.154 15:58:46 -- target/delete_subsystem.sh@57 -- # kill -0 2387285 00:14:57.154 15:58:46 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:57.722 15:58:47 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:57.722 15:58:47 -- target/delete_subsystem.sh@57 -- # kill -0 2387285 00:14:57.722 15:58:47 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:57.722 Initializing NVMe Controllers 00:14:57.722 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:57.722 Controller IO queue size 128, less than required. 00:14:57.722 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:57.722 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:57.722 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:57.722 Initialization complete. Launching workers. 00:14:57.722 ======================================================== 00:14:57.722 Latency(us) 00:14:57.722 Device Information : IOPS MiB/s Average min max 00:14:57.722 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003426.80 1000159.95 1010634.55 00:14:57.722 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1005191.53 1000169.39 1011241.97 00:14:57.722 ======================================================== 00:14:57.722 Total : 256.00 0.12 1004309.16 1000159.95 1011241.97 00:14:57.722 00:14:58.291 15:58:47 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:58.291 15:58:47 -- target/delete_subsystem.sh@57 -- # kill -0 2387285 00:14:58.291 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (2387285) - No such process 00:14:58.291 15:58:47 -- target/delete_subsystem.sh@67 -- # wait 2387285 00:14:58.291 15:58:47 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:58.291 15:58:47 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:58.291 15:58:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:58.291 15:58:47 -- nvmf/common.sh@116 -- # sync 00:14:58.291 15:58:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:58.291 15:58:47 -- nvmf/common.sh@119 -- # set +e 00:14:58.291 15:58:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:58.291 15:58:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:58.291 rmmod nvme_tcp 00:14:58.291 rmmod nvme_fabrics 00:14:58.291 rmmod nvme_keyring 00:14:58.291 15:58:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:58.291 15:58:48 -- nvmf/common.sh@123 -- # set -e 00:14:58.291 15:58:48 -- nvmf/common.sh@124 -- # return 0 00:14:58.291 15:58:48 -- nvmf/common.sh@477 -- # '[' -n 2386707 ']' 00:14:58.291 15:58:48 -- nvmf/common.sh@478 -- # killprocess 2386707 00:14:58.291 15:58:48 -- common/autotest_common.sh@926 -- # '[' -z 2386707 ']' 00:14:58.291 15:58:48 -- common/autotest_common.sh@930 -- # kill -0 2386707 00:14:58.291 15:58:48 -- common/autotest_common.sh@931 -- # uname 00:14:58.291 15:58:48 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:58.291 15:58:48 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2386707 00:14:58.291 15:58:48 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:58.291 15:58:48 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:58.291 15:58:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2386707' 00:14:58.291 killing process with pid 2386707 00:14:58.291 15:58:48 -- common/autotest_common.sh@945 -- # kill 2386707 00:14:58.291 15:58:48 -- common/autotest_common.sh@950 -- # wait 2386707 00:14:58.549 15:58:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:58.549 15:58:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:58.549 15:58:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:58.549 15:58:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:58.549 15:58:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:58.549 15:58:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:58.549 15:58:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:58.549 15:58:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:00.454 15:58:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:00.454 00:15:00.454 real 0m12.757s 00:15:00.454 user 0m29.060s 00:15:00.454 sys 0m2.804s 00:15:00.454 15:58:50 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:00.454 15:58:50 -- common/autotest_common.sh@10 -- # set +x 00:15:00.454 ************************************ 00:15:00.454 END TEST nvmf_delete_subsystem 00:15:00.454 ************************************ 00:15:00.713 15:58:50 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:00.713 15:58:50 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:00.713 15:58:50 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:00.713 15:58:50 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:00.713 15:58:50 -- common/autotest_common.sh@10 -- # set +x 00:15:00.713 ************************************ 00:15:00.713 START TEST nvmf_nvme_cli 00:15:00.713 ************************************ 00:15:00.713 15:58:50 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:00.713 * Looking for test storage... 00:15:00.713 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:00.713 15:58:50 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:00.713 15:58:50 -- nvmf/common.sh@7 -- # uname -s 00:15:00.713 15:58:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:00.713 15:58:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:00.713 15:58:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:00.713 15:58:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:00.713 15:58:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:00.713 15:58:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:00.713 15:58:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:00.713 15:58:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:00.713 15:58:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:00.713 15:58:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:00.713 15:58:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:00.713 15:58:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:00.713 15:58:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:00.713 15:58:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:00.713 15:58:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:00.713 15:58:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:00.713 15:58:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:00.713 15:58:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:00.713 15:58:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:00.713 15:58:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.713 15:58:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.713 15:58:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.713 15:58:50 -- paths/export.sh@5 -- # export PATH 00:15:00.713 15:58:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.713 15:58:50 -- nvmf/common.sh@46 -- # : 0 00:15:00.713 15:58:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:00.713 15:58:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:00.713 15:58:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:00.713 15:58:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:00.713 15:58:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:00.713 15:58:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:00.713 15:58:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:00.713 15:58:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:00.713 15:58:50 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:00.713 15:58:50 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:00.713 15:58:50 -- target/nvme_cli.sh@14 -- # devs=() 00:15:00.713 15:58:50 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:00.713 15:58:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:00.713 15:58:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:00.713 15:58:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:00.713 15:58:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:00.713 15:58:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:00.713 15:58:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:00.713 15:58:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:00.713 15:58:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:00.713 15:58:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:00.713 15:58:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:00.713 15:58:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:00.713 15:58:50 -- common/autotest_common.sh@10 -- # set +x 00:15:02.618 15:58:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:02.618 15:58:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:02.618 15:58:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:02.618 15:58:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:02.618 15:58:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:02.618 15:58:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:02.618 15:58:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:02.618 15:58:52 -- nvmf/common.sh@294 -- # net_devs=() 00:15:02.618 15:58:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:02.618 15:58:52 -- nvmf/common.sh@295 -- # e810=() 00:15:02.618 15:58:52 -- nvmf/common.sh@295 -- # local -ga e810 00:15:02.618 15:58:52 -- nvmf/common.sh@296 -- # x722=() 00:15:02.618 15:58:52 -- nvmf/common.sh@296 -- # local -ga x722 00:15:02.618 15:58:52 -- nvmf/common.sh@297 -- # mlx=() 00:15:02.618 15:58:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:02.618 15:58:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:02.618 15:58:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:02.618 15:58:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:02.618 15:58:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:02.618 15:58:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:02.618 15:58:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:02.618 15:58:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:02.618 15:58:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:02.618 15:58:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:02.618 15:58:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:02.618 15:58:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:02.618 15:58:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:02.618 15:58:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:02.618 15:58:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:02.618 15:58:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:02.618 15:58:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:02.618 15:58:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:02.618 15:58:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:02.618 15:58:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:02.618 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:02.618 15:58:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:02.618 15:58:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:02.618 15:58:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:02.618 15:58:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:02.618 15:58:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:02.618 15:58:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:02.618 15:58:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:02.618 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:02.618 15:58:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:02.878 15:58:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:02.878 15:58:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:02.878 15:58:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:02.878 15:58:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:02.878 15:58:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:02.878 15:58:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:02.878 15:58:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:02.878 15:58:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:02.878 15:58:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:02.878 15:58:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:02.878 15:58:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:02.878 15:58:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:02.878 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:02.878 15:58:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:02.878 15:58:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:02.878 15:58:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:02.878 15:58:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:02.878 15:58:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:02.878 15:58:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:02.878 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:02.878 15:58:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:02.878 15:58:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:02.878 15:58:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:02.878 15:58:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:02.878 15:58:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:02.878 15:58:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:02.878 15:58:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:02.878 15:58:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:02.878 15:58:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:02.878 15:58:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:02.878 15:58:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:02.878 15:58:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:02.878 15:58:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:02.878 15:58:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:02.878 15:58:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:02.878 15:58:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:02.878 15:58:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:02.878 15:58:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:02.878 15:58:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:02.878 15:58:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:02.878 15:58:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:02.878 15:58:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:02.878 15:58:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:02.878 15:58:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:02.878 15:58:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:02.878 15:58:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:02.878 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:02.878 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.262 ms 00:15:02.878 00:15:02.878 --- 10.0.0.2 ping statistics --- 00:15:02.878 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:02.878 rtt min/avg/max/mdev = 0.262/0.262/0.262/0.000 ms 00:15:02.878 15:58:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:02.878 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:02.878 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.045 ms 00:15:02.878 00:15:02.878 --- 10.0.0.1 ping statistics --- 00:15:02.878 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:02.878 rtt min/avg/max/mdev = 0.045/0.045/0.045/0.000 ms 00:15:02.878 15:58:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:02.878 15:58:52 -- nvmf/common.sh@410 -- # return 0 00:15:02.878 15:58:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:02.878 15:58:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:02.878 15:58:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:02.878 15:58:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:02.878 15:58:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:02.878 15:58:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:02.878 15:58:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:02.878 15:58:52 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:02.878 15:58:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:02.878 15:58:52 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:02.878 15:58:52 -- common/autotest_common.sh@10 -- # set +x 00:15:02.878 15:58:52 -- nvmf/common.sh@469 -- # nvmfpid=2389642 00:15:02.878 15:58:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:02.878 15:58:52 -- nvmf/common.sh@470 -- # waitforlisten 2389642 00:15:02.878 15:58:52 -- common/autotest_common.sh@819 -- # '[' -z 2389642 ']' 00:15:02.878 15:58:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:02.878 15:58:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:02.878 15:58:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:02.878 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:02.878 15:58:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:02.878 15:58:52 -- common/autotest_common.sh@10 -- # set +x 00:15:02.878 [2024-10-30 15:58:52.702350] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:15:02.878 [2024-10-30 15:58:52.702424] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:02.878 EAL: No free 2048 kB hugepages reported on node 1 00:15:03.136 [2024-10-30 15:58:52.771830] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:03.136 [2024-10-30 15:58:52.862983] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:03.136 [2024-10-30 15:58:52.863135] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:03.136 [2024-10-30 15:58:52.863168] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:03.136 [2024-10-30 15:58:52.863181] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:03.136 [2024-10-30 15:58:52.865280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:03.136 [2024-10-30 15:58:52.865332] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:03.136 [2024-10-30 15:58:52.865427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:03.136 [2024-10-30 15:58:52.865431] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:04.075 15:58:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:04.075 15:58:53 -- common/autotest_common.sh@852 -- # return 0 00:15:04.075 15:58:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:04.075 15:58:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:04.075 15:58:53 -- common/autotest_common.sh@10 -- # set +x 00:15:04.075 15:58:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:04.075 15:58:53 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:04.075 15:58:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:04.075 15:58:53 -- common/autotest_common.sh@10 -- # set +x 00:15:04.075 [2024-10-30 15:58:53.701931] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:04.075 15:58:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:04.075 15:58:53 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:04.075 15:58:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:04.075 15:58:53 -- common/autotest_common.sh@10 -- # set +x 00:15:04.075 Malloc0 00:15:04.075 15:58:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:04.075 15:58:53 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:04.075 15:58:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:04.075 15:58:53 -- common/autotest_common.sh@10 -- # set +x 00:15:04.075 Malloc1 00:15:04.075 15:58:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:04.075 15:58:53 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:04.075 15:58:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:04.075 15:58:53 -- common/autotest_common.sh@10 -- # set +x 00:15:04.075 15:58:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:04.075 15:58:53 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:04.075 15:58:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:04.075 15:58:53 -- common/autotest_common.sh@10 -- # set +x 00:15:04.075 15:58:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:04.075 15:58:53 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:04.075 15:58:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:04.075 15:58:53 -- common/autotest_common.sh@10 -- # set +x 00:15:04.075 15:58:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:04.075 15:58:53 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:04.075 15:58:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:04.075 15:58:53 -- common/autotest_common.sh@10 -- # set +x 00:15:04.075 [2024-10-30 15:58:53.788699] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:04.075 15:58:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:04.075 15:58:53 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:04.075 15:58:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:04.075 15:58:53 -- common/autotest_common.sh@10 -- # set +x 00:15:04.075 15:58:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:04.075 15:58:53 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:04.334 00:15:04.334 Discovery Log Number of Records 2, Generation counter 2 00:15:04.334 =====Discovery Log Entry 0====== 00:15:04.334 trtype: tcp 00:15:04.334 adrfam: ipv4 00:15:04.334 subtype: current discovery subsystem 00:15:04.334 treq: not required 00:15:04.334 portid: 0 00:15:04.334 trsvcid: 4420 00:15:04.334 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:04.334 traddr: 10.0.0.2 00:15:04.334 eflags: explicit discovery connections, duplicate discovery information 00:15:04.334 sectype: none 00:15:04.334 =====Discovery Log Entry 1====== 00:15:04.334 trtype: tcp 00:15:04.334 adrfam: ipv4 00:15:04.334 subtype: nvme subsystem 00:15:04.334 treq: not required 00:15:04.334 portid: 0 00:15:04.334 trsvcid: 4420 00:15:04.334 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:04.334 traddr: 10.0.0.2 00:15:04.334 eflags: none 00:15:04.334 sectype: none 00:15:04.334 15:58:53 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:04.334 15:58:53 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:04.334 15:58:53 -- nvmf/common.sh@510 -- # local dev _ 00:15:04.334 15:58:53 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:04.334 15:58:53 -- nvmf/common.sh@509 -- # nvme list 00:15:04.334 15:58:53 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:04.334 15:58:53 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:04.334 15:58:53 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:04.334 15:58:53 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:04.334 15:58:53 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:04.334 15:58:53 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:04.901 15:58:54 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:04.901 15:58:54 -- common/autotest_common.sh@1177 -- # local i=0 00:15:04.901 15:58:54 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:15:04.901 15:58:54 -- common/autotest_common.sh@1179 -- # [[ -n 2 ]] 00:15:04.901 15:58:54 -- common/autotest_common.sh@1180 -- # nvme_device_counter=2 00:15:04.901 15:58:54 -- common/autotest_common.sh@1184 -- # sleep 2 00:15:06.807 15:58:56 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:15:06.807 15:58:56 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:15:06.807 15:58:56 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:15:06.807 15:58:56 -- common/autotest_common.sh@1186 -- # nvme_devices=2 00:15:06.807 15:58:56 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:15:06.807 15:58:56 -- common/autotest_common.sh@1187 -- # return 0 00:15:06.807 15:58:56 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:06.807 15:58:56 -- nvmf/common.sh@510 -- # local dev _ 00:15:06.807 15:58:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:06.807 15:58:56 -- nvmf/common.sh@509 -- # nvme list 00:15:06.807 15:58:56 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:06.807 15:58:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:06.807 15:58:56 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:06.807 15:58:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:06.807 15:58:56 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:06.807 15:58:56 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:06.807 15:58:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:06.807 15:58:56 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:06.807 15:58:56 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:06.807 15:58:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:06.807 15:58:56 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:06.807 /dev/nvme0n2 ]] 00:15:06.807 15:58:56 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:06.807 15:58:56 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:06.807 15:58:56 -- nvmf/common.sh@510 -- # local dev _ 00:15:06.807 15:58:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:06.807 15:58:56 -- nvmf/common.sh@509 -- # nvme list 00:15:06.807 15:58:56 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:06.807 15:58:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:06.807 15:58:56 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:06.807 15:58:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:06.807 15:58:56 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:06.807 15:58:56 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:06.807 15:58:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:06.807 15:58:56 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:06.807 15:58:56 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:06.807 15:58:56 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:06.807 15:58:56 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:06.807 15:58:56 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:06.807 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:06.807 15:58:56 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:06.807 15:58:56 -- common/autotest_common.sh@1198 -- # local i=0 00:15:06.807 15:58:56 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:15:06.807 15:58:56 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:07.067 15:58:56 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:15:07.067 15:58:56 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:07.067 15:58:56 -- common/autotest_common.sh@1210 -- # return 0 00:15:07.067 15:58:56 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:07.067 15:58:56 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:07.067 15:58:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:07.067 15:58:56 -- common/autotest_common.sh@10 -- # set +x 00:15:07.067 15:58:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:07.067 15:58:56 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:07.067 15:58:56 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:07.067 15:58:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:07.067 15:58:56 -- nvmf/common.sh@116 -- # sync 00:15:07.067 15:58:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:07.067 15:58:56 -- nvmf/common.sh@119 -- # set +e 00:15:07.067 15:58:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:07.067 15:58:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:07.067 rmmod nvme_tcp 00:15:07.067 rmmod nvme_fabrics 00:15:07.067 rmmod nvme_keyring 00:15:07.067 15:58:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:07.067 15:58:56 -- nvmf/common.sh@123 -- # set -e 00:15:07.067 15:58:56 -- nvmf/common.sh@124 -- # return 0 00:15:07.067 15:58:56 -- nvmf/common.sh@477 -- # '[' -n 2389642 ']' 00:15:07.067 15:58:56 -- nvmf/common.sh@478 -- # killprocess 2389642 00:15:07.067 15:58:56 -- common/autotest_common.sh@926 -- # '[' -z 2389642 ']' 00:15:07.067 15:58:56 -- common/autotest_common.sh@930 -- # kill -0 2389642 00:15:07.067 15:58:56 -- common/autotest_common.sh@931 -- # uname 00:15:07.067 15:58:56 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:07.067 15:58:56 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2389642 00:15:07.067 15:58:56 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:07.067 15:58:56 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:07.067 15:58:56 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2389642' 00:15:07.067 killing process with pid 2389642 00:15:07.067 15:58:56 -- common/autotest_common.sh@945 -- # kill 2389642 00:15:07.067 15:58:56 -- common/autotest_common.sh@950 -- # wait 2389642 00:15:07.326 15:58:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:07.326 15:58:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:07.326 15:58:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:07.326 15:58:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:07.326 15:58:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:07.326 15:58:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:07.326 15:58:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:07.326 15:58:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:09.865 15:58:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:09.865 00:15:09.865 real 0m8.765s 00:15:09.865 user 0m17.487s 00:15:09.865 sys 0m2.306s 00:15:09.865 15:58:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:09.865 15:58:59 -- common/autotest_common.sh@10 -- # set +x 00:15:09.865 ************************************ 00:15:09.865 END TEST nvmf_nvme_cli 00:15:09.865 ************************************ 00:15:09.865 15:58:59 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:09.865 15:58:59 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:09.865 15:58:59 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:09.865 15:58:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:09.865 15:58:59 -- common/autotest_common.sh@10 -- # set +x 00:15:09.865 ************************************ 00:15:09.865 START TEST nvmf_vfio_user 00:15:09.865 ************************************ 00:15:09.865 15:58:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:09.865 * Looking for test storage... 00:15:09.865 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:09.865 15:58:59 -- nvmf/common.sh@7 -- # uname -s 00:15:09.865 15:58:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:09.865 15:58:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:09.865 15:58:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:09.865 15:58:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:09.865 15:58:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:09.865 15:58:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:09.865 15:58:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:09.865 15:58:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:09.865 15:58:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:09.865 15:58:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:09.865 15:58:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:09.865 15:58:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:09.865 15:58:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:09.865 15:58:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:09.865 15:58:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:09.865 15:58:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:09.865 15:58:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:09.865 15:58:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:09.865 15:58:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:09.865 15:58:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:09.865 15:58:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:09.865 15:58:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:09.865 15:58:59 -- paths/export.sh@5 -- # export PATH 00:15:09.865 15:58:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:09.865 15:58:59 -- nvmf/common.sh@46 -- # : 0 00:15:09.865 15:58:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:09.865 15:58:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:09.865 15:58:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:09.865 15:58:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:09.865 15:58:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:09.865 15:58:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:09.865 15:58:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:09.865 15:58:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2390590 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2390590' 00:15:09.865 Process pid: 2390590 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:09.865 15:58:59 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2390590 00:15:09.865 15:58:59 -- common/autotest_common.sh@819 -- # '[' -z 2390590 ']' 00:15:09.865 15:58:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:09.865 15:58:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:09.865 15:58:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:09.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:09.865 15:58:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:09.865 15:58:59 -- common/autotest_common.sh@10 -- # set +x 00:15:09.865 [2024-10-30 15:58:59.271232] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:15:09.865 [2024-10-30 15:58:59.271330] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:09.865 EAL: No free 2048 kB hugepages reported on node 1 00:15:09.865 [2024-10-30 15:58:59.330037] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:09.865 [2024-10-30 15:58:59.415023] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:09.865 [2024-10-30 15:58:59.415175] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:09.865 [2024-10-30 15:58:59.415206] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:09.865 [2024-10-30 15:58:59.415219] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:09.865 [2024-10-30 15:58:59.415290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:09.865 [2024-10-30 15:58:59.415320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:09.865 [2024-10-30 15:58:59.415372] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:09.865 [2024-10-30 15:58:59.415375] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:10.430 15:59:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:10.430 15:59:00 -- common/autotest_common.sh@852 -- # return 0 00:15:10.430 15:59:00 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:11.802 15:59:01 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:11.802 15:59:01 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:11.802 15:59:01 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:11.802 15:59:01 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:11.802 15:59:01 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:11.802 15:59:01 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:12.060 Malloc1 00:15:12.060 15:59:01 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:12.318 15:59:02 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:12.576 15:59:02 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:12.834 15:59:02 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:12.834 15:59:02 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:12.834 15:59:02 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:13.093 Malloc2 00:15:13.093 15:59:02 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:13.350 15:59:03 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:13.608 15:59:03 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:13.867 15:59:03 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:13.867 15:59:03 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:13.867 15:59:03 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:13.867 15:59:03 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:13.867 15:59:03 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:13.867 15:59:03 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:13.867 [2024-10-30 15:59:03.580693] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:15:13.867 [2024-10-30 15:59:03.580734] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2391154 ] 00:15:13.867 EAL: No free 2048 kB hugepages reported on node 1 00:15:13.867 [2024-10-30 15:59:03.613560] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:13.867 [2024-10-30 15:59:03.622657] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:13.867 [2024-10-30 15:59:03.622686] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f08f0241000 00:15:13.867 [2024-10-30 15:59:03.623648] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:13.867 [2024-10-30 15:59:03.624643] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:13.867 [2024-10-30 15:59:03.625661] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:13.867 [2024-10-30 15:59:03.626665] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:13.867 [2024-10-30 15:59:03.627668] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:13.867 [2024-10-30 15:59:03.628676] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:13.867 [2024-10-30 15:59:03.629686] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:13.867 [2024-10-30 15:59:03.630689] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:13.867 [2024-10-30 15:59:03.631700] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:13.867 [2024-10-30 15:59:03.631720] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f08eef39000 00:15:13.867 [2024-10-30 15:59:03.632839] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:13.867 [2024-10-30 15:59:03.647903] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:13.867 [2024-10-30 15:59:03.647951] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:13.867 [2024-10-30 15:59:03.652848] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:13.867 [2024-10-30 15:59:03.652901] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:13.867 [2024-10-30 15:59:03.652997] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:13.867 [2024-10-30 15:59:03.653034] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:13.867 [2024-10-30 15:59:03.653045] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:13.867 [2024-10-30 15:59:03.653848] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:13.867 [2024-10-30 15:59:03.653868] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:13.867 [2024-10-30 15:59:03.653880] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:13.867 [2024-10-30 15:59:03.654849] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:13.867 [2024-10-30 15:59:03.654866] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:13.867 [2024-10-30 15:59:03.654880] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:13.867 [2024-10-30 15:59:03.655856] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:13.867 [2024-10-30 15:59:03.655873] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:13.867 [2024-10-30 15:59:03.656864] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:13.867 [2024-10-30 15:59:03.656882] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:13.867 [2024-10-30 15:59:03.656891] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:13.867 [2024-10-30 15:59:03.656903] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:13.867 [2024-10-30 15:59:03.657012] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:13.867 [2024-10-30 15:59:03.657019] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:13.867 [2024-10-30 15:59:03.657028] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:13.867 [2024-10-30 15:59:03.658265] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:13.868 [2024-10-30 15:59:03.658878] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:13.868 [2024-10-30 15:59:03.659885] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:13.868 [2024-10-30 15:59:03.660927] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:13.868 [2024-10-30 15:59:03.661899] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:13.868 [2024-10-30 15:59:03.661917] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:13.868 [2024-10-30 15:59:03.661925] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.661949] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:13.868 [2024-10-30 15:59:03.661968] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.661995] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:13.868 [2024-10-30 15:59:03.662005] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:13.868 [2024-10-30 15:59:03.662028] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:13.868 [2024-10-30 15:59:03.662079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:13.868 [2024-10-30 15:59:03.662096] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:13.868 [2024-10-30 15:59:03.662105] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:13.868 [2024-10-30 15:59:03.662112] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:13.868 [2024-10-30 15:59:03.662119] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:13.868 [2024-10-30 15:59:03.662128] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:13.868 [2024-10-30 15:59:03.662134] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:13.868 [2024-10-30 15:59:03.662142] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662159] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662175] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:13.868 [2024-10-30 15:59:03.662191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:13.868 [2024-10-30 15:59:03.662212] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:13.868 [2024-10-30 15:59:03.662225] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:13.868 [2024-10-30 15:59:03.662251] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:13.868 [2024-10-30 15:59:03.662272] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:13.868 [2024-10-30 15:59:03.662281] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662297] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662315] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:13.868 [2024-10-30 15:59:03.662330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:13.868 [2024-10-30 15:59:03.662342] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:13.868 [2024-10-30 15:59:03.662350] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662360] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662374] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662388] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:13.868 [2024-10-30 15:59:03.662400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:13.868 [2024-10-30 15:59:03.662462] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662476] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662489] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:13.868 [2024-10-30 15:59:03.662497] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:13.868 [2024-10-30 15:59:03.662506] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:13.868 [2024-10-30 15:59:03.662524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:13.868 [2024-10-30 15:59:03.662562] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:13.868 [2024-10-30 15:59:03.662580] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662596] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662607] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:13.868 [2024-10-30 15:59:03.662614] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:13.868 [2024-10-30 15:59:03.662624] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:13.868 [2024-10-30 15:59:03.662643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:13.868 [2024-10-30 15:59:03.662666] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662680] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662691] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:13.868 [2024-10-30 15:59:03.662698] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:13.868 [2024-10-30 15:59:03.662707] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:13.868 [2024-10-30 15:59:03.662724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:13.868 [2024-10-30 15:59:03.662739] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662749] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662763] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662774] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662782] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662790] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:13.868 [2024-10-30 15:59:03.662798] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:13.868 [2024-10-30 15:59:03.662806] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:13.868 [2024-10-30 15:59:03.662834] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:13.868 [2024-10-30 15:59:03.662852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:13.868 [2024-10-30 15:59:03.662871] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:13.868 [2024-10-30 15:59:03.662882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:13.868 [2024-10-30 15:59:03.662897] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:13.868 [2024-10-30 15:59:03.662907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:13.868 [2024-10-30 15:59:03.662922] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:13.868 [2024-10-30 15:59:03.662932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:13.868 [2024-10-30 15:59:03.662950] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:13.868 [2024-10-30 15:59:03.662959] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:13.868 [2024-10-30 15:59:03.662964] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:13.868 [2024-10-30 15:59:03.662970] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:13.868 [2024-10-30 15:59:03.662979] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:13.868 [2024-10-30 15:59:03.662990] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:13.868 [2024-10-30 15:59:03.662997] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:13.868 [2024-10-30 15:59:03.663006] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:13.868 [2024-10-30 15:59:03.663016] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:13.868 [2024-10-30 15:59:03.663027] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:13.868 [2024-10-30 15:59:03.663036] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:13.868 [2024-10-30 15:59:03.663047] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:13.868 [2024-10-30 15:59:03.663055] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:13.868 [2024-10-30 15:59:03.663063] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:13.868 [2024-10-30 15:59:03.663074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:13.869 [2024-10-30 15:59:03.663106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:13.869 [2024-10-30 15:59:03.663121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:13.869 [2024-10-30 15:59:03.663133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:13.869 ===================================================== 00:15:13.869 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:13.869 ===================================================== 00:15:13.869 Controller Capabilities/Features 00:15:13.869 ================================ 00:15:13.869 Vendor ID: 4e58 00:15:13.869 Subsystem Vendor ID: 4e58 00:15:13.869 Serial Number: SPDK1 00:15:13.869 Model Number: SPDK bdev Controller 00:15:13.869 Firmware Version: 24.01.1 00:15:13.869 Recommended Arb Burst: 6 00:15:13.869 IEEE OUI Identifier: 8d 6b 50 00:15:13.869 Multi-path I/O 00:15:13.869 May have multiple subsystem ports: Yes 00:15:13.869 May have multiple controllers: Yes 00:15:13.869 Associated with SR-IOV VF: No 00:15:13.869 Max Data Transfer Size: 131072 00:15:13.869 Max Number of Namespaces: 32 00:15:13.869 Max Number of I/O Queues: 127 00:15:13.869 NVMe Specification Version (VS): 1.3 00:15:13.869 NVMe Specification Version (Identify): 1.3 00:15:13.869 Maximum Queue Entries: 256 00:15:13.869 Contiguous Queues Required: Yes 00:15:13.869 Arbitration Mechanisms Supported 00:15:13.869 Weighted Round Robin: Not Supported 00:15:13.869 Vendor Specific: Not Supported 00:15:13.869 Reset Timeout: 15000 ms 00:15:13.869 Doorbell Stride: 4 bytes 00:15:13.869 NVM Subsystem Reset: Not Supported 00:15:13.869 Command Sets Supported 00:15:13.869 NVM Command Set: Supported 00:15:13.869 Boot Partition: Not Supported 00:15:13.869 Memory Page Size Minimum: 4096 bytes 00:15:13.869 Memory Page Size Maximum: 4096 bytes 00:15:13.869 Persistent Memory Region: Not Supported 00:15:13.869 Optional Asynchronous Events Supported 00:15:13.869 Namespace Attribute Notices: Supported 00:15:13.869 Firmware Activation Notices: Not Supported 00:15:13.869 ANA Change Notices: Not Supported 00:15:13.869 PLE Aggregate Log Change Notices: Not Supported 00:15:13.869 LBA Status Info Alert Notices: Not Supported 00:15:13.869 EGE Aggregate Log Change Notices: Not Supported 00:15:13.869 Normal NVM Subsystem Shutdown event: Not Supported 00:15:13.869 Zone Descriptor Change Notices: Not Supported 00:15:13.869 Discovery Log Change Notices: Not Supported 00:15:13.869 Controller Attributes 00:15:13.869 128-bit Host Identifier: Supported 00:15:13.869 Non-Operational Permissive Mode: Not Supported 00:15:13.869 NVM Sets: Not Supported 00:15:13.869 Read Recovery Levels: Not Supported 00:15:13.869 Endurance Groups: Not Supported 00:15:13.869 Predictable Latency Mode: Not Supported 00:15:13.869 Traffic Based Keep ALive: Not Supported 00:15:13.869 Namespace Granularity: Not Supported 00:15:13.869 SQ Associations: Not Supported 00:15:13.869 UUID List: Not Supported 00:15:13.869 Multi-Domain Subsystem: Not Supported 00:15:13.869 Fixed Capacity Management: Not Supported 00:15:13.869 Variable Capacity Management: Not Supported 00:15:13.869 Delete Endurance Group: Not Supported 00:15:13.869 Delete NVM Set: Not Supported 00:15:13.869 Extended LBA Formats Supported: Not Supported 00:15:13.869 Flexible Data Placement Supported: Not Supported 00:15:13.869 00:15:13.869 Controller Memory Buffer Support 00:15:13.869 ================================ 00:15:13.869 Supported: No 00:15:13.869 00:15:13.869 Persistent Memory Region Support 00:15:13.869 ================================ 00:15:13.869 Supported: No 00:15:13.869 00:15:13.869 Admin Command Set Attributes 00:15:13.869 ============================ 00:15:13.869 Security Send/Receive: Not Supported 00:15:13.869 Format NVM: Not Supported 00:15:13.869 Firmware Activate/Download: Not Supported 00:15:13.869 Namespace Management: Not Supported 00:15:13.869 Device Self-Test: Not Supported 00:15:13.869 Directives: Not Supported 00:15:13.869 NVMe-MI: Not Supported 00:15:13.869 Virtualization Management: Not Supported 00:15:13.869 Doorbell Buffer Config: Not Supported 00:15:13.869 Get LBA Status Capability: Not Supported 00:15:13.869 Command & Feature Lockdown Capability: Not Supported 00:15:13.869 Abort Command Limit: 4 00:15:13.869 Async Event Request Limit: 4 00:15:13.869 Number of Firmware Slots: N/A 00:15:13.869 Firmware Slot 1 Read-Only: N/A 00:15:13.869 Firmware Activation Without Reset: N/A 00:15:13.869 Multiple Update Detection Support: N/A 00:15:13.869 Firmware Update Granularity: No Information Provided 00:15:13.869 Per-Namespace SMART Log: No 00:15:13.869 Asymmetric Namespace Access Log Page: Not Supported 00:15:13.869 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:13.869 Command Effects Log Page: Supported 00:15:13.869 Get Log Page Extended Data: Supported 00:15:13.869 Telemetry Log Pages: Not Supported 00:15:13.869 Persistent Event Log Pages: Not Supported 00:15:13.869 Supported Log Pages Log Page: May Support 00:15:13.869 Commands Supported & Effects Log Page: Not Supported 00:15:13.869 Feature Identifiers & Effects Log Page:May Support 00:15:13.869 NVMe-MI Commands & Effects Log Page: May Support 00:15:13.869 Data Area 4 for Telemetry Log: Not Supported 00:15:13.869 Error Log Page Entries Supported: 128 00:15:13.869 Keep Alive: Supported 00:15:13.869 Keep Alive Granularity: 10000 ms 00:15:13.869 00:15:13.869 NVM Command Set Attributes 00:15:13.869 ========================== 00:15:13.869 Submission Queue Entry Size 00:15:13.869 Max: 64 00:15:13.869 Min: 64 00:15:13.869 Completion Queue Entry Size 00:15:13.869 Max: 16 00:15:13.869 Min: 16 00:15:13.869 Number of Namespaces: 32 00:15:13.869 Compare Command: Supported 00:15:13.869 Write Uncorrectable Command: Not Supported 00:15:13.869 Dataset Management Command: Supported 00:15:13.869 Write Zeroes Command: Supported 00:15:13.869 Set Features Save Field: Not Supported 00:15:13.869 Reservations: Not Supported 00:15:13.869 Timestamp: Not Supported 00:15:13.869 Copy: Supported 00:15:13.869 Volatile Write Cache: Present 00:15:13.869 Atomic Write Unit (Normal): 1 00:15:13.869 Atomic Write Unit (PFail): 1 00:15:13.869 Atomic Compare & Write Unit: 1 00:15:13.869 Fused Compare & Write: Supported 00:15:13.869 Scatter-Gather List 00:15:13.869 SGL Command Set: Supported (Dword aligned) 00:15:13.869 SGL Keyed: Not Supported 00:15:13.869 SGL Bit Bucket Descriptor: Not Supported 00:15:13.869 SGL Metadata Pointer: Not Supported 00:15:13.869 Oversized SGL: Not Supported 00:15:13.869 SGL Metadata Address: Not Supported 00:15:13.869 SGL Offset: Not Supported 00:15:13.869 Transport SGL Data Block: Not Supported 00:15:13.869 Replay Protected Memory Block: Not Supported 00:15:13.869 00:15:13.869 Firmware Slot Information 00:15:13.869 ========================= 00:15:13.869 Active slot: 1 00:15:13.869 Slot 1 Firmware Revision: 24.01.1 00:15:13.869 00:15:13.869 00:15:13.869 Commands Supported and Effects 00:15:13.869 ============================== 00:15:13.869 Admin Commands 00:15:13.869 -------------- 00:15:13.869 Get Log Page (02h): Supported 00:15:13.869 Identify (06h): Supported 00:15:13.869 Abort (08h): Supported 00:15:13.869 Set Features (09h): Supported 00:15:13.869 Get Features (0Ah): Supported 00:15:13.869 Asynchronous Event Request (0Ch): Supported 00:15:13.869 Keep Alive (18h): Supported 00:15:13.869 I/O Commands 00:15:13.869 ------------ 00:15:13.869 Flush (00h): Supported LBA-Change 00:15:13.869 Write (01h): Supported LBA-Change 00:15:13.869 Read (02h): Supported 00:15:13.869 Compare (05h): Supported 00:15:13.869 Write Zeroes (08h): Supported LBA-Change 00:15:13.869 Dataset Management (09h): Supported LBA-Change 00:15:13.869 Copy (19h): Supported LBA-Change 00:15:13.869 Unknown (79h): Supported LBA-Change 00:15:13.869 Unknown (7Ah): Supported 00:15:13.869 00:15:13.869 Error Log 00:15:13.869 ========= 00:15:13.869 00:15:13.869 Arbitration 00:15:13.869 =========== 00:15:13.869 Arbitration Burst: 1 00:15:13.869 00:15:13.869 Power Management 00:15:13.869 ================ 00:15:13.869 Number of Power States: 1 00:15:13.869 Current Power State: Power State #0 00:15:13.869 Power State #0: 00:15:13.869 Max Power: 0.00 W 00:15:13.869 Non-Operational State: Operational 00:15:13.869 Entry Latency: Not Reported 00:15:13.869 Exit Latency: Not Reported 00:15:13.869 Relative Read Throughput: 0 00:15:13.869 Relative Read Latency: 0 00:15:13.869 Relative Write Throughput: 0 00:15:13.869 Relative Write Latency: 0 00:15:13.869 Idle Power: Not Reported 00:15:13.869 Active Power: Not Reported 00:15:13.869 Non-Operational Permissive Mode: Not Supported 00:15:13.869 00:15:13.869 Health Information 00:15:13.869 ================== 00:15:13.869 Critical Warnings: 00:15:13.869 Available Spare Space: OK 00:15:13.869 Temperature: OK 00:15:13.869 Device Reliability: OK 00:15:13.869 Read Only: No 00:15:13.869 Volatile Memory Backup: OK 00:15:13.869 Current Temperature: 0 Kelvin[2024-10-30 15:59:03.663292] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:13.869 [2024-10-30 15:59:03.663309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:13.869 [2024-10-30 15:59:03.663352] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:13.869 [2024-10-30 15:59:03.663370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:13.870 [2024-10-30 15:59:03.663381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:13.870 [2024-10-30 15:59:03.663390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:13.870 [2024-10-30 15:59:03.663400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:13.870 [2024-10-30 15:59:03.667268] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:13.870 [2024-10-30 15:59:03.667292] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:13.870 [2024-10-30 15:59:03.667985] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:13.870 [2024-10-30 15:59:03.667998] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:13.870 [2024-10-30 15:59:03.668952] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:13.870 [2024-10-30 15:59:03.668975] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:13.870 [2024-10-30 15:59:03.669029] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:13.870 [2024-10-30 15:59:03.670997] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:13.870 (-273 Celsius) 00:15:13.870 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:13.870 Available Spare: 0% 00:15:13.870 Available Spare Threshold: 0% 00:15:13.870 Life Percentage Used: 0% 00:15:13.870 Data Units Read: 0 00:15:13.870 Data Units Written: 0 00:15:13.870 Host Read Commands: 0 00:15:13.870 Host Write Commands: 0 00:15:13.870 Controller Busy Time: 0 minutes 00:15:13.870 Power Cycles: 0 00:15:13.870 Power On Hours: 0 hours 00:15:13.870 Unsafe Shutdowns: 0 00:15:13.870 Unrecoverable Media Errors: 0 00:15:13.870 Lifetime Error Log Entries: 0 00:15:13.870 Warning Temperature Time: 0 minutes 00:15:13.870 Critical Temperature Time: 0 minutes 00:15:13.870 00:15:13.870 Number of Queues 00:15:13.870 ================ 00:15:13.870 Number of I/O Submission Queues: 127 00:15:13.870 Number of I/O Completion Queues: 127 00:15:13.870 00:15:13.870 Active Namespaces 00:15:13.870 ================= 00:15:13.870 Namespace ID:1 00:15:13.870 Error Recovery Timeout: Unlimited 00:15:13.870 Command Set Identifier: NVM (00h) 00:15:13.870 Deallocate: Supported 00:15:13.870 Deallocated/Unwritten Error: Not Supported 00:15:13.870 Deallocated Read Value: Unknown 00:15:13.870 Deallocate in Write Zeroes: Not Supported 00:15:13.870 Deallocated Guard Field: 0xFFFF 00:15:13.870 Flush: Supported 00:15:13.870 Reservation: Supported 00:15:13.870 Namespace Sharing Capabilities: Multiple Controllers 00:15:13.870 Size (in LBAs): 131072 (0GiB) 00:15:13.870 Capacity (in LBAs): 131072 (0GiB) 00:15:13.870 Utilization (in LBAs): 131072 (0GiB) 00:15:13.870 NGUID: 7B9B13A0299845CB97B9E38761ACE33B 00:15:13.870 UUID: 7b9b13a0-2998-45cb-97b9-e38761ace33b 00:15:13.870 Thin Provisioning: Not Supported 00:15:13.870 Per-NS Atomic Units: Yes 00:15:13.870 Atomic Boundary Size (Normal): 0 00:15:13.870 Atomic Boundary Size (PFail): 0 00:15:13.870 Atomic Boundary Offset: 0 00:15:13.870 Maximum Single Source Range Length: 65535 00:15:13.870 Maximum Copy Length: 65535 00:15:13.870 Maximum Source Range Count: 1 00:15:13.870 NGUID/EUI64 Never Reused: No 00:15:13.870 Namespace Write Protected: No 00:15:13.870 Number of LBA Formats: 1 00:15:13.870 Current LBA Format: LBA Format #00 00:15:13.870 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:13.870 00:15:13.870 15:59:03 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:14.127 EAL: No free 2048 kB hugepages reported on node 1 00:15:19.467 Initializing NVMe Controllers 00:15:19.467 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:19.467 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:19.467 Initialization complete. Launching workers. 00:15:19.467 ======================================================== 00:15:19.467 Latency(us) 00:15:19.467 Device Information : IOPS MiB/s Average min max 00:15:19.467 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 36579.40 142.89 3499.04 1162.56 8774.12 00:15:19.467 ======================================================== 00:15:19.467 Total : 36579.40 142.89 3499.04 1162.56 8774.12 00:15:19.467 00:15:19.467 15:59:08 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:19.467 EAL: No free 2048 kB hugepages reported on node 1 00:15:24.729 Initializing NVMe Controllers 00:15:24.729 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:24.729 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:24.729 Initialization complete. Launching workers. 00:15:24.729 ======================================================== 00:15:24.729 Latency(us) 00:15:24.729 Device Information : IOPS MiB/s Average min max 00:15:24.729 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16051.17 62.70 7981.18 5963.38 10975.84 00:15:24.729 ======================================================== 00:15:24.729 Total : 16051.17 62.70 7981.18 5963.38 10975.84 00:15:24.729 00:15:24.729 15:59:14 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:24.729 EAL: No free 2048 kB hugepages reported on node 1 00:15:30.046 Initializing NVMe Controllers 00:15:30.046 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:30.046 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:30.046 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:30.046 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:30.046 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:30.046 Initialization complete. Launching workers. 00:15:30.046 Starting thread on core 2 00:15:30.046 Starting thread on core 3 00:15:30.046 Starting thread on core 1 00:15:30.046 15:59:19 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:30.046 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.329 Initializing NVMe Controllers 00:15:33.329 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:33.329 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:33.329 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:33.329 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:33.329 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:33.329 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:33.329 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:33.329 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:33.329 Initialization complete. Launching workers. 00:15:33.329 Starting thread on core 1 with urgent priority queue 00:15:33.329 Starting thread on core 2 with urgent priority queue 00:15:33.329 Starting thread on core 3 with urgent priority queue 00:15:33.329 Starting thread on core 0 with urgent priority queue 00:15:33.329 SPDK bdev Controller (SPDK1 ) core 0: 4967.33 IO/s 20.13 secs/100000 ios 00:15:33.329 SPDK bdev Controller (SPDK1 ) core 1: 4962.33 IO/s 20.15 secs/100000 ios 00:15:33.329 SPDK bdev Controller (SPDK1 ) core 2: 5054.00 IO/s 19.79 secs/100000 ios 00:15:33.329 SPDK bdev Controller (SPDK1 ) core 3: 4908.67 IO/s 20.37 secs/100000 ios 00:15:33.329 ======================================================== 00:15:33.329 00:15:33.329 15:59:22 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:33.329 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.587 Initializing NVMe Controllers 00:15:33.587 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:33.587 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:33.587 Namespace ID: 1 size: 0GB 00:15:33.587 Initialization complete. 00:15:33.587 INFO: using host memory buffer for IO 00:15:33.587 Hello world! 00:15:33.587 15:59:23 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:33.587 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.960 Initializing NVMe Controllers 00:15:34.961 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:34.961 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:34.961 Initialization complete. Launching workers. 00:15:34.961 submit (in ns) avg, min, max = 7956.3, 3451.1, 4004994.4 00:15:34.961 complete (in ns) avg, min, max = 24539.6, 2031.1, 4017488.9 00:15:34.961 00:15:34.961 Submit histogram 00:15:34.961 ================ 00:15:34.961 Range in us Cumulative Count 00:15:34.961 3.437 - 3.461: 0.1671% ( 23) 00:15:34.961 3.461 - 3.484: 1.1404% ( 134) 00:15:34.961 3.484 - 3.508: 3.2977% ( 297) 00:15:34.961 3.508 - 3.532: 8.1136% ( 663) 00:15:34.961 3.532 - 3.556: 16.9608% ( 1218) 00:15:34.961 3.556 - 3.579: 26.6725% ( 1337) 00:15:34.961 3.579 - 3.603: 35.3163% ( 1190) 00:15:34.961 3.603 - 3.627: 42.9287% ( 1048) 00:15:34.961 3.627 - 3.650: 49.5170% ( 907) 00:15:34.961 3.650 - 3.674: 54.1948% ( 644) 00:15:34.961 3.674 - 3.698: 58.2407% ( 557) 00:15:34.961 3.698 - 3.721: 62.0978% ( 531) 00:15:34.961 3.721 - 3.745: 64.9234% ( 389) 00:15:34.961 3.745 - 3.769: 68.6642% ( 515) 00:15:34.961 3.769 - 3.793: 72.5576% ( 536) 00:15:34.961 3.793 - 3.816: 77.1337% ( 630) 00:15:34.961 3.816 - 3.840: 80.7511% ( 498) 00:15:34.961 3.840 - 3.864: 83.8527% ( 427) 00:15:34.961 3.864 - 3.887: 86.0827% ( 307) 00:15:34.961 3.887 - 3.911: 87.7751% ( 233) 00:15:34.961 3.911 - 3.935: 89.4312% ( 228) 00:15:34.961 3.935 - 3.959: 90.5208% ( 150) 00:15:34.961 3.959 - 3.982: 91.5305% ( 139) 00:15:34.961 3.982 - 4.006: 92.4312% ( 124) 00:15:34.961 4.006 - 4.030: 93.4190% ( 136) 00:15:34.961 4.030 - 4.053: 94.2326% ( 112) 00:15:34.961 4.053 - 4.077: 94.8791% ( 89) 00:15:34.961 4.077 - 4.101: 95.3221% ( 61) 00:15:34.961 4.101 - 4.124: 95.6418% ( 44) 00:15:34.961 4.124 - 4.148: 95.9105% ( 37) 00:15:34.961 4.148 - 4.172: 96.2156% ( 42) 00:15:34.961 4.172 - 4.196: 96.3536% ( 19) 00:15:34.961 4.196 - 4.219: 96.5642% ( 29) 00:15:34.961 4.219 - 4.243: 96.6659% ( 14) 00:15:34.961 4.243 - 4.267: 96.7604% ( 13) 00:15:34.961 4.267 - 4.290: 96.9129% ( 21) 00:15:34.961 4.290 - 4.314: 96.9855% ( 10) 00:15:34.961 4.314 - 4.338: 97.0291% ( 6) 00:15:34.961 4.338 - 4.361: 97.0727% ( 6) 00:15:34.961 4.361 - 4.385: 97.0945% ( 3) 00:15:34.961 4.385 - 4.409: 97.1453% ( 7) 00:15:34.961 4.409 - 4.433: 97.1744% ( 4) 00:15:34.961 4.433 - 4.456: 97.1889% ( 2) 00:15:34.961 4.456 - 4.480: 97.2107% ( 3) 00:15:34.961 4.480 - 4.504: 97.2398% ( 4) 00:15:34.961 4.504 - 4.527: 97.2470% ( 1) 00:15:34.961 4.527 - 4.551: 97.2979% ( 7) 00:15:34.961 4.551 - 4.575: 97.3197% ( 3) 00:15:34.961 4.575 - 4.599: 97.3633% ( 6) 00:15:34.961 4.599 - 4.622: 97.3923% ( 4) 00:15:34.961 4.622 - 4.646: 97.4432% ( 7) 00:15:34.961 4.646 - 4.670: 97.4940% ( 7) 00:15:34.961 4.670 - 4.693: 97.5521% ( 8) 00:15:34.961 4.693 - 4.717: 97.5812% ( 4) 00:15:34.961 4.717 - 4.741: 97.6175% ( 5) 00:15:34.961 4.741 - 4.764: 97.6829% ( 9) 00:15:34.961 4.764 - 4.788: 97.7192% ( 5) 00:15:34.961 4.788 - 4.812: 97.7773% ( 8) 00:15:34.961 4.812 - 4.836: 97.8136% ( 5) 00:15:34.961 4.836 - 4.859: 97.8717% ( 8) 00:15:34.961 4.859 - 4.883: 97.8935% ( 3) 00:15:34.961 4.883 - 4.907: 97.9298% ( 5) 00:15:34.961 4.907 - 4.930: 97.9516% ( 3) 00:15:34.961 4.930 - 4.954: 97.9879% ( 5) 00:15:34.961 4.954 - 4.978: 98.0025% ( 2) 00:15:34.961 4.978 - 5.001: 98.0461% ( 6) 00:15:34.961 5.001 - 5.025: 98.0606% ( 2) 00:15:34.961 5.025 - 5.049: 98.0824% ( 3) 00:15:34.961 5.049 - 5.073: 98.1042% ( 3) 00:15:34.961 5.073 - 5.096: 98.1187% ( 2) 00:15:34.961 5.120 - 5.144: 98.1260% ( 1) 00:15:34.961 5.144 - 5.167: 98.1332% ( 1) 00:15:34.961 5.167 - 5.191: 98.1405% ( 1) 00:15:34.961 5.215 - 5.239: 98.1477% ( 1) 00:15:34.961 5.239 - 5.262: 98.1550% ( 1) 00:15:34.961 5.381 - 5.404: 98.1695% ( 2) 00:15:34.961 5.404 - 5.428: 98.1841% ( 2) 00:15:34.961 5.476 - 5.499: 98.1986% ( 2) 00:15:34.961 5.570 - 5.594: 98.2131% ( 2) 00:15:34.961 5.594 - 5.618: 98.2276% ( 2) 00:15:34.961 5.713 - 5.736: 98.2349% ( 1) 00:15:34.961 5.736 - 5.760: 98.2494% ( 2) 00:15:34.961 5.760 - 5.784: 98.2640% ( 2) 00:15:34.961 5.902 - 5.926: 98.2858% ( 3) 00:15:34.961 5.997 - 6.021: 98.2930% ( 1) 00:15:34.961 6.021 - 6.044: 98.3003% ( 1) 00:15:34.961 6.210 - 6.258: 98.3075% ( 1) 00:15:34.961 6.258 - 6.305: 98.3148% ( 1) 00:15:34.961 6.353 - 6.400: 98.3221% ( 1) 00:15:34.961 6.779 - 6.827: 98.3439% ( 3) 00:15:34.961 6.827 - 6.874: 98.3511% ( 1) 00:15:34.961 7.016 - 7.064: 98.3584% ( 1) 00:15:34.961 7.396 - 7.443: 98.3657% ( 1) 00:15:34.961 7.443 - 7.490: 98.3729% ( 1) 00:15:34.961 7.538 - 7.585: 98.3802% ( 1) 00:15:34.961 7.585 - 7.633: 98.3874% ( 1) 00:15:34.961 7.775 - 7.822: 98.3947% ( 1) 00:15:34.961 7.822 - 7.870: 98.4020% ( 1) 00:15:34.961 7.870 - 7.917: 98.4092% ( 1) 00:15:34.961 7.917 - 7.964: 98.4165% ( 1) 00:15:34.961 7.964 - 8.012: 98.4238% ( 1) 00:15:34.961 8.107 - 8.154: 98.4383% ( 2) 00:15:34.961 8.249 - 8.296: 98.4601% ( 3) 00:15:34.961 8.296 - 8.344: 98.4819% ( 3) 00:15:34.961 8.391 - 8.439: 98.4964% ( 2) 00:15:34.961 8.439 - 8.486: 98.5182% ( 3) 00:15:34.961 8.486 - 8.533: 98.5255% ( 1) 00:15:34.961 8.533 - 8.581: 98.5327% ( 1) 00:15:34.961 8.676 - 8.723: 98.5400% ( 1) 00:15:34.961 8.723 - 8.770: 98.5473% ( 1) 00:15:34.961 8.865 - 8.913: 98.5545% ( 1) 00:15:34.961 8.960 - 9.007: 98.5618% ( 1) 00:15:34.961 9.055 - 9.102: 98.5763% ( 2) 00:15:34.961 9.197 - 9.244: 98.5836% ( 1) 00:15:34.961 9.339 - 9.387: 98.5908% ( 1) 00:15:34.961 9.387 - 9.434: 98.6126% ( 3) 00:15:34.961 9.529 - 9.576: 98.6199% ( 1) 00:15:34.961 9.671 - 9.719: 98.6344% ( 2) 00:15:34.961 9.766 - 9.813: 98.6417% ( 1) 00:15:34.961 9.861 - 9.908: 98.6489% ( 1) 00:15:34.961 9.908 - 9.956: 98.6562% ( 1) 00:15:34.961 10.050 - 10.098: 98.6635% ( 1) 00:15:34.961 10.098 - 10.145: 98.6707% ( 1) 00:15:34.961 10.193 - 10.240: 98.6780% ( 1) 00:15:34.961 10.240 - 10.287: 98.6853% ( 1) 00:15:34.961 10.430 - 10.477: 98.6925% ( 1) 00:15:34.961 10.619 - 10.667: 98.6998% ( 1) 00:15:34.961 10.667 - 10.714: 98.7071% ( 1) 00:15:34.961 10.856 - 10.904: 98.7143% ( 1) 00:15:34.961 10.951 - 10.999: 98.7216% ( 1) 00:15:34.961 10.999 - 11.046: 98.7288% ( 1) 00:15:34.961 11.188 - 11.236: 98.7361% ( 1) 00:15:34.961 11.425 - 11.473: 98.7434% ( 1) 00:15:34.961 11.567 - 11.615: 98.7506% ( 1) 00:15:34.961 12.041 - 12.089: 98.7579% ( 1) 00:15:34.961 12.089 - 12.136: 98.7652% ( 1) 00:15:34.961 12.136 - 12.231: 98.7797% ( 2) 00:15:34.961 12.231 - 12.326: 98.7870% ( 1) 00:15:34.961 12.326 - 12.421: 98.7942% ( 1) 00:15:34.961 12.421 - 12.516: 98.8087% ( 2) 00:15:34.961 12.610 - 12.705: 98.8160% ( 1) 00:15:34.961 12.990 - 13.084: 98.8233% ( 1) 00:15:34.961 13.274 - 13.369: 98.8305% ( 1) 00:15:34.961 13.369 - 13.464: 98.8378% ( 1) 00:15:34.961 13.653 - 13.748: 98.8451% ( 1) 00:15:34.961 13.938 - 14.033: 98.8523% ( 1) 00:15:34.961 14.033 - 14.127: 98.8741% ( 3) 00:15:34.961 14.317 - 14.412: 98.8814% ( 1) 00:15:34.961 14.507 - 14.601: 98.8886% ( 1) 00:15:34.961 14.601 - 14.696: 98.8959% ( 1) 00:15:34.961 14.981 - 15.076: 98.9032% ( 1) 00:15:34.961 17.067 - 17.161: 98.9322% ( 4) 00:15:34.961 17.161 - 17.256: 98.9468% ( 2) 00:15:34.961 17.256 - 17.351: 98.9540% ( 1) 00:15:34.961 17.351 - 17.446: 98.9831% ( 4) 00:15:34.961 17.446 - 17.541: 98.9976% ( 2) 00:15:34.961 17.541 - 17.636: 99.0339% ( 5) 00:15:34.961 17.636 - 17.730: 99.0557% ( 3) 00:15:34.961 17.730 - 17.825: 99.0993% ( 6) 00:15:34.961 17.825 - 17.920: 99.1574% ( 8) 00:15:34.961 17.920 - 18.015: 99.2664% ( 15) 00:15:34.961 18.015 - 18.110: 99.3172% ( 7) 00:15:34.961 18.110 - 18.204: 99.4116% ( 13) 00:15:34.961 18.204 - 18.299: 99.4915% ( 11) 00:15:34.961 18.299 - 18.394: 99.6078% ( 16) 00:15:34.961 18.394 - 18.489: 99.6659% ( 8) 00:15:34.961 18.489 - 18.584: 99.6877% ( 3) 00:15:34.961 18.584 - 18.679: 99.7385% ( 7) 00:15:34.961 18.679 - 18.773: 99.7603% ( 3) 00:15:34.961 18.773 - 18.868: 99.7894% ( 4) 00:15:34.961 18.868 - 18.963: 99.8257% ( 5) 00:15:34.961 18.963 - 19.058: 99.8547% ( 4) 00:15:34.961 20.101 - 20.196: 99.8620% ( 1) 00:15:34.961 20.480 - 20.575: 99.8693% ( 1) 00:15:34.961 22.756 - 22.850: 99.8765% ( 1) 00:15:34.961 23.893 - 23.988: 99.8838% ( 1) 00:15:34.961 26.169 - 26.359: 99.8910% ( 1) 00:15:34.961 28.065 - 28.255: 99.8983% ( 1) 00:15:34.961 3980.705 - 4004.978: 99.9927% ( 13) 00:15:34.961 4004.978 - 4029.250: 100.0000% ( 1) 00:15:34.961 00:15:34.961 Complete histogram 00:15:34.961 ================== 00:15:34.961 Range in us Cumulative Count 00:15:34.961 2.027 - 2.039: 0.4504% ( 62) 00:15:34.962 2.039 - 2.050: 10.0603% ( 1323) 00:15:34.962 2.050 - 2.062: 14.8616% ( 661) 00:15:34.962 2.062 - 2.074: 21.0649% ( 854) 00:15:34.962 2.074 - 2.086: 51.1368% ( 4140) 00:15:34.962 2.086 - 2.098: 59.6281% ( 1169) 00:15:34.962 2.098 - 2.110: 61.9670% ( 322) 00:15:34.962 2.110 - 2.121: 65.3374% ( 464) 00:15:34.962 2.121 - 2.133: 65.9839% ( 89) 00:15:34.962 2.133 - 2.145: 70.5165% ( 624) 00:15:34.962 2.145 - 2.157: 78.9569% ( 1162) 00:15:34.962 2.157 - 2.169: 80.9327% ( 272) 00:15:34.962 2.169 - 2.181: 82.6760% ( 240) 00:15:34.962 2.181 - 2.193: 84.3902% ( 236) 00:15:34.962 2.193 - 2.204: 85.0585% ( 92) 00:15:34.962 2.204 - 2.216: 87.9567% ( 399) 00:15:34.962 2.216 - 2.228: 92.2932% ( 597) 00:15:34.962 2.228 - 2.240: 93.3028% ( 139) 00:15:34.962 2.240 - 2.252: 93.7677% ( 64) 00:15:34.962 2.252 - 2.264: 94.1309% ( 50) 00:15:34.962 2.264 - 2.276: 94.4069% ( 38) 00:15:34.962 2.276 - 2.287: 95.0025% ( 82) 00:15:34.962 2.287 - 2.299: 95.2713% ( 37) 00:15:34.962 2.299 - 2.311: 95.3439% ( 10) 00:15:34.962 2.311 - 2.323: 95.4602% ( 16) 00:15:34.962 2.323 - 2.335: 95.6054% ( 20) 00:15:34.962 2.335 - 2.347: 95.7943% ( 26) 00:15:34.962 2.347 - 2.359: 96.0776% ( 39) 00:15:34.962 2.359 - 2.370: 96.3827% ( 42) 00:15:34.962 2.370 - 2.382: 96.6514% ( 37) 00:15:34.962 2.382 - 2.394: 96.8112% ( 22) 00:15:34.962 2.394 - 2.406: 97.0219% ( 29) 00:15:34.962 2.406 - 2.418: 97.1889% ( 23) 00:15:34.962 2.418 - 2.430: 97.4068% ( 30) 00:15:34.962 2.430 - 2.441: 97.5666% ( 22) 00:15:34.962 2.441 - 2.453: 97.7119% ( 20) 00:15:34.962 2.453 - 2.465: 97.7700% ( 8) 00:15:34.962 2.465 - 2.477: 97.8354% ( 9) 00:15:34.962 2.477 - 2.489: 97.9153% ( 11) 00:15:34.962 2.489 - 2.501: 97.9879% ( 10) 00:15:34.962 2.501 - 2.513: 98.0678% ( 11) 00:15:34.962 2.513 - 2.524: 98.1187% ( 7) 00:15:34.962 2.524 - 2.536: 98.1405% ( 3) 00:15:34.962 2.536 - 2.548: 98.1477% ( 1) 00:15:34.962 2.548 - 2.560: 98.1623% ( 2) 00:15:34.962 2.560 - 2.572: 98.1768% ( 2) 00:15:34.962 2.572 - 2.584: 98.1841% ( 1) 00:15:34.962 2.584 - 2.596: 98.1913% ( 1) 00:15:34.962 2.596 - 2.607: 98.2204% ( 4) 00:15:34.962 2.607 - 2.619: 98.2349% ( 2) 00:15:34.962 2.619 - 2.631: 98.2640% ( 4) 00:15:34.962 2.643 - 2.655: 98.3003% ( 5) 00:15:34.962 2.655 - 2.667: 98.3148% ( 2) 00:15:34.962 2.667 - 2.679: 98.3439% ( 4) 00:15:34.962 2.679 - 2.690: 98.3511% ( 1) 00:15:34.962 2.714 - 2.726: 98.3584% ( 1) 00:15:34.962 2.738 - 2.750: 98.3657% ( 1) 00:15:34.962 2.750 - 2.761: 98.3802% ( 2) 00:15:34.962 2.761 - 2.773: 98.3947% ( 2) 00:15:34.962 2.773 - 2.785: 98.4165% ( 3) 00:15:34.962 2.868 - 2.880: 98.4238% ( 1) 00:15:34.962 2.880 - 2.892: 98.4310% ( 1) 00:15:34.962 2.892 - 2.904: 98.4383% ( 1) 00:15:34.962 2.916 - 2.927: 98.4456% ( 1) 00:15:34.962 3.081 - 3.105: 98.4528% ( 1) 00:15:34.962 3.105 - 3.129: 98.4601% ( 1) 00:15:34.962 3.153 - 3.176: 98.4673% ( 1) 00:15:34.962 3.176 - 3.200: 98.4746% ( 1) 00:15:34.962 3.200 - 3.224: 98.4819% ( 1) 00:15:34.962 3.224 - 3.247: 98.4891% ( 1) 00:15:34.962 3.247 - 3.271: 98.5037% ( 2) 00:15:34.962 3.271 - 3.295: 98.5255% ( 3) 00:15:34.962 3.295 - 3.319: 98.5473% ( 3) 00:15:34.962 3.319 - 3.342: 98.5763% ( 4) 00:15:34.962 3.366 - 3.390: 98.6054% ( 4) 00:15:34.962 3.413 - 3.437: 98.6126% ( 1) 00:15:34.962 3.461 - 3.484: 98.6344% ( 3) 00:15:34.962 3.484 - 3.508: 98.6635% ( 4) 00:15:34.962 3.508 - 3.532: 98.6780% ( 2) 00:15:34.962 3.532 - 3.556: 98.6853% ( 1) 00:15:34.962 3.556 - 3.579: 98.6925% ( 1) 00:15:34.962 3.603 - 3.627: 98.6998% ( 1) 00:15:34.962 3.650 - 3.674: 98.7071% ( 1) 00:15:34.962 3.674 - 3.698: 98.7143% ( 1) 00:15:34.962 3.745 - 3.769: 98.7216% ( 1) 00:15:34.962 3.769 - 3.793: 98.7288% ( 1) 00:15:34.962 4.053 - 4.077: 98.7361% ( 1) 00:15:34.962 4.764 - 4.788: 98.7434% ( 1) 00:15:34.962 5.310 - 5.333: 98.7506% ( 1) 00:15:34.962 5.641 - 5.665: 98.7579% ( 1) 00:15:34.962 5.950 - 5.973: 98.7652% ( 1) 00:15:34.962 6.044 - 6.068: 98.7724% ( 1) 00:15:34.962 6.163 - 6.210: 98.7797% ( 1) 00:15:34.962 6.353 - 6.400: 98.7870% ( 1) 00:15:34.962 6.590 - 6.637: 98.7942% ( 1) 00:15:34.962 6.779 - 6.827: 98.8015% ( 1) 00:15:34.962 6.969 - 7.016: 98.8087% ( 1) 00:15:34.962 7.064 - 7.111: 98.8160% ( 1) 00:15:34.962 7.111 - 7.159: 98.8305% ( 2) 00:15:34.962 7.159 - 7.206: 98.8378% ( 1) 00:15:34.962 7.680 - 7.727: 98.8451% ( 1) 00:15:34.962 7.870 - 7.917: 98.8523% ( 1) 00:15:34.962 7.917 - 7.964: 98.8596% ( 1) 00:15:34.962 8.533 - 8.581: 98.8741% ( 2) 00:15:34.962 11.567 - 11.615: 98.8814% ( 1) 00:15:34.962 12.231 - 12.326: 98.8886% ( 1) 00:15:34.962 14.886 - 14.981: 98.8959% ( 1) 00:15:34.962 15.455 - 15.550: 98.9032% ( 1) 00:15:34.962 15.550 - 15.644: 98.9177% ( 2) 00:15:34.962 15.644 - 15.739: 98.9250% ( 1) 00:15:34.962 15.834 - 15.929: 98.9468% ( 3) 00:15:34.962 15.929 - 16.024: 98.9685% ( 3) 00:15:34.962 16.024 - 16.119: 99.0121% ( 6) 00:15:34.962 16.119 - 16.213: 99.0775% ( 9) 00:15:34.962 16.213 - 16.308: 99.1138% ( 5) 00:15:34.962 16.308 - 16.403: 99.1211% ( 1) 00:15:34.962 16.403 - 16.498: 99.1647% ( 6) 00:15:34.962 16.498 - 16.593: 99.1937% ( 4) 00:15:34.962 16.593 - 16.687: 99.2300% ( 5) 00:15:34.962 16.687 - 16.782: 99.2664% ( 5) 00:15:34.962 16.782 - 16.877: 99.3027% ( 5) 00:15:34.962 16.972 - 17.067: 99.3245% ( 3) 00:15:34.962 17.067 - 17.161: 99.3535% ( 4) 00:15:34.962 17.161 - 17.256: 99.3608% ( 1) 00:15:34.962 17.256 - 17.351: 99.3753% ( 2) 00:15:34.962 17.351 - 17.446: 99.3971% ( 3) 00:15:34.962 17.446 - 17.541: 99.4044% ( 1) 00:15:34.962 17.636 - 17.730: 99.4116% ( 1) 00:15:34.962 17.920 - 18.015: 99.4189% ( 1) 00:15:34.962 18.868 - 18.963: 99.4262% ( 1) 00:15:34.962 31.668 - 31.858: 99.4334% ( 1) 00:15:34.962 33.564 - 33.754: 99.4407% ( 1) 00:15:34.962 3398.163 - 3422.436: 99.4480% ( 1) 00:15:34.962 3980.705 - 4004.978: 99.9274% ( 66) 00:15:34.962 4004.978 - 4029.250: 100.0000% ( 10) 00:15:34.962 00:15:34.962 15:59:24 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:15:34.962 15:59:24 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:34.962 15:59:24 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:15:34.962 15:59:24 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:15:34.962 15:59:24 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:34.962 [2024-10-30 15:59:24.745163] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:15:34.962 [ 00:15:34.962 { 00:15:34.962 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:34.962 "subtype": "Discovery", 00:15:34.962 "listen_addresses": [], 00:15:34.962 "allow_any_host": true, 00:15:34.962 "hosts": [] 00:15:34.962 }, 00:15:34.962 { 00:15:34.962 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:34.962 "subtype": "NVMe", 00:15:34.962 "listen_addresses": [ 00:15:34.962 { 00:15:34.962 "transport": "VFIOUSER", 00:15:34.962 "trtype": "VFIOUSER", 00:15:34.962 "adrfam": "IPv4", 00:15:34.962 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:34.962 "trsvcid": "0" 00:15:34.962 } 00:15:34.962 ], 00:15:34.962 "allow_any_host": true, 00:15:34.962 "hosts": [], 00:15:34.962 "serial_number": "SPDK1", 00:15:34.962 "model_number": "SPDK bdev Controller", 00:15:34.962 "max_namespaces": 32, 00:15:34.962 "min_cntlid": 1, 00:15:34.962 "max_cntlid": 65519, 00:15:34.962 "namespaces": [ 00:15:34.962 { 00:15:34.962 "nsid": 1, 00:15:34.962 "bdev_name": "Malloc1", 00:15:34.962 "name": "Malloc1", 00:15:34.962 "nguid": "7B9B13A0299845CB97B9E38761ACE33B", 00:15:34.962 "uuid": "7b9b13a0-2998-45cb-97b9-e38761ace33b" 00:15:34.962 } 00:15:34.962 ] 00:15:34.962 }, 00:15:34.962 { 00:15:34.962 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:34.962 "subtype": "NVMe", 00:15:34.962 "listen_addresses": [ 00:15:34.962 { 00:15:34.962 "transport": "VFIOUSER", 00:15:34.962 "trtype": "VFIOUSER", 00:15:34.962 "adrfam": "IPv4", 00:15:34.962 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:34.962 "trsvcid": "0" 00:15:34.962 } 00:15:34.962 ], 00:15:34.962 "allow_any_host": true, 00:15:34.962 "hosts": [], 00:15:34.962 "serial_number": "SPDK2", 00:15:34.962 "model_number": "SPDK bdev Controller", 00:15:34.962 "max_namespaces": 32, 00:15:34.962 "min_cntlid": 1, 00:15:34.962 "max_cntlid": 65519, 00:15:34.962 "namespaces": [ 00:15:34.962 { 00:15:34.962 "nsid": 1, 00:15:34.962 "bdev_name": "Malloc2", 00:15:34.962 "name": "Malloc2", 00:15:34.962 "nguid": "14AFA5E04CC240E6B7F7108EF131393C", 00:15:34.962 "uuid": "14afa5e0-4cc2-40e6-b7f7-108ef131393c" 00:15:34.962 } 00:15:34.962 ] 00:15:34.962 } 00:15:34.962 ] 00:15:34.962 15:59:24 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:34.962 15:59:24 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2393627 00:15:34.963 15:59:24 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:15:34.963 15:59:24 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:34.963 15:59:24 -- common/autotest_common.sh@1244 -- # local i=0 00:15:34.963 15:59:24 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:34.963 15:59:24 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:34.963 15:59:24 -- common/autotest_common.sh@1255 -- # return 0 00:15:34.963 15:59:24 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:34.963 15:59:24 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:15:34.963 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.220 Malloc3 00:15:35.220 15:59:25 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:15:35.477 15:59:25 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:35.477 Asynchronous Event Request test 00:15:35.477 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:35.477 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:35.477 Registering asynchronous event callbacks... 00:15:35.477 Starting namespace attribute notice tests for all controllers... 00:15:35.477 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:35.477 aer_cb - Changed Namespace 00:15:35.477 Cleaning up... 00:15:35.735 [ 00:15:35.735 { 00:15:35.735 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:35.735 "subtype": "Discovery", 00:15:35.735 "listen_addresses": [], 00:15:35.735 "allow_any_host": true, 00:15:35.735 "hosts": [] 00:15:35.735 }, 00:15:35.735 { 00:15:35.735 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:35.735 "subtype": "NVMe", 00:15:35.735 "listen_addresses": [ 00:15:35.735 { 00:15:35.735 "transport": "VFIOUSER", 00:15:35.735 "trtype": "VFIOUSER", 00:15:35.735 "adrfam": "IPv4", 00:15:35.735 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:35.735 "trsvcid": "0" 00:15:35.735 } 00:15:35.735 ], 00:15:35.735 "allow_any_host": true, 00:15:35.735 "hosts": [], 00:15:35.735 "serial_number": "SPDK1", 00:15:35.735 "model_number": "SPDK bdev Controller", 00:15:35.735 "max_namespaces": 32, 00:15:35.735 "min_cntlid": 1, 00:15:35.735 "max_cntlid": 65519, 00:15:35.735 "namespaces": [ 00:15:35.735 { 00:15:35.735 "nsid": 1, 00:15:35.735 "bdev_name": "Malloc1", 00:15:35.735 "name": "Malloc1", 00:15:35.735 "nguid": "7B9B13A0299845CB97B9E38761ACE33B", 00:15:35.735 "uuid": "7b9b13a0-2998-45cb-97b9-e38761ace33b" 00:15:35.735 }, 00:15:35.735 { 00:15:35.735 "nsid": 2, 00:15:35.735 "bdev_name": "Malloc3", 00:15:35.735 "name": "Malloc3", 00:15:35.735 "nguid": "6E1EDF14DEC94B82BBE07C05A2F3685C", 00:15:35.735 "uuid": "6e1edf14-dec9-4b82-bbe0-7c05a2f3685c" 00:15:35.735 } 00:15:35.735 ] 00:15:35.735 }, 00:15:35.735 { 00:15:35.735 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:35.735 "subtype": "NVMe", 00:15:35.735 "listen_addresses": [ 00:15:35.735 { 00:15:35.735 "transport": "VFIOUSER", 00:15:35.735 "trtype": "VFIOUSER", 00:15:35.735 "adrfam": "IPv4", 00:15:35.735 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:35.735 "trsvcid": "0" 00:15:35.735 } 00:15:35.735 ], 00:15:35.735 "allow_any_host": true, 00:15:35.735 "hosts": [], 00:15:35.735 "serial_number": "SPDK2", 00:15:35.735 "model_number": "SPDK bdev Controller", 00:15:35.735 "max_namespaces": 32, 00:15:35.735 "min_cntlid": 1, 00:15:35.735 "max_cntlid": 65519, 00:15:35.735 "namespaces": [ 00:15:35.735 { 00:15:35.735 "nsid": 1, 00:15:35.735 "bdev_name": "Malloc2", 00:15:35.735 "name": "Malloc2", 00:15:35.735 "nguid": "14AFA5E04CC240E6B7F7108EF131393C", 00:15:35.735 "uuid": "14afa5e0-4cc2-40e6-b7f7-108ef131393c" 00:15:35.735 } 00:15:35.735 ] 00:15:35.735 } 00:15:35.735 ] 00:15:35.735 15:59:25 -- target/nvmf_vfio_user.sh@44 -- # wait 2393627 00:15:35.735 15:59:25 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:35.735 15:59:25 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:35.735 15:59:25 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:15:35.735 15:59:25 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:35.735 [2024-10-30 15:59:25.579737] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:15:35.735 [2024-10-30 15:59:25.579780] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2393766 ] 00:15:35.735 EAL: No free 2048 kB hugepages reported on node 1 00:15:35.735 [2024-10-30 15:59:25.611646] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:15:35.994 [2024-10-30 15:59:25.624583] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:35.994 [2024-10-30 15:59:25.624613] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7fe8a3bed000 00:15:35.994 [2024-10-30 15:59:25.625568] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:35.994 [2024-10-30 15:59:25.626590] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:35.994 [2024-10-30 15:59:25.627602] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:35.994 [2024-10-30 15:59:25.628596] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:35.994 [2024-10-30 15:59:25.629604] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:35.994 [2024-10-30 15:59:25.630615] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:35.994 [2024-10-30 15:59:25.631636] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:35.994 [2024-10-30 15:59:25.632629] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:35.994 [2024-10-30 15:59:25.633632] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:35.994 [2024-10-30 15:59:25.633653] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7fe8a28e5000 00:15:35.994 [2024-10-30 15:59:25.634809] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:35.994 [2024-10-30 15:59:25.649563] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:15:35.994 [2024-10-30 15:59:25.649598] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:15:35.994 [2024-10-30 15:59:25.651669] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:35.994 [2024-10-30 15:59:25.651725] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:35.994 [2024-10-30 15:59:25.651815] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:15:35.994 [2024-10-30 15:59:25.651842] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:15:35.994 [2024-10-30 15:59:25.651871] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:15:35.994 [2024-10-30 15:59:25.652673] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:15:35.994 [2024-10-30 15:59:25.652694] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:15:35.994 [2024-10-30 15:59:25.652707] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:15:35.994 [2024-10-30 15:59:25.653680] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:35.994 [2024-10-30 15:59:25.653700] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:15:35.994 [2024-10-30 15:59:25.653714] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:15:35.994 [2024-10-30 15:59:25.654685] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:15:35.994 [2024-10-30 15:59:25.654705] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:35.994 [2024-10-30 15:59:25.655708] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:15:35.994 [2024-10-30 15:59:25.655728] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:15:35.994 [2024-10-30 15:59:25.655738] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:15:35.994 [2024-10-30 15:59:25.655749] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:35.994 [2024-10-30 15:59:25.655859] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:15:35.994 [2024-10-30 15:59:25.655866] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:35.994 [2024-10-30 15:59:25.655874] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:15:35.994 [2024-10-30 15:59:25.656706] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:15:35.994 [2024-10-30 15:59:25.657711] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:15:35.994 [2024-10-30 15:59:25.658724] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:35.994 [2024-10-30 15:59:25.659756] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:35.994 [2024-10-30 15:59:25.660734] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:15:35.994 [2024-10-30 15:59:25.660754] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:35.994 [2024-10-30 15:59:25.660763] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:15:35.994 [2024-10-30 15:59:25.660786] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:15:35.994 [2024-10-30 15:59:25.660804] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:15:35.994 [2024-10-30 15:59:25.660826] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:35.994 [2024-10-30 15:59:25.660836] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:35.994 [2024-10-30 15:59:25.660855] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:35.994 [2024-10-30 15:59:25.671271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:35.994 [2024-10-30 15:59:25.671294] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:15:35.994 [2024-10-30 15:59:25.671304] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:15:35.994 [2024-10-30 15:59:25.671311] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:15:35.995 [2024-10-30 15:59:25.671319] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:35.995 [2024-10-30 15:59:25.671326] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:15:35.995 [2024-10-30 15:59:25.671334] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:15:35.995 [2024-10-30 15:59:25.671342] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.671361] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.671378] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:35.995 [2024-10-30 15:59:25.687280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:35.995 [2024-10-30 15:59:25.687311] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:35.995 [2024-10-30 15:59:25.687326] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:35.995 [2024-10-30 15:59:25.687338] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:35.995 [2024-10-30 15:59:25.687350] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:35.995 [2024-10-30 15:59:25.687359] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.687375] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.687390] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:35.995 [2024-10-30 15:59:25.695271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:35.995 [2024-10-30 15:59:25.695290] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:15:35.995 [2024-10-30 15:59:25.695314] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.695326] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.695346] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.695362] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:35.995 [2024-10-30 15:59:25.703269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:35.995 [2024-10-30 15:59:25.703339] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.703354] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.703367] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:35.995 [2024-10-30 15:59:25.703376] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:35.995 [2024-10-30 15:59:25.703386] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:35.995 [2024-10-30 15:59:25.711270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:35.995 [2024-10-30 15:59:25.711297] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:15:35.995 [2024-10-30 15:59:25.711313] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.711328] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.711340] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:35.995 [2024-10-30 15:59:25.711349] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:35.995 [2024-10-30 15:59:25.711359] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:35.995 [2024-10-30 15:59:25.719271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:35.995 [2024-10-30 15:59:25.719300] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.719317] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.719329] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:35.995 [2024-10-30 15:59:25.719338] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:35.995 [2024-10-30 15:59:25.719348] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:35.995 [2024-10-30 15:59:25.727270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:35.995 [2024-10-30 15:59:25.727292] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.727303] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.727319] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.727333] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.727342] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.727350] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:15:35.995 [2024-10-30 15:59:25.727358] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:15:35.995 [2024-10-30 15:59:25.727366] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:15:35.995 [2024-10-30 15:59:25.727390] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:35.995 [2024-10-30 15:59:25.735269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:35.995 [2024-10-30 15:59:25.735294] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:35.995 [2024-10-30 15:59:25.743265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:35.995 [2024-10-30 15:59:25.743291] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:35.995 [2024-10-30 15:59:25.751266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:35.995 [2024-10-30 15:59:25.751291] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:35.995 [2024-10-30 15:59:25.759282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:35.995 [2024-10-30 15:59:25.759307] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:35.995 [2024-10-30 15:59:25.759317] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:35.995 [2024-10-30 15:59:25.759323] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:35.995 [2024-10-30 15:59:25.759329] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:35.995 [2024-10-30 15:59:25.759339] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:35.995 [2024-10-30 15:59:25.759351] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:35.995 [2024-10-30 15:59:25.759359] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:35.995 [2024-10-30 15:59:25.759368] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:35.995 [2024-10-30 15:59:25.759379] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:35.995 [2024-10-30 15:59:25.759387] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:35.995 [2024-10-30 15:59:25.759396] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:35.995 [2024-10-30 15:59:25.759408] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:35.995 [2024-10-30 15:59:25.759416] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:35.995 [2024-10-30 15:59:25.759425] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:35.995 [2024-10-30 15:59:25.767266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:35.995 [2024-10-30 15:59:25.767297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:35.995 [2024-10-30 15:59:25.767314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:35.995 [2024-10-30 15:59:25.767326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:35.995 ===================================================== 00:15:35.995 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:35.995 ===================================================== 00:15:35.995 Controller Capabilities/Features 00:15:35.995 ================================ 00:15:35.995 Vendor ID: 4e58 00:15:35.995 Subsystem Vendor ID: 4e58 00:15:35.995 Serial Number: SPDK2 00:15:35.995 Model Number: SPDK bdev Controller 00:15:35.995 Firmware Version: 24.01.1 00:15:35.995 Recommended Arb Burst: 6 00:15:35.995 IEEE OUI Identifier: 8d 6b 50 00:15:35.995 Multi-path I/O 00:15:35.995 May have multiple subsystem ports: Yes 00:15:35.995 May have multiple controllers: Yes 00:15:35.995 Associated with SR-IOV VF: No 00:15:35.995 Max Data Transfer Size: 131072 00:15:35.995 Max Number of Namespaces: 32 00:15:35.995 Max Number of I/O Queues: 127 00:15:35.995 NVMe Specification Version (VS): 1.3 00:15:35.995 NVMe Specification Version (Identify): 1.3 00:15:35.995 Maximum Queue Entries: 256 00:15:35.995 Contiguous Queues Required: Yes 00:15:35.995 Arbitration Mechanisms Supported 00:15:35.995 Weighted Round Robin: Not Supported 00:15:35.995 Vendor Specific: Not Supported 00:15:35.995 Reset Timeout: 15000 ms 00:15:35.995 Doorbell Stride: 4 bytes 00:15:35.996 NVM Subsystem Reset: Not Supported 00:15:35.996 Command Sets Supported 00:15:35.996 NVM Command Set: Supported 00:15:35.996 Boot Partition: Not Supported 00:15:35.996 Memory Page Size Minimum: 4096 bytes 00:15:35.996 Memory Page Size Maximum: 4096 bytes 00:15:35.996 Persistent Memory Region: Not Supported 00:15:35.996 Optional Asynchronous Events Supported 00:15:35.996 Namespace Attribute Notices: Supported 00:15:35.996 Firmware Activation Notices: Not Supported 00:15:35.996 ANA Change Notices: Not Supported 00:15:35.996 PLE Aggregate Log Change Notices: Not Supported 00:15:35.996 LBA Status Info Alert Notices: Not Supported 00:15:35.996 EGE Aggregate Log Change Notices: Not Supported 00:15:35.996 Normal NVM Subsystem Shutdown event: Not Supported 00:15:35.996 Zone Descriptor Change Notices: Not Supported 00:15:35.996 Discovery Log Change Notices: Not Supported 00:15:35.996 Controller Attributes 00:15:35.996 128-bit Host Identifier: Supported 00:15:35.996 Non-Operational Permissive Mode: Not Supported 00:15:35.996 NVM Sets: Not Supported 00:15:35.996 Read Recovery Levels: Not Supported 00:15:35.996 Endurance Groups: Not Supported 00:15:35.996 Predictable Latency Mode: Not Supported 00:15:35.996 Traffic Based Keep ALive: Not Supported 00:15:35.996 Namespace Granularity: Not Supported 00:15:35.996 SQ Associations: Not Supported 00:15:35.996 UUID List: Not Supported 00:15:35.996 Multi-Domain Subsystem: Not Supported 00:15:35.996 Fixed Capacity Management: Not Supported 00:15:35.996 Variable Capacity Management: Not Supported 00:15:35.996 Delete Endurance Group: Not Supported 00:15:35.996 Delete NVM Set: Not Supported 00:15:35.996 Extended LBA Formats Supported: Not Supported 00:15:35.996 Flexible Data Placement Supported: Not Supported 00:15:35.996 00:15:35.996 Controller Memory Buffer Support 00:15:35.996 ================================ 00:15:35.996 Supported: No 00:15:35.996 00:15:35.996 Persistent Memory Region Support 00:15:35.996 ================================ 00:15:35.996 Supported: No 00:15:35.996 00:15:35.996 Admin Command Set Attributes 00:15:35.996 ============================ 00:15:35.996 Security Send/Receive: Not Supported 00:15:35.996 Format NVM: Not Supported 00:15:35.996 Firmware Activate/Download: Not Supported 00:15:35.996 Namespace Management: Not Supported 00:15:35.996 Device Self-Test: Not Supported 00:15:35.996 Directives: Not Supported 00:15:35.996 NVMe-MI: Not Supported 00:15:35.996 Virtualization Management: Not Supported 00:15:35.996 Doorbell Buffer Config: Not Supported 00:15:35.996 Get LBA Status Capability: Not Supported 00:15:35.996 Command & Feature Lockdown Capability: Not Supported 00:15:35.996 Abort Command Limit: 4 00:15:35.996 Async Event Request Limit: 4 00:15:35.996 Number of Firmware Slots: N/A 00:15:35.996 Firmware Slot 1 Read-Only: N/A 00:15:35.996 Firmware Activation Without Reset: N/A 00:15:35.996 Multiple Update Detection Support: N/A 00:15:35.996 Firmware Update Granularity: No Information Provided 00:15:35.996 Per-Namespace SMART Log: No 00:15:35.996 Asymmetric Namespace Access Log Page: Not Supported 00:15:35.996 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:15:35.996 Command Effects Log Page: Supported 00:15:35.996 Get Log Page Extended Data: Supported 00:15:35.996 Telemetry Log Pages: Not Supported 00:15:35.996 Persistent Event Log Pages: Not Supported 00:15:35.996 Supported Log Pages Log Page: May Support 00:15:35.996 Commands Supported & Effects Log Page: Not Supported 00:15:35.996 Feature Identifiers & Effects Log Page:May Support 00:15:35.996 NVMe-MI Commands & Effects Log Page: May Support 00:15:35.996 Data Area 4 for Telemetry Log: Not Supported 00:15:35.996 Error Log Page Entries Supported: 128 00:15:35.996 Keep Alive: Supported 00:15:35.996 Keep Alive Granularity: 10000 ms 00:15:35.996 00:15:35.996 NVM Command Set Attributes 00:15:35.996 ========================== 00:15:35.996 Submission Queue Entry Size 00:15:35.996 Max: 64 00:15:35.996 Min: 64 00:15:35.996 Completion Queue Entry Size 00:15:35.996 Max: 16 00:15:35.996 Min: 16 00:15:35.996 Number of Namespaces: 32 00:15:35.996 Compare Command: Supported 00:15:35.996 Write Uncorrectable Command: Not Supported 00:15:35.996 Dataset Management Command: Supported 00:15:35.996 Write Zeroes Command: Supported 00:15:35.996 Set Features Save Field: Not Supported 00:15:35.996 Reservations: Not Supported 00:15:35.996 Timestamp: Not Supported 00:15:35.996 Copy: Supported 00:15:35.996 Volatile Write Cache: Present 00:15:35.996 Atomic Write Unit (Normal): 1 00:15:35.996 Atomic Write Unit (PFail): 1 00:15:35.996 Atomic Compare & Write Unit: 1 00:15:35.996 Fused Compare & Write: Supported 00:15:35.996 Scatter-Gather List 00:15:35.996 SGL Command Set: Supported (Dword aligned) 00:15:35.996 SGL Keyed: Not Supported 00:15:35.996 SGL Bit Bucket Descriptor: Not Supported 00:15:35.996 SGL Metadata Pointer: Not Supported 00:15:35.996 Oversized SGL: Not Supported 00:15:35.996 SGL Metadata Address: Not Supported 00:15:35.996 SGL Offset: Not Supported 00:15:35.996 Transport SGL Data Block: Not Supported 00:15:35.996 Replay Protected Memory Block: Not Supported 00:15:35.996 00:15:35.996 Firmware Slot Information 00:15:35.996 ========================= 00:15:35.996 Active slot: 1 00:15:35.996 Slot 1 Firmware Revision: 24.01.1 00:15:35.996 00:15:35.996 00:15:35.996 Commands Supported and Effects 00:15:35.996 ============================== 00:15:35.996 Admin Commands 00:15:35.996 -------------- 00:15:35.996 Get Log Page (02h): Supported 00:15:35.996 Identify (06h): Supported 00:15:35.996 Abort (08h): Supported 00:15:35.996 Set Features (09h): Supported 00:15:35.996 Get Features (0Ah): Supported 00:15:35.996 Asynchronous Event Request (0Ch): Supported 00:15:35.996 Keep Alive (18h): Supported 00:15:35.996 I/O Commands 00:15:35.996 ------------ 00:15:35.996 Flush (00h): Supported LBA-Change 00:15:35.996 Write (01h): Supported LBA-Change 00:15:35.996 Read (02h): Supported 00:15:35.996 Compare (05h): Supported 00:15:35.996 Write Zeroes (08h): Supported LBA-Change 00:15:35.996 Dataset Management (09h): Supported LBA-Change 00:15:35.996 Copy (19h): Supported LBA-Change 00:15:35.996 Unknown (79h): Supported LBA-Change 00:15:35.996 Unknown (7Ah): Supported 00:15:35.996 00:15:35.996 Error Log 00:15:35.996 ========= 00:15:35.996 00:15:35.996 Arbitration 00:15:35.996 =========== 00:15:35.996 Arbitration Burst: 1 00:15:35.996 00:15:35.996 Power Management 00:15:35.996 ================ 00:15:35.996 Number of Power States: 1 00:15:35.996 Current Power State: Power State #0 00:15:35.996 Power State #0: 00:15:35.996 Max Power: 0.00 W 00:15:35.996 Non-Operational State: Operational 00:15:35.996 Entry Latency: Not Reported 00:15:35.996 Exit Latency: Not Reported 00:15:35.996 Relative Read Throughput: 0 00:15:35.996 Relative Read Latency: 0 00:15:35.996 Relative Write Throughput: 0 00:15:35.996 Relative Write Latency: 0 00:15:35.996 Idle Power: Not Reported 00:15:35.996 Active Power: Not Reported 00:15:35.996 Non-Operational Permissive Mode: Not Supported 00:15:35.996 00:15:35.996 Health Information 00:15:35.996 ================== 00:15:35.996 Critical Warnings: 00:15:35.996 Available Spare Space: OK 00:15:35.996 Temperature: OK 00:15:35.996 Device Reliability: OK 00:15:35.996 Read Only: No 00:15:35.996 Volatile Memory Backup: OK 00:15:35.996 Current Temperature: 0 Kelvin[2024-10-30 15:59:25.767450] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:35.996 [2024-10-30 15:59:25.775266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:35.996 [2024-10-30 15:59:25.775312] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:15:35.996 [2024-10-30 15:59:25.775330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:35.996 [2024-10-30 15:59:25.775342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:35.996 [2024-10-30 15:59:25.775352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:35.996 [2024-10-30 15:59:25.775361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:35.996 [2024-10-30 15:59:25.775436] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:35.996 [2024-10-30 15:59:25.775458] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:15:35.996 [2024-10-30 15:59:25.776480] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:15:35.996 [2024-10-30 15:59:25.776496] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:15:35.996 [2024-10-30 15:59:25.777444] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:15:35.996 [2024-10-30 15:59:25.777468] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:15:35.996 [2024-10-30 15:59:25.777520] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:15:35.996 [2024-10-30 15:59:25.778710] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:35.996 (-273 Celsius) 00:15:35.996 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:35.996 Available Spare: 0% 00:15:35.996 Available Spare Threshold: 0% 00:15:35.996 Life Percentage Used: 0% 00:15:35.996 Data Units Read: 0 00:15:35.996 Data Units Written: 0 00:15:35.997 Host Read Commands: 0 00:15:35.997 Host Write Commands: 0 00:15:35.997 Controller Busy Time: 0 minutes 00:15:35.997 Power Cycles: 0 00:15:35.997 Power On Hours: 0 hours 00:15:35.997 Unsafe Shutdowns: 0 00:15:35.997 Unrecoverable Media Errors: 0 00:15:35.997 Lifetime Error Log Entries: 0 00:15:35.997 Warning Temperature Time: 0 minutes 00:15:35.997 Critical Temperature Time: 0 minutes 00:15:35.997 00:15:35.997 Number of Queues 00:15:35.997 ================ 00:15:35.997 Number of I/O Submission Queues: 127 00:15:35.997 Number of I/O Completion Queues: 127 00:15:35.997 00:15:35.997 Active Namespaces 00:15:35.997 ================= 00:15:35.997 Namespace ID:1 00:15:35.997 Error Recovery Timeout: Unlimited 00:15:35.997 Command Set Identifier: NVM (00h) 00:15:35.997 Deallocate: Supported 00:15:35.997 Deallocated/Unwritten Error: Not Supported 00:15:35.997 Deallocated Read Value: Unknown 00:15:35.997 Deallocate in Write Zeroes: Not Supported 00:15:35.997 Deallocated Guard Field: 0xFFFF 00:15:35.997 Flush: Supported 00:15:35.997 Reservation: Supported 00:15:35.997 Namespace Sharing Capabilities: Multiple Controllers 00:15:35.997 Size (in LBAs): 131072 (0GiB) 00:15:35.997 Capacity (in LBAs): 131072 (0GiB) 00:15:35.997 Utilization (in LBAs): 131072 (0GiB) 00:15:35.997 NGUID: 14AFA5E04CC240E6B7F7108EF131393C 00:15:35.997 UUID: 14afa5e0-4cc2-40e6-b7f7-108ef131393c 00:15:35.997 Thin Provisioning: Not Supported 00:15:35.997 Per-NS Atomic Units: Yes 00:15:35.997 Atomic Boundary Size (Normal): 0 00:15:35.997 Atomic Boundary Size (PFail): 0 00:15:35.997 Atomic Boundary Offset: 0 00:15:35.997 Maximum Single Source Range Length: 65535 00:15:35.997 Maximum Copy Length: 65535 00:15:35.997 Maximum Source Range Count: 1 00:15:35.997 NGUID/EUI64 Never Reused: No 00:15:35.997 Namespace Write Protected: No 00:15:35.997 Number of LBA Formats: 1 00:15:35.997 Current LBA Format: LBA Format #00 00:15:35.997 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:35.997 00:15:35.997 15:59:25 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:35.997 EAL: No free 2048 kB hugepages reported on node 1 00:15:42.548 Initializing NVMe Controllers 00:15:42.548 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:42.548 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:42.548 Initialization complete. Launching workers. 00:15:42.548 ======================================================== 00:15:42.548 Latency(us) 00:15:42.548 Device Information : IOPS MiB/s Average min max 00:15:42.548 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36682.15 143.29 3488.74 1137.76 7639.21 00:15:42.548 ======================================================== 00:15:42.548 Total : 36682.15 143.29 3488.74 1137.76 7639.21 00:15:42.548 00:15:42.548 15:59:31 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:42.548 EAL: No free 2048 kB hugepages reported on node 1 00:15:46.726 Initializing NVMe Controllers 00:15:46.726 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:46.726 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:46.726 Initialization complete. Launching workers. 00:15:46.726 ======================================================== 00:15:46.726 Latency(us) 00:15:46.726 Device Information : IOPS MiB/s Average min max 00:15:46.726 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 35808.85 139.88 3574.33 1161.04 8517.20 00:15:46.726 ======================================================== 00:15:46.726 Total : 35808.85 139.88 3574.33 1161.04 8517.20 00:15:46.726 00:15:46.726 15:59:36 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:46.726 EAL: No free 2048 kB hugepages reported on node 1 00:15:51.985 Initializing NVMe Controllers 00:15:51.985 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:51.985 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:51.985 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:15:51.985 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:15:51.985 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:15:51.985 Initialization complete. Launching workers. 00:15:51.985 Starting thread on core 2 00:15:51.985 Starting thread on core 3 00:15:51.985 Starting thread on core 1 00:15:51.985 15:59:41 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:15:51.985 EAL: No free 2048 kB hugepages reported on node 1 00:15:56.168 Initializing NVMe Controllers 00:15:56.168 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:56.168 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:56.168 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:15:56.168 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:15:56.168 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:15:56.168 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:15:56.168 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:56.168 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:56.168 Initialization complete. Launching workers. 00:15:56.168 Starting thread on core 1 with urgent priority queue 00:15:56.168 Starting thread on core 2 with urgent priority queue 00:15:56.168 Starting thread on core 3 with urgent priority queue 00:15:56.168 Starting thread on core 0 with urgent priority queue 00:15:56.168 SPDK bdev Controller (SPDK2 ) core 0: 3766.67 IO/s 26.55 secs/100000 ios 00:15:56.168 SPDK bdev Controller (SPDK2 ) core 1: 4647.67 IO/s 21.52 secs/100000 ios 00:15:56.168 SPDK bdev Controller (SPDK2 ) core 2: 3665.33 IO/s 27.28 secs/100000 ios 00:15:56.168 SPDK bdev Controller (SPDK2 ) core 3: 4035.33 IO/s 24.78 secs/100000 ios 00:15:56.168 ======================================================== 00:15:56.168 00:15:56.168 15:59:45 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:56.168 EAL: No free 2048 kB hugepages reported on node 1 00:15:56.168 Initializing NVMe Controllers 00:15:56.168 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:56.168 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:56.168 Namespace ID: 1 size: 0GB 00:15:56.168 Initialization complete. 00:15:56.169 INFO: using host memory buffer for IO 00:15:56.169 Hello world! 00:15:56.169 15:59:45 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:56.169 EAL: No free 2048 kB hugepages reported on node 1 00:15:57.102 Initializing NVMe Controllers 00:15:57.102 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:57.102 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:57.102 Initialization complete. Launching workers. 00:15:57.102 submit (in ns) avg, min, max = 7906.2, 3440.0, 4016094.4 00:15:57.102 complete (in ns) avg, min, max = 23425.1, 2045.6, 4016290.0 00:15:57.102 00:15:57.102 Submit histogram 00:15:57.102 ================ 00:15:57.102 Range in us Cumulative Count 00:15:57.102 3.437 - 3.461: 0.3633% ( 50) 00:15:57.102 3.461 - 3.484: 1.2062% ( 116) 00:15:57.102 3.484 - 3.508: 4.0619% ( 393) 00:15:57.102 3.508 - 3.532: 9.2138% ( 709) 00:15:57.102 3.532 - 3.556: 18.2677% ( 1246) 00:15:57.102 3.556 - 3.579: 28.6950% ( 1435) 00:15:57.102 3.579 - 3.603: 37.9741% ( 1277) 00:15:57.102 3.603 - 3.627: 44.7537% ( 933) 00:15:57.102 3.627 - 3.650: 52.1654% ( 1020) 00:15:57.102 3.650 - 3.674: 58.4435% ( 864) 00:15:57.102 3.674 - 3.698: 63.2030% ( 655) 00:15:57.102 3.698 - 3.721: 67.3231% ( 567) 00:15:57.102 3.721 - 3.745: 70.3459% ( 416) 00:15:57.102 3.745 - 3.769: 73.7974% ( 475) 00:15:57.102 3.769 - 3.793: 77.1254% ( 458) 00:15:57.102 3.793 - 3.816: 80.5188% ( 467) 00:15:57.102 3.816 - 3.840: 83.6797% ( 435) 00:15:57.102 3.840 - 3.864: 86.4264% ( 378) 00:15:57.102 3.864 - 3.887: 88.5845% ( 297) 00:15:57.102 3.887 - 3.911: 90.0886% ( 207) 00:15:57.102 3.911 - 3.935: 91.7890% ( 234) 00:15:57.102 3.935 - 3.959: 92.9516% ( 160) 00:15:57.102 3.959 - 3.982: 94.0052% ( 145) 00:15:57.102 3.982 - 4.006: 94.8481% ( 116) 00:15:57.102 4.006 - 4.030: 95.4149% ( 78) 00:15:57.102 4.030 - 4.053: 95.9890% ( 79) 00:15:57.102 4.053 - 4.077: 96.4685% ( 66) 00:15:57.102 4.077 - 4.101: 96.6793% ( 29) 00:15:57.102 4.101 - 4.124: 96.8609% ( 25) 00:15:57.102 4.124 - 4.148: 96.9844% ( 17) 00:15:57.102 4.148 - 4.172: 97.0644% ( 11) 00:15:57.102 4.172 - 4.196: 97.1225% ( 8) 00:15:57.102 4.196 - 4.219: 97.2824% ( 22) 00:15:57.102 4.219 - 4.243: 97.3623% ( 11) 00:15:57.102 4.243 - 4.267: 97.4422% ( 11) 00:15:57.102 4.267 - 4.290: 97.5004% ( 8) 00:15:57.102 4.290 - 4.314: 97.5367% ( 5) 00:15:57.102 4.314 - 4.338: 97.5730% ( 5) 00:15:57.102 4.338 - 4.361: 97.5948% ( 3) 00:15:57.102 4.361 - 4.385: 97.6239% ( 4) 00:15:57.102 4.385 - 4.409: 97.6457% ( 3) 00:15:57.102 4.433 - 4.456: 97.6530% ( 1) 00:15:57.102 4.456 - 4.480: 97.6602% ( 1) 00:15:57.102 4.480 - 4.504: 97.6675% ( 1) 00:15:57.102 4.527 - 4.551: 97.6748% ( 1) 00:15:57.102 4.599 - 4.622: 97.6820% ( 1) 00:15:57.102 4.646 - 4.670: 97.6893% ( 1) 00:15:57.102 4.670 - 4.693: 97.7329% ( 6) 00:15:57.102 4.693 - 4.717: 97.7838% ( 7) 00:15:57.102 4.717 - 4.741: 97.8201% ( 5) 00:15:57.102 4.741 - 4.764: 97.8637% ( 6) 00:15:57.102 4.764 - 4.788: 97.9363% ( 10) 00:15:57.102 4.788 - 4.812: 98.0017% ( 9) 00:15:57.102 4.812 - 4.836: 98.0163% ( 2) 00:15:57.102 4.836 - 4.859: 98.0962% ( 11) 00:15:57.102 4.859 - 4.883: 98.1325% ( 5) 00:15:57.102 4.883 - 4.907: 98.2052% ( 10) 00:15:57.102 4.907 - 4.930: 98.2270% ( 3) 00:15:57.102 4.930 - 4.954: 98.2415% ( 2) 00:15:57.102 4.954 - 4.978: 98.2706% ( 4) 00:15:57.102 4.978 - 5.001: 98.2997% ( 4) 00:15:57.102 5.001 - 5.025: 98.3142% ( 2) 00:15:57.102 5.025 - 5.049: 98.3360% ( 3) 00:15:57.102 5.049 - 5.073: 98.3651% ( 4) 00:15:57.102 5.073 - 5.096: 98.4014% ( 5) 00:15:57.102 5.096 - 5.120: 98.4159% ( 2) 00:15:57.102 5.120 - 5.144: 98.4232% ( 1) 00:15:57.102 5.144 - 5.167: 98.4305% ( 1) 00:15:57.102 5.191 - 5.215: 98.4595% ( 4) 00:15:57.103 5.262 - 5.286: 98.4668% ( 1) 00:15:57.103 5.286 - 5.310: 98.4741% ( 1) 00:15:57.103 5.357 - 5.381: 98.4886% ( 2) 00:15:57.103 5.784 - 5.807: 98.4959% ( 1) 00:15:57.103 5.879 - 5.902: 98.5104% ( 2) 00:15:57.103 5.973 - 5.997: 98.5177% ( 1) 00:15:57.103 6.163 - 6.210: 98.5322% ( 2) 00:15:57.103 6.305 - 6.353: 98.5395% ( 1) 00:15:57.103 7.253 - 7.301: 98.5467% ( 1) 00:15:57.103 7.348 - 7.396: 98.5540% ( 1) 00:15:57.103 7.443 - 7.490: 98.5613% ( 1) 00:15:57.103 7.490 - 7.538: 98.5685% ( 1) 00:15:57.103 7.538 - 7.585: 98.5758% ( 1) 00:15:57.103 7.633 - 7.680: 98.5831% ( 1) 00:15:57.103 7.727 - 7.775: 98.5903% ( 1) 00:15:57.103 7.775 - 7.822: 98.6121% ( 3) 00:15:57.103 7.822 - 7.870: 98.6194% ( 1) 00:15:57.103 7.870 - 7.917: 98.6412% ( 3) 00:15:57.103 7.917 - 7.964: 98.6485% ( 1) 00:15:57.103 7.964 - 8.012: 98.6557% ( 1) 00:15:57.103 8.059 - 8.107: 98.6630% ( 1) 00:15:57.103 8.107 - 8.154: 98.6703% ( 1) 00:15:57.103 8.154 - 8.201: 98.6775% ( 1) 00:15:57.103 8.201 - 8.249: 98.6921% ( 2) 00:15:57.103 8.249 - 8.296: 98.6993% ( 1) 00:15:57.103 8.296 - 8.344: 98.7284% ( 4) 00:15:57.103 8.344 - 8.391: 98.7356% ( 1) 00:15:57.103 8.439 - 8.486: 98.7502% ( 2) 00:15:57.103 8.486 - 8.533: 98.7574% ( 1) 00:15:57.103 8.533 - 8.581: 98.7647% ( 1) 00:15:57.103 8.581 - 8.628: 98.7720% ( 1) 00:15:57.103 8.770 - 8.818: 98.7865% ( 2) 00:15:57.103 8.818 - 8.865: 98.7938% ( 1) 00:15:57.103 8.865 - 8.913: 98.8010% ( 1) 00:15:57.103 8.913 - 8.960: 98.8083% ( 1) 00:15:57.103 9.055 - 9.102: 98.8156% ( 1) 00:15:57.103 9.102 - 9.150: 98.8374% ( 3) 00:15:57.103 9.150 - 9.197: 98.8446% ( 1) 00:15:57.103 9.292 - 9.339: 98.8519% ( 1) 00:15:57.103 9.339 - 9.387: 98.8592% ( 1) 00:15:57.103 9.387 - 9.434: 98.8664% ( 1) 00:15:57.103 9.434 - 9.481: 98.8737% ( 1) 00:15:57.103 9.576 - 9.624: 98.8810% ( 1) 00:15:57.103 9.671 - 9.719: 98.8955% ( 2) 00:15:57.103 9.766 - 9.813: 98.9100% ( 2) 00:15:57.103 9.861 - 9.908: 98.9246% ( 2) 00:15:57.103 9.908 - 9.956: 98.9318% ( 1) 00:15:57.103 10.050 - 10.098: 98.9391% ( 1) 00:15:57.103 10.145 - 10.193: 98.9464% ( 1) 00:15:57.103 10.240 - 10.287: 98.9536% ( 1) 00:15:57.103 10.382 - 10.430: 98.9682% ( 2) 00:15:57.103 10.572 - 10.619: 98.9754% ( 1) 00:15:57.103 10.667 - 10.714: 98.9827% ( 1) 00:15:57.103 10.809 - 10.856: 98.9900% ( 1) 00:15:57.103 11.093 - 11.141: 98.9972% ( 1) 00:15:57.103 11.236 - 11.283: 99.0045% ( 1) 00:15:57.103 11.330 - 11.378: 99.0118% ( 1) 00:15:57.103 11.520 - 11.567: 99.0263% ( 2) 00:15:57.103 11.947 - 11.994: 99.0336% ( 1) 00:15:57.103 12.326 - 12.421: 99.0481% ( 2) 00:15:57.103 12.421 - 12.516: 99.0554% ( 1) 00:15:57.103 12.516 - 12.610: 99.0626% ( 1) 00:15:57.103 12.800 - 12.895: 99.0699% ( 1) 00:15:57.103 12.895 - 12.990: 99.0772% ( 1) 00:15:57.103 12.990 - 13.084: 99.0844% ( 1) 00:15:57.103 13.464 - 13.559: 99.0917% ( 1) 00:15:57.103 13.653 - 13.748: 99.1062% ( 2) 00:15:57.103 13.843 - 13.938: 99.1135% ( 1) 00:15:57.103 13.938 - 14.033: 99.1208% ( 1) 00:15:57.103 14.033 - 14.127: 99.1280% ( 1) 00:15:57.103 14.317 - 14.412: 99.1426% ( 2) 00:15:57.103 14.412 - 14.507: 99.1498% ( 1) 00:15:57.103 14.507 - 14.601: 99.1571% ( 1) 00:15:57.103 14.886 - 14.981: 99.1644% ( 1) 00:15:57.103 15.076 - 15.170: 99.1716% ( 1) 00:15:57.103 15.170 - 15.265: 99.1789% ( 1) 00:15:57.103 16.877 - 16.972: 99.1862% ( 1) 00:15:57.103 17.067 - 17.161: 99.1934% ( 1) 00:15:57.103 17.161 - 17.256: 99.2007% ( 1) 00:15:57.103 17.256 - 17.351: 99.2152% ( 2) 00:15:57.103 17.351 - 17.446: 99.2298% ( 2) 00:15:57.103 17.446 - 17.541: 99.2443% ( 2) 00:15:57.103 17.541 - 17.636: 99.2952% ( 7) 00:15:57.103 17.636 - 17.730: 99.3242% ( 4) 00:15:57.103 17.730 - 17.825: 99.3824% ( 8) 00:15:57.103 17.825 - 17.920: 99.4260% ( 6) 00:15:57.103 17.920 - 18.015: 99.4405% ( 2) 00:15:57.103 18.015 - 18.110: 99.4768% ( 5) 00:15:57.103 18.110 - 18.204: 99.5495% ( 10) 00:15:57.103 18.204 - 18.299: 99.6221% ( 10) 00:15:57.103 18.299 - 18.394: 99.6657% ( 6) 00:15:57.103 18.394 - 18.489: 99.7093% ( 6) 00:15:57.103 18.489 - 18.584: 99.7529% ( 6) 00:15:57.103 18.584 - 18.679: 99.7747% ( 3) 00:15:57.103 18.679 - 18.773: 99.7965% ( 3) 00:15:57.103 18.773 - 18.868: 99.8183% ( 3) 00:15:57.103 18.963 - 19.058: 99.8256% ( 1) 00:15:57.103 19.058 - 19.153: 99.8329% ( 1) 00:15:57.103 19.247 - 19.342: 99.8401% ( 1) 00:15:57.103 19.342 - 19.437: 99.8474% ( 1) 00:15:57.103 19.437 - 19.532: 99.8547% ( 1) 00:15:57.103 19.721 - 19.816: 99.8619% ( 1) 00:15:57.103 23.704 - 23.799: 99.8692% ( 1) 00:15:57.103 26.359 - 26.548: 99.8765% ( 1) 00:15:57.103 26.927 - 27.117: 99.8837% ( 1) 00:15:57.103 27.117 - 27.307: 99.8910% ( 1) 00:15:57.103 29.203 - 29.393: 99.8983% ( 1) 00:15:57.103 3980.705 - 4004.978: 99.9855% ( 12) 00:15:57.103 4004.978 - 4029.250: 100.0000% ( 2) 00:15:57.103 00:15:57.103 Complete histogram 00:15:57.103 ================== 00:15:57.103 Range in us Cumulative Count 00:15:57.103 2.039 - 2.050: 0.1308% ( 18) 00:15:57.103 2.050 - 2.062: 8.1093% ( 1098) 00:15:57.103 2.062 - 2.074: 14.7871% ( 919) 00:15:57.103 2.074 - 2.086: 19.9026% ( 704) 00:15:57.103 2.086 - 2.098: 47.2024% ( 3757) 00:15:57.103 2.098 - 2.110: 58.2837% ( 1525) 00:15:57.103 2.110 - 2.121: 62.6144% ( 596) 00:15:57.103 2.121 - 2.133: 66.7999% ( 576) 00:15:57.103 2.133 - 2.145: 68.0570% ( 173) 00:15:57.103 2.145 - 2.157: 72.7583% ( 647) 00:15:57.103 2.157 - 2.169: 84.5444% ( 1622) 00:15:57.103 2.169 - 2.181: 87.8433% ( 454) 00:15:57.103 2.181 - 2.193: 89.8707% ( 279) 00:15:57.103 2.193 - 2.204: 90.9461% ( 148) 00:15:57.103 2.204 - 2.216: 91.6146% ( 92) 00:15:57.103 2.216 - 2.228: 93.4021% ( 246) 00:15:57.103 2.228 - 2.240: 94.8699% ( 202) 00:15:57.103 2.240 - 2.252: 95.3640% ( 68) 00:15:57.103 2.252 - 2.264: 95.6983% ( 46) 00:15:57.103 2.264 - 2.276: 95.8872% ( 26) 00:15:57.103 2.276 - 2.287: 96.0326% ( 20) 00:15:57.103 2.287 - 2.299: 96.2287% ( 27) 00:15:57.103 2.299 - 2.311: 96.3377% ( 15) 00:15:57.103 2.311 - 2.323: 96.3813% ( 6) 00:15:57.103 2.323 - 2.335: 96.4540% ( 10) 00:15:57.103 2.335 - 2.347: 96.5339% ( 11) 00:15:57.103 2.347 - 2.359: 96.7156% ( 25) 00:15:57.103 2.359 - 2.370: 96.9118% ( 27) 00:15:57.103 2.370 - 2.382: 97.1806% ( 37) 00:15:57.103 2.382 - 2.394: 97.4277% ( 34) 00:15:57.103 2.394 - 2.406: 97.6893% ( 36) 00:15:57.103 2.406 - 2.418: 97.8491% ( 22) 00:15:57.103 2.418 - 2.430: 98.0017% ( 21) 00:15:57.103 2.430 - 2.441: 98.1689% ( 23) 00:15:57.103 2.441 - 2.453: 98.2706% ( 14) 00:15:57.103 2.453 - 2.465: 98.3578% ( 12) 00:15:57.103 2.465 - 2.477: 98.4159% ( 8) 00:15:57.103 2.477 - 2.489: 98.4450% ( 4) 00:15:57.103 2.489 - 2.501: 98.4741% ( 4) 00:15:57.103 2.501 - 2.513: 98.5031% ( 4) 00:15:57.103 2.513 - 2.524: 98.5104% ( 1) 00:15:57.103 2.524 - 2.536: 98.5177% ( 1) 00:15:57.103 2.560 - 2.572: 98.5322% ( 2) 00:15:57.103 2.572 - 2.584: 98.5395% ( 1) 00:15:57.103 2.596 - 2.607: 98.5467% ( 1) 00:15:57.103 2.607 - 2.619: 98.5613% ( 2) 00:15:57.103 2.655 - 2.667: 98.5685% ( 1) 00:15:57.103 2.679 - 2.690: 98.5758% ( 1) 00:15:57.103 2.714 - 2.726: 98.5831% ( 1) 00:15:57.103 2.750 - 2.761: 98.5903% ( 1) 00:15:57.103 3.247 - 3.271: 98.5976% ( 1) 00:15:57.103 3.295 - 3.319: 98.6121% ( 2) 00:15:57.103 3.319 - 3.342: 98.6194% ( 1) 00:15:57.103 3.413 - 3.437: 98.6339% ( 2) 00:15:57.103 3.461 - 3.484: 98.6485% ( 2) 00:15:57.103 3.484 - 3.508: 98.6703% ( 3) 00:15:57.103 3.508 - 3.532: 98.6921% ( 3) 00:15:57.103 3.556 - 3.579: 98.7138% ( 3) 00:15:57.103 3.579 - 3.603: 98.7211% ( 1) 00:15:57.103 3.603 - 3.627: 98.7429% ( 3) 00:15:57.103 3.627 - 3.650: 98.7502% ( 1) 00:15:57.103 3.650 - 3.674: 98.7792% ( 4) 00:15:57.103 3.674 - 3.698: 98.7865% ( 1) 00:15:57.103 3.721 - 3.745: 98.7938% ( 1) 00:15:57.103 3.793 - 3.816: 98.8010% ( 1) 00:15:57.103 3.840 - 3.864: 98.8156% ( 2) 00:15:57.103 3.887 - 3.911: 98.8228% ( 1) 00:15:57.103 3.911 - 3.935: 98.8374% ( 2) 00:15:57.103 5.594 - 5.618: 98.8446% ( 1) 00:15:57.103 5.879 - 5.902: 98.8519% ( 1) 00:15:57.103 5.950 - 5.973: 98.8592% ( 1) 00:15:57.103 6.258 - 6.305: 98.8664% ( 1) 00:15:57.103 6.305 - 6.353: 98.8810% ( 2) 00:15:57.103 6.732 - 6.779: 98.8882% ( 1) 00:15:57.103 6.779 - 6.827: 98.8955% ( 1) 00:15:57.103 6.969 - 7.016: 98.9028% ( 1) 00:15:57.103 7.064 - 7.111: 98.9100% ( 1) 00:15:57.103 7.206 - 7.253: 98.9173% ( 1) 00:15:57.103 7.253 - 7.301: 98.9246% ( 1) 00:15:57.103 7.348 - 7.396: 98.9318% ( 1) 00:15:57.103 7.443 - 7.490: 98.9391% ( 1) 00:15:57.103 7.490 - 7.538: 98.9464% ( 1) 00:15:57.103 7.585 - 7.633: 98.9536% ( 1) 00:15:57.103 7.633 - 7.680: 98.9754% ( 3) 00:15:57.104 7.870 - 7.917: 98.9827% ( 1) 00:15:57.104 7.964 - 8.012: 98.9900% ( 1) 00:15:57.104 8.391 - 8.439: 98.9972% ( 1) 00:15:57.104 8.486 - 8.533: 99.0045% ( 1) 00:15:57.104 8.676 - 8.723: 99.0118% ( 1) 00:15:57.104 13.559 - 13.653: 99.0190% ( 1) 00:15:57.104 15.360 - 15.455: 99.0263% ( 1) 00:15:57.104 15.455 - 15.550: 99.0481% ( 3) 00:15:57.104 15.644 - 15.739: 99.0626% ( 2) 00:15:57.104 15.739 - 15.834: 99.0772% ( 2) 00:15:57.104 15.834 - 15.929: 99.1135% ( 5) 00:15:57.104 15.929 - 16.024: 99.1208% ( 1) 00:15:57.104 16.024 - 16.119: 99.1644% ( 6) 00:15:57.104 16.119 - 16.213: 99.1862% ( 3) 00:15:57.104 16.213 - 16.308: 99.2080% ( 3) 00:15:57.104 16.308 - 16.403: 99.2370% ( 4) 00:15:57.104 16.403 - 16.498: 99.2661% ( 4) 00:15:57.104 16.498 - 16.593: 99.2952% ( 4) 00:15:57.104 16.593 - 16.687: 99.3170% ( 3) 00:15:57.104 16.687 - 16.782: 99.3388% ( 3) 00:15:57.104 16.782 - 16.877: 99.3751% ( 5) 00:15:57.104 16.877 - 16.972: 99.3824% ( 1) 00:15:57.104 16.972 - 17.067: 99.4042% ( 3) 00:15:57.104 17.067 - 17.161: 99.4114% ( 1) 00:15:57.104 17.161 - 17.256: 99.4187% ( 1) 00:15:57.104 17.351 - 17.446: 99.4332% ( 2) 00:15:57.104 17.541 - 17.636: 99.4405% ( 1) 00:15:57.104 17.636 - 17.730: 99.4478% ( 1) 00:15:57.104 17.730 - 17.825: 99.4550% ( 1) 00:15:57.104 25.031 - 25.221: 99.4623% ( 1) 00:15:57.104 28.634 - 28.824: 99.4696% ( 1) 00:15:57.104 3980.705 - 4004.978: 99.8983% ( 59) 00:15:57.104 4004.978 - 4029.250: 100.0000% ( 14) 00:15:57.104 00:15:57.104 15:59:46 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:15:57.104 15:59:46 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:57.104 15:59:46 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:15:57.104 15:59:46 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:15:57.104 15:59:46 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:57.362 [ 00:15:57.362 { 00:15:57.362 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:57.362 "subtype": "Discovery", 00:15:57.362 "listen_addresses": [], 00:15:57.362 "allow_any_host": true, 00:15:57.362 "hosts": [] 00:15:57.362 }, 00:15:57.362 { 00:15:57.362 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:57.362 "subtype": "NVMe", 00:15:57.362 "listen_addresses": [ 00:15:57.362 { 00:15:57.362 "transport": "VFIOUSER", 00:15:57.362 "trtype": "VFIOUSER", 00:15:57.362 "adrfam": "IPv4", 00:15:57.362 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:57.362 "trsvcid": "0" 00:15:57.362 } 00:15:57.362 ], 00:15:57.362 "allow_any_host": true, 00:15:57.362 "hosts": [], 00:15:57.362 "serial_number": "SPDK1", 00:15:57.362 "model_number": "SPDK bdev Controller", 00:15:57.362 "max_namespaces": 32, 00:15:57.362 "min_cntlid": 1, 00:15:57.362 "max_cntlid": 65519, 00:15:57.362 "namespaces": [ 00:15:57.362 { 00:15:57.362 "nsid": 1, 00:15:57.362 "bdev_name": "Malloc1", 00:15:57.362 "name": "Malloc1", 00:15:57.362 "nguid": "7B9B13A0299845CB97B9E38761ACE33B", 00:15:57.362 "uuid": "7b9b13a0-2998-45cb-97b9-e38761ace33b" 00:15:57.362 }, 00:15:57.362 { 00:15:57.362 "nsid": 2, 00:15:57.362 "bdev_name": "Malloc3", 00:15:57.362 "name": "Malloc3", 00:15:57.362 "nguid": "6E1EDF14DEC94B82BBE07C05A2F3685C", 00:15:57.362 "uuid": "6e1edf14-dec9-4b82-bbe0-7c05a2f3685c" 00:15:57.362 } 00:15:57.362 ] 00:15:57.362 }, 00:15:57.362 { 00:15:57.362 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:57.362 "subtype": "NVMe", 00:15:57.362 "listen_addresses": [ 00:15:57.362 { 00:15:57.362 "transport": "VFIOUSER", 00:15:57.362 "trtype": "VFIOUSER", 00:15:57.362 "adrfam": "IPv4", 00:15:57.362 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:57.362 "trsvcid": "0" 00:15:57.362 } 00:15:57.362 ], 00:15:57.362 "allow_any_host": true, 00:15:57.362 "hosts": [], 00:15:57.362 "serial_number": "SPDK2", 00:15:57.362 "model_number": "SPDK bdev Controller", 00:15:57.362 "max_namespaces": 32, 00:15:57.362 "min_cntlid": 1, 00:15:57.362 "max_cntlid": 65519, 00:15:57.362 "namespaces": [ 00:15:57.362 { 00:15:57.362 "nsid": 1, 00:15:57.362 "bdev_name": "Malloc2", 00:15:57.362 "name": "Malloc2", 00:15:57.362 "nguid": "14AFA5E04CC240E6B7F7108EF131393C", 00:15:57.362 "uuid": "14afa5e0-4cc2-40e6-b7f7-108ef131393c" 00:15:57.362 } 00:15:57.362 ] 00:15:57.362 } 00:15:57.362 ] 00:15:57.362 15:59:47 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:57.362 15:59:47 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2396360 00:15:57.362 15:59:47 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:15:57.362 15:59:47 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:57.362 15:59:47 -- common/autotest_common.sh@1244 -- # local i=0 00:15:57.362 15:59:47 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:57.362 15:59:47 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:57.362 15:59:47 -- common/autotest_common.sh@1255 -- # return 0 00:15:57.362 15:59:47 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:57.362 15:59:47 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:15:57.362 EAL: No free 2048 kB hugepages reported on node 1 00:15:57.620 Malloc4 00:15:57.620 15:59:47 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:15:57.877 15:59:47 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:57.877 Asynchronous Event Request test 00:15:57.877 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:57.877 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:57.877 Registering asynchronous event callbacks... 00:15:57.877 Starting namespace attribute notice tests for all controllers... 00:15:57.877 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:57.877 aer_cb - Changed Namespace 00:15:57.877 Cleaning up... 00:15:58.135 [ 00:15:58.135 { 00:15:58.135 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:58.135 "subtype": "Discovery", 00:15:58.135 "listen_addresses": [], 00:15:58.135 "allow_any_host": true, 00:15:58.135 "hosts": [] 00:15:58.135 }, 00:15:58.135 { 00:15:58.135 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:58.135 "subtype": "NVMe", 00:15:58.135 "listen_addresses": [ 00:15:58.135 { 00:15:58.135 "transport": "VFIOUSER", 00:15:58.135 "trtype": "VFIOUSER", 00:15:58.135 "adrfam": "IPv4", 00:15:58.135 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:58.135 "trsvcid": "0" 00:15:58.135 } 00:15:58.135 ], 00:15:58.135 "allow_any_host": true, 00:15:58.135 "hosts": [], 00:15:58.135 "serial_number": "SPDK1", 00:15:58.135 "model_number": "SPDK bdev Controller", 00:15:58.135 "max_namespaces": 32, 00:15:58.135 "min_cntlid": 1, 00:15:58.135 "max_cntlid": 65519, 00:15:58.135 "namespaces": [ 00:15:58.135 { 00:15:58.135 "nsid": 1, 00:15:58.135 "bdev_name": "Malloc1", 00:15:58.135 "name": "Malloc1", 00:15:58.135 "nguid": "7B9B13A0299845CB97B9E38761ACE33B", 00:15:58.135 "uuid": "7b9b13a0-2998-45cb-97b9-e38761ace33b" 00:15:58.135 }, 00:15:58.135 { 00:15:58.135 "nsid": 2, 00:15:58.135 "bdev_name": "Malloc3", 00:15:58.135 "name": "Malloc3", 00:15:58.135 "nguid": "6E1EDF14DEC94B82BBE07C05A2F3685C", 00:15:58.135 "uuid": "6e1edf14-dec9-4b82-bbe0-7c05a2f3685c" 00:15:58.135 } 00:15:58.135 ] 00:15:58.135 }, 00:15:58.135 { 00:15:58.135 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:58.135 "subtype": "NVMe", 00:15:58.135 "listen_addresses": [ 00:15:58.135 { 00:15:58.135 "transport": "VFIOUSER", 00:15:58.135 "trtype": "VFIOUSER", 00:15:58.135 "adrfam": "IPv4", 00:15:58.135 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:58.135 "trsvcid": "0" 00:15:58.135 } 00:15:58.135 ], 00:15:58.135 "allow_any_host": true, 00:15:58.135 "hosts": [], 00:15:58.135 "serial_number": "SPDK2", 00:15:58.135 "model_number": "SPDK bdev Controller", 00:15:58.135 "max_namespaces": 32, 00:15:58.135 "min_cntlid": 1, 00:15:58.135 "max_cntlid": 65519, 00:15:58.135 "namespaces": [ 00:15:58.135 { 00:15:58.135 "nsid": 1, 00:15:58.135 "bdev_name": "Malloc2", 00:15:58.135 "name": "Malloc2", 00:15:58.135 "nguid": "14AFA5E04CC240E6B7F7108EF131393C", 00:15:58.135 "uuid": "14afa5e0-4cc2-40e6-b7f7-108ef131393c" 00:15:58.135 }, 00:15:58.135 { 00:15:58.136 "nsid": 2, 00:15:58.136 "bdev_name": "Malloc4", 00:15:58.136 "name": "Malloc4", 00:15:58.136 "nguid": "442CBDDE790B45D48BC73793CDB72462", 00:15:58.136 "uuid": "442cbdde-790b-45d4-8bc7-3793cdb72462" 00:15:58.136 } 00:15:58.136 ] 00:15:58.136 } 00:15:58.136 ] 00:15:58.136 15:59:47 -- target/nvmf_vfio_user.sh@44 -- # wait 2396360 00:15:58.136 15:59:47 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:15:58.136 15:59:47 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2390590 00:15:58.136 15:59:47 -- common/autotest_common.sh@926 -- # '[' -z 2390590 ']' 00:15:58.136 15:59:47 -- common/autotest_common.sh@930 -- # kill -0 2390590 00:15:58.136 15:59:47 -- common/autotest_common.sh@931 -- # uname 00:15:58.136 15:59:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:58.136 15:59:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2390590 00:15:58.136 15:59:48 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:58.136 15:59:48 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:58.136 15:59:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2390590' 00:15:58.136 killing process with pid 2390590 00:15:58.136 15:59:48 -- common/autotest_common.sh@945 -- # kill 2390590 00:15:58.136 [2024-10-30 15:59:48.013497] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:15:58.136 15:59:48 -- common/autotest_common.sh@950 -- # wait 2390590 00:15:58.702 15:59:48 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:15:58.702 15:59:48 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:15:58.702 15:59:48 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:15:58.702 15:59:48 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:15:58.702 15:59:48 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:15:58.702 15:59:48 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2396512 00:15:58.702 15:59:48 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:15:58.702 15:59:48 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2396512' 00:15:58.702 Process pid: 2396512 00:15:58.702 15:59:48 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:58.702 15:59:48 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2396512 00:15:58.702 15:59:48 -- common/autotest_common.sh@819 -- # '[' -z 2396512 ']' 00:15:58.702 15:59:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:58.702 15:59:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:58.702 15:59:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:58.702 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:58.702 15:59:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:58.702 15:59:48 -- common/autotest_common.sh@10 -- # set +x 00:15:58.702 [2024-10-30 15:59:48.401467] thread.c:2927:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:15:58.702 [2024-10-30 15:59:48.402481] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:15:58.703 [2024-10-30 15:59:48.402541] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:58.703 EAL: No free 2048 kB hugepages reported on node 1 00:15:58.703 [2024-10-30 15:59:48.466336] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:58.703 [2024-10-30 15:59:48.553145] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:58.703 [2024-10-30 15:59:48.553324] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:58.703 [2024-10-30 15:59:48.553345] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:58.703 [2024-10-30 15:59:48.553359] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:58.703 [2024-10-30 15:59:48.553420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:58.703 [2024-10-30 15:59:48.553480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:58.703 [2024-10-30 15:59:48.553598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:58.703 [2024-10-30 15:59:48.553601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:58.961 [2024-10-30 15:59:48.658555] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:15:58.961 [2024-10-30 15:59:48.658812] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:15:58.961 [2024-10-30 15:59:48.659104] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:15:58.961 [2024-10-30 15:59:48.659825] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:15:58.961 [2024-10-30 15:59:48.659935] thread.c:2085:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:15:59.526 15:59:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:59.526 15:59:49 -- common/autotest_common.sh@852 -- # return 0 00:15:59.526 15:59:49 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:00.896 15:59:50 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:16:00.896 15:59:50 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:00.896 15:59:50 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:00.896 15:59:50 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:00.896 15:59:50 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:00.896 15:59:50 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:01.155 Malloc1 00:16:01.155 15:59:50 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:01.413 15:59:51 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:01.720 15:59:51 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:02.009 15:59:51 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:02.009 15:59:51 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:02.009 15:59:51 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:02.267 Malloc2 00:16:02.268 15:59:51 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:02.525 15:59:52 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:02.783 15:59:52 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:03.041 15:59:52 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:03.041 15:59:52 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2396512 00:16:03.041 15:59:52 -- common/autotest_common.sh@926 -- # '[' -z 2396512 ']' 00:16:03.041 15:59:52 -- common/autotest_common.sh@930 -- # kill -0 2396512 00:16:03.041 15:59:52 -- common/autotest_common.sh@931 -- # uname 00:16:03.041 15:59:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:03.041 15:59:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2396512 00:16:03.041 15:59:52 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:03.041 15:59:52 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:03.041 15:59:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2396512' 00:16:03.041 killing process with pid 2396512 00:16:03.041 15:59:52 -- common/autotest_common.sh@945 -- # kill 2396512 00:16:03.041 15:59:52 -- common/autotest_common.sh@950 -- # wait 2396512 00:16:03.300 15:59:53 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:03.300 15:59:53 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:03.300 00:16:03.300 real 0m53.862s 00:16:03.300 user 3m33.150s 00:16:03.300 sys 0m4.477s 00:16:03.300 15:59:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:03.300 15:59:53 -- common/autotest_common.sh@10 -- # set +x 00:16:03.300 ************************************ 00:16:03.300 END TEST nvmf_vfio_user 00:16:03.300 ************************************ 00:16:03.300 15:59:53 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:03.300 15:59:53 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:03.300 15:59:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:03.300 15:59:53 -- common/autotest_common.sh@10 -- # set +x 00:16:03.300 ************************************ 00:16:03.300 START TEST nvmf_vfio_user_nvme_compliance 00:16:03.300 ************************************ 00:16:03.300 15:59:53 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:03.300 * Looking for test storage... 00:16:03.300 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:03.300 15:59:53 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:03.300 15:59:53 -- nvmf/common.sh@7 -- # uname -s 00:16:03.300 15:59:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:03.300 15:59:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:03.300 15:59:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:03.300 15:59:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:03.300 15:59:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:03.300 15:59:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:03.300 15:59:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:03.300 15:59:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:03.300 15:59:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:03.300 15:59:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:03.300 15:59:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:03.300 15:59:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:03.300 15:59:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:03.300 15:59:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:03.300 15:59:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:03.300 15:59:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:03.300 15:59:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:03.300 15:59:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:03.300 15:59:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:03.300 15:59:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:03.300 15:59:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:03.300 15:59:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:03.300 15:59:53 -- paths/export.sh@5 -- # export PATH 00:16:03.300 15:59:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:03.300 15:59:53 -- nvmf/common.sh@46 -- # : 0 00:16:03.300 15:59:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:03.300 15:59:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:03.300 15:59:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:03.301 15:59:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:03.301 15:59:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:03.301 15:59:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:03.301 15:59:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:03.301 15:59:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:03.301 15:59:53 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:03.301 15:59:53 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:03.301 15:59:53 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:03.301 15:59:53 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:03.301 15:59:53 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:03.301 15:59:53 -- compliance/compliance.sh@20 -- # nvmfpid=2397133 00:16:03.301 15:59:53 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:03.301 15:59:53 -- compliance/compliance.sh@21 -- # echo 'Process pid: 2397133' 00:16:03.301 Process pid: 2397133 00:16:03.301 15:59:53 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:03.301 15:59:53 -- compliance/compliance.sh@24 -- # waitforlisten 2397133 00:16:03.301 15:59:53 -- common/autotest_common.sh@819 -- # '[' -z 2397133 ']' 00:16:03.301 15:59:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:03.301 15:59:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:03.301 15:59:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:03.301 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:03.301 15:59:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:03.301 15:59:53 -- common/autotest_common.sh@10 -- # set +x 00:16:03.301 [2024-10-30 15:59:53.152737] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:16:03.301 [2024-10-30 15:59:53.152824] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:03.559 EAL: No free 2048 kB hugepages reported on node 1 00:16:03.559 [2024-10-30 15:59:53.222937] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:03.559 [2024-10-30 15:59:53.308442] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:03.559 [2024-10-30 15:59:53.308602] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:03.559 [2024-10-30 15:59:53.308620] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:03.559 [2024-10-30 15:59:53.308632] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:03.559 [2024-10-30 15:59:53.308697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:03.559 [2024-10-30 15:59:53.308769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:03.559 [2024-10-30 15:59:53.308772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:04.493 15:59:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:04.493 15:59:54 -- common/autotest_common.sh@852 -- # return 0 00:16:04.493 15:59:54 -- compliance/compliance.sh@26 -- # sleep 1 00:16:05.425 15:59:55 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:05.425 15:59:55 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:05.425 15:59:55 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:05.425 15:59:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:05.425 15:59:55 -- common/autotest_common.sh@10 -- # set +x 00:16:05.425 15:59:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:05.425 15:59:55 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:05.425 15:59:55 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:05.425 15:59:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:05.425 15:59:55 -- common/autotest_common.sh@10 -- # set +x 00:16:05.425 malloc0 00:16:05.425 15:59:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:05.425 15:59:55 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:05.425 15:59:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:05.425 15:59:55 -- common/autotest_common.sh@10 -- # set +x 00:16:05.425 15:59:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:05.425 15:59:55 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:05.425 15:59:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:05.425 15:59:55 -- common/autotest_common.sh@10 -- # set +x 00:16:05.425 15:59:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:05.425 15:59:55 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:05.425 15:59:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:05.425 15:59:55 -- common/autotest_common.sh@10 -- # set +x 00:16:05.425 15:59:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:05.425 15:59:55 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:05.425 EAL: No free 2048 kB hugepages reported on node 1 00:16:05.425 00:16:05.425 00:16:05.425 CUnit - A unit testing framework for C - Version 2.1-3 00:16:05.425 http://cunit.sourceforge.net/ 00:16:05.425 00:16:05.425 00:16:05.425 Suite: nvme_compliance 00:16:05.683 Test: admin_identify_ctrlr_verify_dptr ...[2024-10-30 15:59:55.344253] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:05.683 [2024-10-30 15:59:55.344316] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:05.683 [2024-10-30 15:59:55.344344] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:05.683 passed 00:16:05.683 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:05.941 Test: admin_identify_ns ...[2024-10-30 15:59:55.582275] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:05.941 [2024-10-30 15:59:55.590271] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:05.941 passed 00:16:05.941 Test: admin_get_features_mandatory_features ...passed 00:16:05.941 Test: admin_get_features_optional_features ...passed 00:16:06.200 Test: admin_set_features_number_of_queues ...passed 00:16:06.457 Test: admin_get_log_page_mandatory_logs ...passed 00:16:06.457 Test: admin_get_log_page_with_lpo ...[2024-10-30 15:59:56.216273] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:06.457 passed 00:16:06.715 Test: fabric_property_get ...passed 00:16:06.715 Test: admin_delete_io_sq_use_admin_qid ...[2024-10-30 15:59:56.399911] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:06.715 passed 00:16:06.715 Test: admin_delete_io_sq_delete_sq_twice ...[2024-10-30 15:59:56.568283] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:06.715 [2024-10-30 15:59:56.584282] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:06.973 passed 00:16:06.973 Test: admin_delete_io_cq_use_admin_qid ...[2024-10-30 15:59:56.672777] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:06.973 passed 00:16:06.973 Test: admin_delete_io_cq_delete_cq_first ...[2024-10-30 15:59:56.834296] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:07.231 [2024-10-30 15:59:56.858264] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:07.231 passed 00:16:07.231 Test: admin_create_io_cq_verify_iv_pc ...[2024-10-30 15:59:56.946810] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:07.231 [2024-10-30 15:59:56.946866] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:07.231 passed 00:16:07.489 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-10-30 15:59:57.125268] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:07.489 [2024-10-30 15:59:57.133284] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:07.489 [2024-10-30 15:59:57.141277] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:07.489 [2024-10-30 15:59:57.149277] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:07.489 passed 00:16:07.489 Test: admin_create_io_sq_verify_pc ...[2024-10-30 15:59:57.278282] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:07.489 passed 00:16:08.864 Test: admin_create_io_qp_max_qps ...[2024-10-30 15:59:58.478275] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:09.121 passed 00:16:09.380 Test: admin_create_io_sq_shared_cq ...[2024-10-30 15:59:59.082295] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:09.380 passed 00:16:09.380 00:16:09.380 Run Summary: Type Total Ran Passed Failed Inactive 00:16:09.380 suites 1 1 n/a 0 0 00:16:09.380 tests 18 18 18 0 0 00:16:09.380 asserts 360 360 360 0 n/a 00:16:09.380 00:16:09.380 Elapsed time = 1.568 seconds 00:16:09.380 15:59:59 -- compliance/compliance.sh@42 -- # killprocess 2397133 00:16:09.380 15:59:59 -- common/autotest_common.sh@926 -- # '[' -z 2397133 ']' 00:16:09.380 15:59:59 -- common/autotest_common.sh@930 -- # kill -0 2397133 00:16:09.380 15:59:59 -- common/autotest_common.sh@931 -- # uname 00:16:09.380 15:59:59 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:09.380 15:59:59 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2397133 00:16:09.380 15:59:59 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:09.380 15:59:59 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:09.380 15:59:59 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2397133' 00:16:09.380 killing process with pid 2397133 00:16:09.380 15:59:59 -- common/autotest_common.sh@945 -- # kill 2397133 00:16:09.380 15:59:59 -- common/autotest_common.sh@950 -- # wait 2397133 00:16:09.640 15:59:59 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:09.640 15:59:59 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:09.640 00:16:09.640 real 0m6.407s 00:16:09.640 user 0m18.370s 00:16:09.640 sys 0m0.550s 00:16:09.640 15:59:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:09.640 15:59:59 -- common/autotest_common.sh@10 -- # set +x 00:16:09.640 ************************************ 00:16:09.640 END TEST nvmf_vfio_user_nvme_compliance 00:16:09.640 ************************************ 00:16:09.640 15:59:59 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:09.640 15:59:59 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:09.640 15:59:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:09.640 15:59:59 -- common/autotest_common.sh@10 -- # set +x 00:16:09.640 ************************************ 00:16:09.640 START TEST nvmf_vfio_user_fuzz 00:16:09.640 ************************************ 00:16:09.640 15:59:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:09.900 * Looking for test storage... 00:16:09.900 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:09.900 15:59:59 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:09.900 15:59:59 -- nvmf/common.sh@7 -- # uname -s 00:16:09.900 15:59:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:09.900 15:59:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:09.900 15:59:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:09.900 15:59:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:09.900 15:59:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:09.900 15:59:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:09.900 15:59:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:09.900 15:59:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:09.901 15:59:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:09.901 15:59:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:09.901 15:59:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:09.901 15:59:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:09.901 15:59:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:09.901 15:59:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:09.901 15:59:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:09.901 15:59:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:09.901 15:59:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:09.901 15:59:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:09.901 15:59:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:09.901 15:59:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:09.901 15:59:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:09.901 15:59:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:09.901 15:59:59 -- paths/export.sh@5 -- # export PATH 00:16:09.901 15:59:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:09.901 15:59:59 -- nvmf/common.sh@46 -- # : 0 00:16:09.901 15:59:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:09.901 15:59:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:09.901 15:59:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:09.901 15:59:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:09.901 15:59:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:09.901 15:59:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:09.901 15:59:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:09.901 15:59:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:09.901 15:59:59 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:09.901 15:59:59 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:09.901 15:59:59 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:09.901 15:59:59 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:09.901 15:59:59 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:09.901 15:59:59 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:09.901 15:59:59 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:09.901 15:59:59 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=2398006 00:16:09.901 15:59:59 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:09.901 15:59:59 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 2398006' 00:16:09.901 Process pid: 2398006 00:16:09.901 15:59:59 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:09.901 15:59:59 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 2398006 00:16:09.901 15:59:59 -- common/autotest_common.sh@819 -- # '[' -z 2398006 ']' 00:16:09.901 15:59:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:09.901 15:59:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:09.901 15:59:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:09.901 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:09.901 15:59:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:09.901 15:59:59 -- common/autotest_common.sh@10 -- # set +x 00:16:10.834 16:00:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:10.834 16:00:00 -- common/autotest_common.sh@852 -- # return 0 00:16:10.834 16:00:00 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:11.769 16:00:01 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:11.769 16:00:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:11.769 16:00:01 -- common/autotest_common.sh@10 -- # set +x 00:16:11.769 16:00:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:11.769 16:00:01 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:11.769 16:00:01 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:11.769 16:00:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:11.769 16:00:01 -- common/autotest_common.sh@10 -- # set +x 00:16:11.769 malloc0 00:16:11.769 16:00:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:11.769 16:00:01 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:11.769 16:00:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:11.769 16:00:01 -- common/autotest_common.sh@10 -- # set +x 00:16:11.769 16:00:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:11.769 16:00:01 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:11.769 16:00:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:11.769 16:00:01 -- common/autotest_common.sh@10 -- # set +x 00:16:12.027 16:00:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:12.028 16:00:01 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:12.028 16:00:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:12.028 16:00:01 -- common/autotest_common.sh@10 -- # set +x 00:16:12.028 16:00:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:12.028 16:00:01 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:12.028 16:00:01 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:16:44.096 Fuzzing completed. Shutting down the fuzz application 00:16:44.096 00:16:44.096 Dumping successful admin opcodes: 00:16:44.096 8, 9, 10, 24, 00:16:44.096 Dumping successful io opcodes: 00:16:44.096 0, 00:16:44.096 NS: 0x200003a1ef00 I/O qp, Total commands completed: 547910, total successful commands: 2106, random_seed: 2859063232 00:16:44.096 NS: 0x200003a1ef00 admin qp, Total commands completed: 136320, total successful commands: 1108, random_seed: 3066437248 00:16:44.096 16:00:32 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:16:44.096 16:00:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:44.096 16:00:32 -- common/autotest_common.sh@10 -- # set +x 00:16:44.096 16:00:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:44.096 16:00:32 -- target/vfio_user_fuzz.sh@46 -- # killprocess 2398006 00:16:44.096 16:00:32 -- common/autotest_common.sh@926 -- # '[' -z 2398006 ']' 00:16:44.096 16:00:32 -- common/autotest_common.sh@930 -- # kill -0 2398006 00:16:44.096 16:00:32 -- common/autotest_common.sh@931 -- # uname 00:16:44.096 16:00:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:44.096 16:00:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2398006 00:16:44.096 16:00:32 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:44.096 16:00:32 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:44.096 16:00:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2398006' 00:16:44.096 killing process with pid 2398006 00:16:44.096 16:00:32 -- common/autotest_common.sh@945 -- # kill 2398006 00:16:44.096 16:00:32 -- common/autotest_common.sh@950 -- # wait 2398006 00:16:44.096 16:00:32 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:16:44.096 16:00:32 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:16:44.096 00:16:44.096 real 0m33.368s 00:16:44.096 user 0m33.991s 00:16:44.096 sys 0m25.560s 00:16:44.096 16:00:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:44.096 16:00:32 -- common/autotest_common.sh@10 -- # set +x 00:16:44.096 ************************************ 00:16:44.096 END TEST nvmf_vfio_user_fuzz 00:16:44.096 ************************************ 00:16:44.096 16:00:32 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:44.096 16:00:32 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:44.096 16:00:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:44.096 16:00:32 -- common/autotest_common.sh@10 -- # set +x 00:16:44.096 ************************************ 00:16:44.096 START TEST nvmf_host_management 00:16:44.096 ************************************ 00:16:44.096 16:00:32 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:44.096 * Looking for test storage... 00:16:44.096 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:44.096 16:00:32 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:44.096 16:00:32 -- nvmf/common.sh@7 -- # uname -s 00:16:44.096 16:00:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:44.096 16:00:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:44.096 16:00:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:44.096 16:00:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:44.096 16:00:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:44.096 16:00:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:44.096 16:00:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:44.096 16:00:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:44.096 16:00:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:44.096 16:00:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:44.096 16:00:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:44.096 16:00:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:44.096 16:00:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:44.096 16:00:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:44.096 16:00:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:44.096 16:00:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:44.096 16:00:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:44.096 16:00:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:44.096 16:00:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:44.096 16:00:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.096 16:00:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.096 16:00:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.096 16:00:32 -- paths/export.sh@5 -- # export PATH 00:16:44.096 16:00:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.096 16:00:32 -- nvmf/common.sh@46 -- # : 0 00:16:44.096 16:00:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:44.096 16:00:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:44.096 16:00:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:44.096 16:00:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:44.096 16:00:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:44.096 16:00:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:44.096 16:00:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:44.096 16:00:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:44.096 16:00:32 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:44.096 16:00:32 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:44.096 16:00:32 -- target/host_management.sh@104 -- # nvmftestinit 00:16:44.096 16:00:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:44.096 16:00:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:44.096 16:00:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:44.096 16:00:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:44.096 16:00:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:44.097 16:00:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:44.097 16:00:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:44.097 16:00:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:44.097 16:00:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:44.097 16:00:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:44.097 16:00:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:44.097 16:00:32 -- common/autotest_common.sh@10 -- # set +x 00:16:45.471 16:00:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:45.471 16:00:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:45.471 16:00:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:45.471 16:00:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:45.471 16:00:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:45.471 16:00:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:45.471 16:00:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:45.471 16:00:34 -- nvmf/common.sh@294 -- # net_devs=() 00:16:45.471 16:00:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:45.471 16:00:34 -- nvmf/common.sh@295 -- # e810=() 00:16:45.471 16:00:34 -- nvmf/common.sh@295 -- # local -ga e810 00:16:45.471 16:00:34 -- nvmf/common.sh@296 -- # x722=() 00:16:45.471 16:00:34 -- nvmf/common.sh@296 -- # local -ga x722 00:16:45.471 16:00:34 -- nvmf/common.sh@297 -- # mlx=() 00:16:45.471 16:00:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:45.471 16:00:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:45.471 16:00:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:45.471 16:00:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:45.471 16:00:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:45.471 16:00:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:45.471 16:00:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:45.471 16:00:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:45.471 16:00:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:45.471 16:00:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:45.471 16:00:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:45.471 16:00:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:45.471 16:00:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:45.471 16:00:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:45.471 16:00:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:45.471 16:00:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:45.471 16:00:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:45.471 16:00:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:45.471 16:00:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:45.471 16:00:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:45.471 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:45.471 16:00:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:45.471 16:00:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:45.471 16:00:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:45.471 16:00:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:45.471 16:00:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:45.472 16:00:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:45.472 16:00:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:45.472 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:45.472 16:00:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:45.472 16:00:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:45.472 16:00:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:45.472 16:00:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:45.472 16:00:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:45.472 16:00:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:45.472 16:00:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:45.472 16:00:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:45.472 16:00:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:45.472 16:00:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:45.472 16:00:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:45.472 16:00:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:45.472 16:00:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:45.472 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:45.472 16:00:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:45.472 16:00:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:45.472 16:00:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:45.472 16:00:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:45.472 16:00:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:45.472 16:00:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:45.472 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:45.472 16:00:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:45.472 16:00:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:45.472 16:00:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:45.472 16:00:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:45.472 16:00:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:45.472 16:00:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:45.472 16:00:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:45.472 16:00:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:45.472 16:00:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:45.472 16:00:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:45.472 16:00:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:45.472 16:00:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:45.472 16:00:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:45.472 16:00:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:45.472 16:00:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:45.472 16:00:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:45.472 16:00:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:45.472 16:00:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:45.472 16:00:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:45.472 16:00:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:45.472 16:00:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:45.472 16:00:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:45.472 16:00:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:45.472 16:00:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:45.472 16:00:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:45.472 16:00:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:45.472 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:45.472 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.168 ms 00:16:45.472 00:16:45.472 --- 10.0.0.2 ping statistics --- 00:16:45.472 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:45.472 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:16:45.472 16:00:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:45.472 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:45.472 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.085 ms 00:16:45.472 00:16:45.472 --- 10.0.0.1 ping statistics --- 00:16:45.472 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:45.472 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:16:45.472 16:00:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:45.472 16:00:35 -- nvmf/common.sh@410 -- # return 0 00:16:45.472 16:00:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:45.472 16:00:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:45.472 16:00:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:45.472 16:00:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:45.472 16:00:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:45.472 16:00:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:45.472 16:00:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:45.472 16:00:35 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:16:45.472 16:00:35 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:16:45.472 16:00:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:45.472 16:00:35 -- common/autotest_common.sh@10 -- # set +x 00:16:45.472 ************************************ 00:16:45.472 START TEST nvmf_host_management 00:16:45.472 ************************************ 00:16:45.472 16:00:35 -- common/autotest_common.sh@1104 -- # nvmf_host_management 00:16:45.472 16:00:35 -- target/host_management.sh@69 -- # starttarget 00:16:45.472 16:00:35 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:16:45.472 16:00:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:45.472 16:00:35 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:45.472 16:00:35 -- common/autotest_common.sh@10 -- # set +x 00:16:45.472 16:00:35 -- nvmf/common.sh@469 -- # nvmfpid=2404343 00:16:45.472 16:00:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:16:45.472 16:00:35 -- nvmf/common.sh@470 -- # waitforlisten 2404343 00:16:45.472 16:00:35 -- common/autotest_common.sh@819 -- # '[' -z 2404343 ']' 00:16:45.472 16:00:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:45.472 16:00:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:45.472 16:00:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:45.472 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:45.472 16:00:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:45.472 16:00:35 -- common/autotest_common.sh@10 -- # set +x 00:16:45.472 [2024-10-30 16:00:35.152582] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:16:45.472 [2024-10-30 16:00:35.152677] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:45.472 EAL: No free 2048 kB hugepages reported on node 1 00:16:45.472 [2024-10-30 16:00:35.222980] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:45.472 [2024-10-30 16:00:35.313176] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:45.472 [2024-10-30 16:00:35.313369] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:45.472 [2024-10-30 16:00:35.313388] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:45.472 [2024-10-30 16:00:35.313400] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:45.472 [2024-10-30 16:00:35.313501] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:45.472 [2024-10-30 16:00:35.313556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:45.472 [2024-10-30 16:00:35.313673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:45.472 [2024-10-30 16:00:35.313677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:46.407 16:00:36 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:46.407 16:00:36 -- common/autotest_common.sh@852 -- # return 0 00:16:46.407 16:00:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:46.407 16:00:36 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:46.407 16:00:36 -- common/autotest_common.sh@10 -- # set +x 00:16:46.407 16:00:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:46.407 16:00:36 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:46.407 16:00:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:46.407 16:00:36 -- common/autotest_common.sh@10 -- # set +x 00:16:46.407 [2024-10-30 16:00:36.116816] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:46.407 16:00:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:46.407 16:00:36 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:16:46.407 16:00:36 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:46.407 16:00:36 -- common/autotest_common.sh@10 -- # set +x 00:16:46.407 16:00:36 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:46.407 16:00:36 -- target/host_management.sh@23 -- # cat 00:16:46.407 16:00:36 -- target/host_management.sh@30 -- # rpc_cmd 00:16:46.407 16:00:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:46.407 16:00:36 -- common/autotest_common.sh@10 -- # set +x 00:16:46.407 Malloc0 00:16:46.407 [2024-10-30 16:00:36.178110] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:46.407 16:00:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:46.407 16:00:36 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:16:46.407 16:00:36 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:46.407 16:00:36 -- common/autotest_common.sh@10 -- # set +x 00:16:46.407 16:00:36 -- target/host_management.sh@73 -- # perfpid=2404521 00:16:46.407 16:00:36 -- target/host_management.sh@74 -- # waitforlisten 2404521 /var/tmp/bdevperf.sock 00:16:46.407 16:00:36 -- common/autotest_common.sh@819 -- # '[' -z 2404521 ']' 00:16:46.407 16:00:36 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:46.407 16:00:36 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:16:46.407 16:00:36 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:16:46.407 16:00:36 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:46.407 16:00:36 -- nvmf/common.sh@520 -- # config=() 00:16:46.407 16:00:36 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:46.407 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:46.407 16:00:36 -- nvmf/common.sh@520 -- # local subsystem config 00:16:46.407 16:00:36 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:46.408 16:00:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:46.408 16:00:36 -- common/autotest_common.sh@10 -- # set +x 00:16:46.408 16:00:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:46.408 { 00:16:46.408 "params": { 00:16:46.408 "name": "Nvme$subsystem", 00:16:46.408 "trtype": "$TEST_TRANSPORT", 00:16:46.408 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:46.408 "adrfam": "ipv4", 00:16:46.408 "trsvcid": "$NVMF_PORT", 00:16:46.408 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:46.408 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:46.408 "hdgst": ${hdgst:-false}, 00:16:46.408 "ddgst": ${ddgst:-false} 00:16:46.408 }, 00:16:46.408 "method": "bdev_nvme_attach_controller" 00:16:46.408 } 00:16:46.408 EOF 00:16:46.408 )") 00:16:46.408 16:00:36 -- nvmf/common.sh@542 -- # cat 00:16:46.408 16:00:36 -- nvmf/common.sh@544 -- # jq . 00:16:46.408 16:00:36 -- nvmf/common.sh@545 -- # IFS=, 00:16:46.408 16:00:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:46.408 "params": { 00:16:46.408 "name": "Nvme0", 00:16:46.408 "trtype": "tcp", 00:16:46.408 "traddr": "10.0.0.2", 00:16:46.408 "adrfam": "ipv4", 00:16:46.408 "trsvcid": "4420", 00:16:46.408 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:46.408 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:46.408 "hdgst": false, 00:16:46.408 "ddgst": false 00:16:46.408 }, 00:16:46.408 "method": "bdev_nvme_attach_controller" 00:16:46.408 }' 00:16:46.408 [2024-10-30 16:00:36.255551] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:16:46.408 [2024-10-30 16:00:36.255624] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2404521 ] 00:16:46.408 EAL: No free 2048 kB hugepages reported on node 1 00:16:46.666 [2024-10-30 16:00:36.317291] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:46.666 [2024-10-30 16:00:36.401851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:46.924 Running I/O for 10 seconds... 00:16:47.491 16:00:37 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:47.491 16:00:37 -- common/autotest_common.sh@852 -- # return 0 00:16:47.491 16:00:37 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:16:47.491 16:00:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:47.491 16:00:37 -- common/autotest_common.sh@10 -- # set +x 00:16:47.491 16:00:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:47.491 16:00:37 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:47.491 16:00:37 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:16:47.491 16:00:37 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:16:47.491 16:00:37 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:16:47.491 16:00:37 -- target/host_management.sh@52 -- # local ret=1 00:16:47.491 16:00:37 -- target/host_management.sh@53 -- # local i 00:16:47.491 16:00:37 -- target/host_management.sh@54 -- # (( i = 10 )) 00:16:47.491 16:00:37 -- target/host_management.sh@54 -- # (( i != 0 )) 00:16:47.491 16:00:37 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:16:47.491 16:00:37 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:16:47.491 16:00:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:47.491 16:00:37 -- common/autotest_common.sh@10 -- # set +x 00:16:47.491 16:00:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:47.491 16:00:37 -- target/host_management.sh@55 -- # read_io_count=2434 00:16:47.491 16:00:37 -- target/host_management.sh@58 -- # '[' 2434 -ge 100 ']' 00:16:47.491 16:00:37 -- target/host_management.sh@59 -- # ret=0 00:16:47.491 16:00:37 -- target/host_management.sh@60 -- # break 00:16:47.491 16:00:37 -- target/host_management.sh@64 -- # return 0 00:16:47.491 16:00:37 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:47.491 16:00:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:47.491 16:00:37 -- common/autotest_common.sh@10 -- # set +x 00:16:47.491 [2024-10-30 16:00:37.278502] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f7bf40 is same with the state(5) to be set 00:16:47.491 [2024-10-30 16:00:37.278637] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f7bf40 is same with the state(5) to be set 00:16:47.491 [2024-10-30 16:00:37.278654] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f7bf40 is same with the state(5) to be set 00:16:47.491 [2024-10-30 16:00:37.278667] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f7bf40 is same with the state(5) to be set 00:16:47.491 [2024-10-30 16:00:37.278679] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f7bf40 is same with the state(5) to be set 00:16:47.491 [2024-10-30 16:00:37.278693] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f7bf40 is same with the state(5) to be set 00:16:47.491 16:00:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:47.491 16:00:37 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:47.491 16:00:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:47.491 16:00:37 -- common/autotest_common.sh@10 -- # set +x 00:16:47.491 [2024-10-30 16:00:37.283158] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:16:47.491 [2024-10-30 16:00:37.283202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283222] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:16:47.491 [2024-10-30 16:00:37.283236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283249] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:16:47.491 [2024-10-30 16:00:37.283272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283287] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:16:47.491 [2024-10-30 16:00:37.283309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa06870 is same with the state(5) to be set 00:16:47.491 [2024-10-30 16:00:37.283415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:68224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:68352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:68480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:68608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:68736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:68992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:69120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:69248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:69504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:69760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:70528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:70656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:63872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:64000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:64256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:64384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:64512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.283978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:64640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.283993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.284010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:65024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.284025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.284042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:65152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.284057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.284074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:65280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.284089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.491 [2024-10-30 16:00:37.284106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:70784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.491 [2024-10-30 16:00:37.284121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:70912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:71040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:71168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:71296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:65408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:71424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:71552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:71680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:71808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:71936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:72064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:72192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:72320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:72448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:72576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:72704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:72832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:72960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:73088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:73216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:73344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:73472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:73600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:73728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:65920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:73856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.284976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.284993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:73984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.285008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.285025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:66048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.285040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.285060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:66432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.285076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.285093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:74112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.285109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.285125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:74240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.285140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.285157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:74368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.285172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.285189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:66560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.285205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.285221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:66816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.285237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.285264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:74496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.285281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.285298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:74624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.285314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.285331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:74752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.492 [2024-10-30 16:00:37.285347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.492 [2024-10-30 16:00:37.285364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:74880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.493 [2024-10-30 16:00:37.285379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.493 [2024-10-30 16:00:37.285395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:67072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.493 [2024-10-30 16:00:37.285411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.493 [2024-10-30 16:00:37.285427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:75008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.493 [2024-10-30 16:00:37.285443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.493 [2024-10-30 16:00:37.285459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:75136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.493 [2024-10-30 16:00:37.285479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.493 [2024-10-30 16:00:37.285496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:68096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:47.493 [2024-10-30 16:00:37.285511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:47.493 [2024-10-30 16:00:37.285617] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xa03f30 was disconnected and freed. reset controller. 00:16:47.493 [2024-10-30 16:00:37.286766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:16:47.493 task offset: 68224 on job bdev=Nvme0n1 fails 00:16:47.493 00:16:47.493 Latency(us) 00:16:47.493 [2024-10-30T15:00:37.369Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:47.493 [2024-10-30T15:00:37.369Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:47.493 [2024-10-30T15:00:37.369Z] Job: Nvme0n1 ended in about 0.67 seconds with error 00:16:47.493 Verification LBA range: start 0x0 length 0x400 00:16:47.493 Nvme0n1 : 0.67 3825.31 239.08 95.19 0.00 16085.70 2827.76 21845.33 00:16:47.493 [2024-10-30T15:00:37.369Z] =================================================================================================================== 00:16:47.493 [2024-10-30T15:00:37.369Z] Total : 3825.31 239.08 95.19 0.00 16085.70 2827.76 21845.33 00:16:47.493 [2024-10-30 16:00:37.288628] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:16:47.493 [2024-10-30 16:00:37.288656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa06870 (9): Bad file descriptor 00:16:47.493 16:00:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:47.493 16:00:37 -- target/host_management.sh@87 -- # sleep 1 00:16:47.493 [2024-10-30 16:00:37.293562] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:48.426 16:00:38 -- target/host_management.sh@91 -- # kill -9 2404521 00:16:48.426 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (2404521) - No such process 00:16:48.426 16:00:38 -- target/host_management.sh@91 -- # true 00:16:48.426 16:00:38 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:16:48.426 16:00:38 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:16:48.426 16:00:38 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:16:48.426 16:00:38 -- nvmf/common.sh@520 -- # config=() 00:16:48.426 16:00:38 -- nvmf/common.sh@520 -- # local subsystem config 00:16:48.426 16:00:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:48.426 16:00:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:48.426 { 00:16:48.426 "params": { 00:16:48.426 "name": "Nvme$subsystem", 00:16:48.426 "trtype": "$TEST_TRANSPORT", 00:16:48.426 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:48.426 "adrfam": "ipv4", 00:16:48.426 "trsvcid": "$NVMF_PORT", 00:16:48.426 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:48.426 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:48.426 "hdgst": ${hdgst:-false}, 00:16:48.426 "ddgst": ${ddgst:-false} 00:16:48.426 }, 00:16:48.426 "method": "bdev_nvme_attach_controller" 00:16:48.426 } 00:16:48.426 EOF 00:16:48.426 )") 00:16:48.426 16:00:38 -- nvmf/common.sh@542 -- # cat 00:16:48.426 16:00:38 -- nvmf/common.sh@544 -- # jq . 00:16:48.426 16:00:38 -- nvmf/common.sh@545 -- # IFS=, 00:16:48.426 16:00:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:48.426 "params": { 00:16:48.426 "name": "Nvme0", 00:16:48.426 "trtype": "tcp", 00:16:48.426 "traddr": "10.0.0.2", 00:16:48.426 "adrfam": "ipv4", 00:16:48.426 "trsvcid": "4420", 00:16:48.426 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:48.426 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:48.426 "hdgst": false, 00:16:48.426 "ddgst": false 00:16:48.426 }, 00:16:48.426 "method": "bdev_nvme_attach_controller" 00:16:48.426 }' 00:16:48.685 [2024-10-30 16:00:38.333385] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:16:48.685 [2024-10-30 16:00:38.333471] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2404803 ] 00:16:48.685 EAL: No free 2048 kB hugepages reported on node 1 00:16:48.685 [2024-10-30 16:00:38.396460] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:48.685 [2024-10-30 16:00:38.479978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:48.944 Running I/O for 1 seconds... 00:16:49.884 00:16:49.884 Latency(us) 00:16:49.885 [2024-10-30T15:00:39.761Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:49.885 [2024-10-30T15:00:39.761Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:49.885 Verification LBA range: start 0x0 length 0x400 00:16:49.885 Nvme0n1 : 1.01 3959.98 247.50 0.00 0.00 15908.33 1237.90 22816.24 00:16:49.885 [2024-10-30T15:00:39.761Z] =================================================================================================================== 00:16:49.885 [2024-10-30T15:00:39.761Z] Total : 3959.98 247.50 0.00 0.00 15908.33 1237.90 22816.24 00:16:50.141 16:00:39 -- target/host_management.sh@101 -- # stoptarget 00:16:50.141 16:00:39 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:16:50.141 16:00:39 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:16:50.141 16:00:39 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:50.141 16:00:39 -- target/host_management.sh@40 -- # nvmftestfini 00:16:50.141 16:00:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:50.141 16:00:39 -- nvmf/common.sh@116 -- # sync 00:16:50.141 16:00:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:50.141 16:00:39 -- nvmf/common.sh@119 -- # set +e 00:16:50.141 16:00:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:50.141 16:00:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:50.141 rmmod nvme_tcp 00:16:50.141 rmmod nvme_fabrics 00:16:50.141 rmmod nvme_keyring 00:16:50.141 16:00:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:50.141 16:00:39 -- nvmf/common.sh@123 -- # set -e 00:16:50.141 16:00:39 -- nvmf/common.sh@124 -- # return 0 00:16:50.141 16:00:39 -- nvmf/common.sh@477 -- # '[' -n 2404343 ']' 00:16:50.141 16:00:39 -- nvmf/common.sh@478 -- # killprocess 2404343 00:16:50.141 16:00:39 -- common/autotest_common.sh@926 -- # '[' -z 2404343 ']' 00:16:50.141 16:00:39 -- common/autotest_common.sh@930 -- # kill -0 2404343 00:16:50.141 16:00:39 -- common/autotest_common.sh@931 -- # uname 00:16:50.141 16:00:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:50.141 16:00:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2404343 00:16:50.141 16:00:39 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:16:50.141 16:00:39 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:16:50.141 16:00:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2404343' 00:16:50.141 killing process with pid 2404343 00:16:50.141 16:00:39 -- common/autotest_common.sh@945 -- # kill 2404343 00:16:50.141 16:00:39 -- common/autotest_common.sh@950 -- # wait 2404343 00:16:50.399 [2024-10-30 16:00:40.214004] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:16:50.399 16:00:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:50.399 16:00:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:50.399 16:00:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:50.399 16:00:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:50.399 16:00:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:50.399 16:00:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:50.399 16:00:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:50.399 16:00:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:52.929 16:00:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:52.929 00:16:52.929 real 0m7.182s 00:16:52.929 user 0m22.079s 00:16:52.929 sys 0m1.383s 00:16:52.929 16:00:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:52.929 16:00:42 -- common/autotest_common.sh@10 -- # set +x 00:16:52.929 ************************************ 00:16:52.929 END TEST nvmf_host_management 00:16:52.929 ************************************ 00:16:52.929 16:00:42 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:16:52.929 00:16:52.929 real 0m9.435s 00:16:52.929 user 0m22.854s 00:16:52.929 sys 0m2.886s 00:16:52.929 16:00:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:52.929 16:00:42 -- common/autotest_common.sh@10 -- # set +x 00:16:52.929 ************************************ 00:16:52.929 END TEST nvmf_host_management 00:16:52.929 ************************************ 00:16:52.929 16:00:42 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:52.929 16:00:42 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:52.929 16:00:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:52.929 16:00:42 -- common/autotest_common.sh@10 -- # set +x 00:16:52.929 ************************************ 00:16:52.929 START TEST nvmf_lvol 00:16:52.929 ************************************ 00:16:52.929 16:00:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:52.929 * Looking for test storage... 00:16:52.929 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:52.929 16:00:42 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:52.929 16:00:42 -- nvmf/common.sh@7 -- # uname -s 00:16:52.929 16:00:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:52.929 16:00:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:52.929 16:00:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:52.929 16:00:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:52.929 16:00:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:52.929 16:00:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:52.929 16:00:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:52.929 16:00:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:52.929 16:00:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:52.929 16:00:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:52.929 16:00:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:52.929 16:00:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:52.929 16:00:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:52.929 16:00:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:52.929 16:00:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:52.929 16:00:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:52.929 16:00:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:52.929 16:00:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:52.929 16:00:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:52.929 16:00:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.929 16:00:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.929 16:00:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.929 16:00:42 -- paths/export.sh@5 -- # export PATH 00:16:52.929 16:00:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.929 16:00:42 -- nvmf/common.sh@46 -- # : 0 00:16:52.929 16:00:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:52.929 16:00:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:52.929 16:00:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:52.929 16:00:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:52.929 16:00:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:52.929 16:00:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:52.929 16:00:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:52.929 16:00:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:52.929 16:00:42 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:52.929 16:00:42 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:52.929 16:00:42 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:16:52.929 16:00:42 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:16:52.929 16:00:42 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:52.929 16:00:42 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:16:52.929 16:00:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:52.929 16:00:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:52.929 16:00:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:52.929 16:00:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:52.929 16:00:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:52.929 16:00:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:52.929 16:00:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:52.929 16:00:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:52.929 16:00:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:52.929 16:00:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:52.929 16:00:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:52.929 16:00:42 -- common/autotest_common.sh@10 -- # set +x 00:16:54.841 16:00:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:54.841 16:00:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:54.841 16:00:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:54.841 16:00:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:54.841 16:00:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:54.841 16:00:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:54.841 16:00:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:54.841 16:00:44 -- nvmf/common.sh@294 -- # net_devs=() 00:16:54.841 16:00:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:54.841 16:00:44 -- nvmf/common.sh@295 -- # e810=() 00:16:54.841 16:00:44 -- nvmf/common.sh@295 -- # local -ga e810 00:16:54.841 16:00:44 -- nvmf/common.sh@296 -- # x722=() 00:16:54.841 16:00:44 -- nvmf/common.sh@296 -- # local -ga x722 00:16:54.841 16:00:44 -- nvmf/common.sh@297 -- # mlx=() 00:16:54.841 16:00:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:54.841 16:00:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:54.841 16:00:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:54.841 16:00:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:54.841 16:00:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:54.841 16:00:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:54.841 16:00:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:54.841 16:00:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:54.841 16:00:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:54.841 16:00:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:54.841 16:00:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:54.841 16:00:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:54.841 16:00:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:54.841 16:00:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:54.841 16:00:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:54.841 16:00:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:54.841 16:00:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:54.841 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:54.841 16:00:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:54.841 16:00:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:54.841 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:54.841 16:00:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:54.841 16:00:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:54.841 16:00:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:54.841 16:00:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:54.841 16:00:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:54.841 16:00:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:54.842 16:00:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:54.842 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:54.842 16:00:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:54.842 16:00:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:54.842 16:00:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:54.842 16:00:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:54.842 16:00:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:54.842 16:00:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:54.842 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:54.842 16:00:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:54.842 16:00:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:54.842 16:00:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:54.842 16:00:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:54.842 16:00:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:54.842 16:00:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:54.842 16:00:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:54.842 16:00:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:54.842 16:00:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:54.842 16:00:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:54.842 16:00:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:54.842 16:00:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:54.842 16:00:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:54.842 16:00:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:54.842 16:00:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:54.842 16:00:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:54.842 16:00:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:54.842 16:00:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:54.842 16:00:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:54.842 16:00:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:54.842 16:00:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:54.842 16:00:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:54.842 16:00:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:54.842 16:00:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:54.842 16:00:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:54.842 16:00:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:54.842 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:54.842 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:16:54.842 00:16:54.842 --- 10.0.0.2 ping statistics --- 00:16:54.842 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:54.842 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:16:54.842 16:00:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:54.842 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:54.842 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.197 ms 00:16:54.842 00:16:54.842 --- 10.0.0.1 ping statistics --- 00:16:54.842 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:54.842 rtt min/avg/max/mdev = 0.197/0.197/0.197/0.000 ms 00:16:54.842 16:00:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:54.842 16:00:44 -- nvmf/common.sh@410 -- # return 0 00:16:54.842 16:00:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:54.842 16:00:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:54.842 16:00:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:54.842 16:00:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:54.842 16:00:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:54.842 16:00:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:54.842 16:00:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:54.842 16:00:44 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:16:54.842 16:00:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:54.842 16:00:44 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:54.842 16:00:44 -- common/autotest_common.sh@10 -- # set +x 00:16:54.842 16:00:44 -- nvmf/common.sh@469 -- # nvmfpid=2406912 00:16:54.842 16:00:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:54.842 16:00:44 -- nvmf/common.sh@470 -- # waitforlisten 2406912 00:16:54.842 16:00:44 -- common/autotest_common.sh@819 -- # '[' -z 2406912 ']' 00:16:54.842 16:00:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:54.842 16:00:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:54.842 16:00:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:54.842 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:54.842 16:00:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:54.842 16:00:44 -- common/autotest_common.sh@10 -- # set +x 00:16:54.842 [2024-10-30 16:00:44.576121] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:16:54.842 [2024-10-30 16:00:44.576201] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:54.842 EAL: No free 2048 kB hugepages reported on node 1 00:16:54.842 [2024-10-30 16:00:44.649511] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:55.133 [2024-10-30 16:00:44.747497] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:55.133 [2024-10-30 16:00:44.747636] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:55.133 [2024-10-30 16:00:44.747653] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:55.133 [2024-10-30 16:00:44.747666] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:55.133 [2024-10-30 16:00:44.747717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:55.133 [2024-10-30 16:00:44.747745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:55.133 [2024-10-30 16:00:44.747748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:55.703 16:00:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:55.703 16:00:45 -- common/autotest_common.sh@852 -- # return 0 00:16:55.703 16:00:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:55.703 16:00:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:55.703 16:00:45 -- common/autotest_common.sh@10 -- # set +x 00:16:55.703 16:00:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:55.703 16:00:45 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:55.961 [2024-10-30 16:00:45.812893] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:55.961 16:00:45 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:56.526 16:00:46 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:16:56.526 16:00:46 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:56.526 16:00:46 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:16:56.526 16:00:46 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:16:56.783 16:00:46 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:16:57.040 16:00:46 -- target/nvmf_lvol.sh@29 -- # lvs=fc8b294f-9de0-449e-9a5f-ee7b45987e29 00:16:57.041 16:00:46 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u fc8b294f-9de0-449e-9a5f-ee7b45987e29 lvol 20 00:16:57.605 16:00:47 -- target/nvmf_lvol.sh@32 -- # lvol=30d8807d-661a-4dde-99ac-b7f6435f3390 00:16:57.605 16:00:47 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:16:57.605 16:00:47 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 30d8807d-661a-4dde-99ac-b7f6435f3390 00:16:57.862 16:00:47 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:16:58.119 [2024-10-30 16:00:47.910544] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:58.119 16:00:47 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:58.377 16:00:48 -- target/nvmf_lvol.sh@42 -- # perf_pid=2407379 00:16:58.377 16:00:48 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:16:58.377 16:00:48 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:16:58.377 EAL: No free 2048 kB hugepages reported on node 1 00:16:59.310 16:00:49 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 30d8807d-661a-4dde-99ac-b7f6435f3390 MY_SNAPSHOT 00:16:59.875 16:00:49 -- target/nvmf_lvol.sh@47 -- # snapshot=d39ba8d8-32e8-48f6-b235-d4ae3348ba8d 00:16:59.875 16:00:49 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 30d8807d-661a-4dde-99ac-b7f6435f3390 30 00:17:00.133 16:00:49 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone d39ba8d8-32e8-48f6-b235-d4ae3348ba8d MY_CLONE 00:17:00.389 16:00:50 -- target/nvmf_lvol.sh@49 -- # clone=eb6eda10-6ec0-4fc7-a1c9-9f19ce77aa06 00:17:00.389 16:00:50 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate eb6eda10-6ec0-4fc7-a1c9-9f19ce77aa06 00:17:00.955 16:00:50 -- target/nvmf_lvol.sh@53 -- # wait 2407379 00:17:09.067 Initializing NVMe Controllers 00:17:09.067 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:09.067 Controller IO queue size 128, less than required. 00:17:09.067 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:09.067 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:09.067 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:09.067 Initialization complete. Launching workers. 00:17:09.067 ======================================================== 00:17:09.067 Latency(us) 00:17:09.067 Device Information : IOPS MiB/s Average min max 00:17:09.067 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10907.70 42.61 11734.99 799.58 70801.34 00:17:09.067 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10757.90 42.02 11904.97 2005.52 77568.59 00:17:09.067 ======================================================== 00:17:09.067 Total : 21665.60 84.63 11819.39 799.58 77568.59 00:17:09.067 00:17:09.067 16:00:58 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:09.324 16:00:58 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 30d8807d-661a-4dde-99ac-b7f6435f3390 00:17:09.582 16:00:59 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u fc8b294f-9de0-449e-9a5f-ee7b45987e29 00:17:09.843 16:00:59 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:09.843 16:00:59 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:09.843 16:00:59 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:09.843 16:00:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:09.843 16:00:59 -- nvmf/common.sh@116 -- # sync 00:17:09.843 16:00:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:09.843 16:00:59 -- nvmf/common.sh@119 -- # set +e 00:17:09.843 16:00:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:09.843 16:00:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:09.843 rmmod nvme_tcp 00:17:09.843 rmmod nvme_fabrics 00:17:09.843 rmmod nvme_keyring 00:17:09.843 16:00:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:09.843 16:00:59 -- nvmf/common.sh@123 -- # set -e 00:17:09.843 16:00:59 -- nvmf/common.sh@124 -- # return 0 00:17:09.843 16:00:59 -- nvmf/common.sh@477 -- # '[' -n 2406912 ']' 00:17:09.843 16:00:59 -- nvmf/common.sh@478 -- # killprocess 2406912 00:17:09.843 16:00:59 -- common/autotest_common.sh@926 -- # '[' -z 2406912 ']' 00:17:09.843 16:00:59 -- common/autotest_common.sh@930 -- # kill -0 2406912 00:17:09.843 16:00:59 -- common/autotest_common.sh@931 -- # uname 00:17:09.843 16:00:59 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:09.843 16:00:59 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2406912 00:17:09.843 16:00:59 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:17:09.843 16:00:59 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:17:09.843 16:00:59 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2406912' 00:17:09.843 killing process with pid 2406912 00:17:09.843 16:00:59 -- common/autotest_common.sh@945 -- # kill 2406912 00:17:09.843 16:00:59 -- common/autotest_common.sh@950 -- # wait 2406912 00:17:10.103 16:00:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:10.103 16:00:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:10.103 16:00:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:10.103 16:00:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:10.103 16:00:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:10.103 16:00:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:10.103 16:00:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:10.103 16:00:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:12.642 16:01:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:12.642 00:17:12.642 real 0m19.572s 00:17:12.642 user 1m7.470s 00:17:12.642 sys 0m5.179s 00:17:12.642 16:01:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:12.642 16:01:01 -- common/autotest_common.sh@10 -- # set +x 00:17:12.642 ************************************ 00:17:12.642 END TEST nvmf_lvol 00:17:12.642 ************************************ 00:17:12.642 16:01:01 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:12.642 16:01:01 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:12.642 16:01:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:12.642 16:01:01 -- common/autotest_common.sh@10 -- # set +x 00:17:12.642 ************************************ 00:17:12.642 START TEST nvmf_lvs_grow 00:17:12.642 ************************************ 00:17:12.642 16:01:01 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:12.642 * Looking for test storage... 00:17:12.642 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:12.642 16:01:01 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:12.642 16:01:01 -- nvmf/common.sh@7 -- # uname -s 00:17:12.642 16:01:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:12.642 16:01:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:12.642 16:01:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:12.642 16:01:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:12.642 16:01:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:12.642 16:01:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:12.642 16:01:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:12.642 16:01:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:12.642 16:01:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:12.642 16:01:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:12.642 16:01:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:12.642 16:01:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:12.642 16:01:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:12.642 16:01:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:12.642 16:01:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:12.642 16:01:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:12.642 16:01:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:12.642 16:01:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:12.642 16:01:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:12.642 16:01:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.642 16:01:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.642 16:01:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.642 16:01:01 -- paths/export.sh@5 -- # export PATH 00:17:12.642 16:01:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:12.642 16:01:01 -- nvmf/common.sh@46 -- # : 0 00:17:12.642 16:01:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:12.642 16:01:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:12.642 16:01:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:12.642 16:01:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:12.642 16:01:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:12.642 16:01:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:12.642 16:01:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:12.642 16:01:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:12.642 16:01:01 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:12.642 16:01:01 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:12.642 16:01:01 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:12.643 16:01:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:12.643 16:01:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:12.643 16:01:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:12.643 16:01:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:12.643 16:01:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:12.643 16:01:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:12.643 16:01:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:12.643 16:01:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:12.643 16:01:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:12.643 16:01:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:12.643 16:01:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:12.643 16:01:02 -- common/autotest_common.sh@10 -- # set +x 00:17:14.547 16:01:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:14.547 16:01:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:14.547 16:01:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:14.547 16:01:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:14.547 16:01:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:14.547 16:01:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:14.547 16:01:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:14.547 16:01:03 -- nvmf/common.sh@294 -- # net_devs=() 00:17:14.547 16:01:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:14.547 16:01:03 -- nvmf/common.sh@295 -- # e810=() 00:17:14.547 16:01:03 -- nvmf/common.sh@295 -- # local -ga e810 00:17:14.547 16:01:03 -- nvmf/common.sh@296 -- # x722=() 00:17:14.547 16:01:03 -- nvmf/common.sh@296 -- # local -ga x722 00:17:14.547 16:01:03 -- nvmf/common.sh@297 -- # mlx=() 00:17:14.547 16:01:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:14.547 16:01:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:14.547 16:01:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:14.547 16:01:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:14.547 16:01:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:14.547 16:01:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:14.547 16:01:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:14.547 16:01:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:14.547 16:01:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:14.547 16:01:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:14.547 16:01:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:14.547 16:01:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:14.547 16:01:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:14.547 16:01:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:14.547 16:01:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:14.547 16:01:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:14.547 16:01:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:14.547 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:14.547 16:01:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:14.547 16:01:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:14.547 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:14.547 16:01:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:14.547 16:01:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:14.547 16:01:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:14.547 16:01:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:14.547 16:01:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:14.547 16:01:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:14.547 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:14.547 16:01:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:14.547 16:01:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:14.547 16:01:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:14.547 16:01:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:14.547 16:01:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:14.547 16:01:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:14.547 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:14.547 16:01:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:14.547 16:01:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:14.547 16:01:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:14.547 16:01:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:14.547 16:01:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:14.547 16:01:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:14.547 16:01:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:14.547 16:01:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:14.547 16:01:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:14.547 16:01:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:14.547 16:01:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:14.547 16:01:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:14.547 16:01:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:14.547 16:01:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:14.547 16:01:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:14.547 16:01:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:14.547 16:01:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:14.547 16:01:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:14.547 16:01:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:14.547 16:01:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:14.547 16:01:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:14.547 16:01:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:14.547 16:01:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:14.547 16:01:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:14.547 16:01:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:14.547 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:14.547 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:17:14.547 00:17:14.547 --- 10.0.0.2 ping statistics --- 00:17:14.547 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:14.547 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:17:14.547 16:01:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:14.547 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:14.547 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:17:14.547 00:17:14.547 --- 10.0.0.1 ping statistics --- 00:17:14.547 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:14.547 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:17:14.547 16:01:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:14.547 16:01:04 -- nvmf/common.sh@410 -- # return 0 00:17:14.547 16:01:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:14.547 16:01:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:14.547 16:01:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:14.547 16:01:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:14.547 16:01:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:14.547 16:01:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:14.547 16:01:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:14.547 16:01:04 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:14.547 16:01:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:14.547 16:01:04 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:14.547 16:01:04 -- common/autotest_common.sh@10 -- # set +x 00:17:14.547 16:01:04 -- nvmf/common.sh@469 -- # nvmfpid=2410739 00:17:14.547 16:01:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:14.547 16:01:04 -- nvmf/common.sh@470 -- # waitforlisten 2410739 00:17:14.547 16:01:04 -- common/autotest_common.sh@819 -- # '[' -z 2410739 ']' 00:17:14.547 16:01:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:14.547 16:01:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:14.547 16:01:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:14.547 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:14.547 16:01:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:14.547 16:01:04 -- common/autotest_common.sh@10 -- # set +x 00:17:14.547 [2024-10-30 16:01:04.136492] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:14.547 [2024-10-30 16:01:04.136591] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:14.547 EAL: No free 2048 kB hugepages reported on node 1 00:17:14.547 [2024-10-30 16:01:04.207516] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:14.547 [2024-10-30 16:01:04.295501] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:14.547 [2024-10-30 16:01:04.295685] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:14.547 [2024-10-30 16:01:04.295706] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:14.547 [2024-10-30 16:01:04.295721] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:14.547 [2024-10-30 16:01:04.295752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:15.480 16:01:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:15.480 16:01:05 -- common/autotest_common.sh@852 -- # return 0 00:17:15.480 16:01:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:15.480 16:01:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:15.480 16:01:05 -- common/autotest_common.sh@10 -- # set +x 00:17:15.480 16:01:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:15.480 16:01:05 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:15.480 [2024-10-30 16:01:05.352542] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:15.739 16:01:05 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:15.739 16:01:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:17:15.739 16:01:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:15.739 16:01:05 -- common/autotest_common.sh@10 -- # set +x 00:17:15.739 ************************************ 00:17:15.739 START TEST lvs_grow_clean 00:17:15.739 ************************************ 00:17:15.739 16:01:05 -- common/autotest_common.sh@1104 -- # lvs_grow 00:17:15.739 16:01:05 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:15.739 16:01:05 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:15.739 16:01:05 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:15.739 16:01:05 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:15.739 16:01:05 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:15.739 16:01:05 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:15.739 16:01:05 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:15.739 16:01:05 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:15.739 16:01:05 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:15.996 16:01:05 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:15.996 16:01:05 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:16.254 16:01:05 -- target/nvmf_lvs_grow.sh@28 -- # lvs=6c198f22-864e-4d5f-807a-68d793120b3a 00:17:16.254 16:01:05 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c198f22-864e-4d5f-807a-68d793120b3a 00:17:16.254 16:01:05 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:16.512 16:01:06 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:16.512 16:01:06 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:16.512 16:01:06 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 6c198f22-864e-4d5f-807a-68d793120b3a lvol 150 00:17:16.769 16:01:06 -- target/nvmf_lvs_grow.sh@33 -- # lvol=c314cbc5-adce-4e87-b3a2-9ec55d018e38 00:17:16.769 16:01:06 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:16.769 16:01:06 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:17.026 [2024-10-30 16:01:06.663625] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:17.026 [2024-10-30 16:01:06.663730] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:17.026 true 00:17:17.026 16:01:06 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c198f22-864e-4d5f-807a-68d793120b3a 00:17:17.026 16:01:06 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:17.284 16:01:06 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:17.284 16:01:06 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:17.542 16:01:07 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 c314cbc5-adce-4e87-b3a2-9ec55d018e38 00:17:17.800 16:01:07 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:18.058 [2024-10-30 16:01:07.726928] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:18.058 16:01:07 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:18.317 16:01:07 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2411243 00:17:18.317 16:01:07 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:18.317 16:01:07 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:18.317 16:01:07 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2411243 /var/tmp/bdevperf.sock 00:17:18.317 16:01:07 -- common/autotest_common.sh@819 -- # '[' -z 2411243 ']' 00:17:18.317 16:01:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:18.317 16:01:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:18.317 16:01:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:18.317 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:18.317 16:01:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:18.317 16:01:07 -- common/autotest_common.sh@10 -- # set +x 00:17:18.317 [2024-10-30 16:01:08.028282] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:18.317 [2024-10-30 16:01:08.028357] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2411243 ] 00:17:18.317 EAL: No free 2048 kB hugepages reported on node 1 00:17:18.317 [2024-10-30 16:01:08.091013] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:18.317 [2024-10-30 16:01:08.181056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:19.251 16:01:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:19.251 16:01:09 -- common/autotest_common.sh@852 -- # return 0 00:17:19.251 16:01:09 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:19.510 Nvme0n1 00:17:19.510 16:01:09 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:20.076 [ 00:17:20.076 { 00:17:20.076 "name": "Nvme0n1", 00:17:20.076 "aliases": [ 00:17:20.076 "c314cbc5-adce-4e87-b3a2-9ec55d018e38" 00:17:20.076 ], 00:17:20.076 "product_name": "NVMe disk", 00:17:20.076 "block_size": 4096, 00:17:20.076 "num_blocks": 38912, 00:17:20.076 "uuid": "c314cbc5-adce-4e87-b3a2-9ec55d018e38", 00:17:20.076 "assigned_rate_limits": { 00:17:20.076 "rw_ios_per_sec": 0, 00:17:20.076 "rw_mbytes_per_sec": 0, 00:17:20.076 "r_mbytes_per_sec": 0, 00:17:20.076 "w_mbytes_per_sec": 0 00:17:20.076 }, 00:17:20.076 "claimed": false, 00:17:20.076 "zoned": false, 00:17:20.076 "supported_io_types": { 00:17:20.076 "read": true, 00:17:20.076 "write": true, 00:17:20.076 "unmap": true, 00:17:20.076 "write_zeroes": true, 00:17:20.076 "flush": true, 00:17:20.076 "reset": true, 00:17:20.076 "compare": true, 00:17:20.076 "compare_and_write": true, 00:17:20.076 "abort": true, 00:17:20.076 "nvme_admin": true, 00:17:20.076 "nvme_io": true 00:17:20.076 }, 00:17:20.076 "driver_specific": { 00:17:20.076 "nvme": [ 00:17:20.076 { 00:17:20.076 "trid": { 00:17:20.076 "trtype": "TCP", 00:17:20.076 "adrfam": "IPv4", 00:17:20.076 "traddr": "10.0.0.2", 00:17:20.076 "trsvcid": "4420", 00:17:20.076 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:20.076 }, 00:17:20.076 "ctrlr_data": { 00:17:20.076 "cntlid": 1, 00:17:20.076 "vendor_id": "0x8086", 00:17:20.076 "model_number": "SPDK bdev Controller", 00:17:20.076 "serial_number": "SPDK0", 00:17:20.076 "firmware_revision": "24.01.1", 00:17:20.076 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:20.076 "oacs": { 00:17:20.076 "security": 0, 00:17:20.076 "format": 0, 00:17:20.076 "firmware": 0, 00:17:20.076 "ns_manage": 0 00:17:20.076 }, 00:17:20.076 "multi_ctrlr": true, 00:17:20.076 "ana_reporting": false 00:17:20.076 }, 00:17:20.076 "vs": { 00:17:20.076 "nvme_version": "1.3" 00:17:20.076 }, 00:17:20.076 "ns_data": { 00:17:20.076 "id": 1, 00:17:20.076 "can_share": true 00:17:20.076 } 00:17:20.076 } 00:17:20.076 ], 00:17:20.076 "mp_policy": "active_passive" 00:17:20.076 } 00:17:20.076 } 00:17:20.076 ] 00:17:20.076 16:01:09 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2411400 00:17:20.076 16:01:09 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:20.076 16:01:09 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:20.076 Running I/O for 10 seconds... 00:17:21.011 Latency(us) 00:17:21.011 [2024-10-30T15:01:10.887Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:21.011 [2024-10-30T15:01:10.887Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:21.011 Nvme0n1 : 1.00 14369.00 56.13 0.00 0.00 0.00 0.00 0.00 00:17:21.011 [2024-10-30T15:01:10.887Z] =================================================================================================================== 00:17:21.011 [2024-10-30T15:01:10.887Z] Total : 14369.00 56.13 0.00 0.00 0.00 0.00 0.00 00:17:21.011 00:17:21.946 16:01:11 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 6c198f22-864e-4d5f-807a-68d793120b3a 00:17:21.946 [2024-10-30T15:01:11.822Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:21.946 Nvme0n1 : 2.00 14682.00 57.35 0.00 0.00 0.00 0.00 0.00 00:17:21.946 [2024-10-30T15:01:11.822Z] =================================================================================================================== 00:17:21.946 [2024-10-30T15:01:11.822Z] Total : 14682.00 57.35 0.00 0.00 0.00 0.00 0.00 00:17:21.946 00:17:22.205 true 00:17:22.205 16:01:12 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c198f22-864e-4d5f-807a-68d793120b3a 00:17:22.205 16:01:12 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:22.463 16:01:12 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:22.463 16:01:12 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:22.463 16:01:12 -- target/nvmf_lvs_grow.sh@65 -- # wait 2411400 00:17:23.030 [2024-10-30T15:01:12.906Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:23.030 Nvme0n1 : 3.00 14825.67 57.91 0.00 0.00 0.00 0.00 0.00 00:17:23.030 [2024-10-30T15:01:12.906Z] =================================================================================================================== 00:17:23.030 [2024-10-30T15:01:12.906Z] Total : 14825.67 57.91 0.00 0.00 0.00 0.00 0.00 00:17:23.030 00:17:23.966 [2024-10-30T15:01:13.842Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:23.966 Nvme0n1 : 4.00 14899.25 58.20 0.00 0.00 0.00 0.00 0.00 00:17:23.966 [2024-10-30T15:01:13.842Z] =================================================================================================================== 00:17:23.966 [2024-10-30T15:01:13.842Z] Total : 14899.25 58.20 0.00 0.00 0.00 0.00 0.00 00:17:23.966 00:17:25.343 [2024-10-30T15:01:15.219Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:25.343 Nvme0n1 : 5.00 14968.60 58.47 0.00 0.00 0.00 0.00 0.00 00:17:25.343 [2024-10-30T15:01:15.219Z] =================================================================================================================== 00:17:25.343 [2024-10-30T15:01:15.219Z] Total : 14968.60 58.47 0.00 0.00 0.00 0.00 0.00 00:17:25.343 00:17:26.279 [2024-10-30T15:01:16.155Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:26.279 Nvme0n1 : 6.00 15015.17 58.65 0.00 0.00 0.00 0.00 0.00 00:17:26.279 [2024-10-30T15:01:16.155Z] =================================================================================================================== 00:17:26.279 [2024-10-30T15:01:16.155Z] Total : 15015.17 58.65 0.00 0.00 0.00 0.00 0.00 00:17:26.279 00:17:27.280 [2024-10-30T15:01:17.156Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:27.280 Nvme0n1 : 7.00 15060.00 58.83 0.00 0.00 0.00 0.00 0.00 00:17:27.280 [2024-10-30T15:01:17.156Z] =================================================================================================================== 00:17:27.280 [2024-10-30T15:01:17.156Z] Total : 15060.00 58.83 0.00 0.00 0.00 0.00 0.00 00:17:27.280 00:17:28.217 [2024-10-30T15:01:18.093Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:28.217 Nvme0n1 : 8.00 15092.12 58.95 0.00 0.00 0.00 0.00 0.00 00:17:28.217 [2024-10-30T15:01:18.093Z] =================================================================================================================== 00:17:28.217 [2024-10-30T15:01:18.093Z] Total : 15092.12 58.95 0.00 0.00 0.00 0.00 0.00 00:17:28.217 00:17:29.152 [2024-10-30T15:01:19.028Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:29.152 Nvme0n1 : 9.00 15124.00 59.08 0.00 0.00 0.00 0.00 0.00 00:17:29.152 [2024-10-30T15:01:19.028Z] =================================================================================================================== 00:17:29.152 [2024-10-30T15:01:19.028Z] Total : 15124.00 59.08 0.00 0.00 0.00 0.00 0.00 00:17:29.152 00:17:30.086 [2024-10-30T15:01:19.962Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:30.086 Nvme0n1 : 10.00 15149.80 59.18 0.00 0.00 0.00 0.00 0.00 00:17:30.086 [2024-10-30T15:01:19.962Z] =================================================================================================================== 00:17:30.086 [2024-10-30T15:01:19.962Z] Total : 15149.80 59.18 0.00 0.00 0.00 0.00 0.00 00:17:30.086 00:17:30.086 00:17:30.086 Latency(us) 00:17:30.086 [2024-10-30T15:01:19.962Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:30.086 [2024-10-30T15:01:19.962Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:30.086 Nvme0n1 : 10.00 15157.30 59.21 0.00 0.00 8440.34 2293.76 22719.15 00:17:30.086 [2024-10-30T15:01:19.962Z] =================================================================================================================== 00:17:30.086 [2024-10-30T15:01:19.962Z] Total : 15157.30 59.21 0.00 0.00 8440.34 2293.76 22719.15 00:17:30.086 0 00:17:30.086 16:01:19 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2411243 00:17:30.086 16:01:19 -- common/autotest_common.sh@926 -- # '[' -z 2411243 ']' 00:17:30.086 16:01:19 -- common/autotest_common.sh@930 -- # kill -0 2411243 00:17:30.086 16:01:19 -- common/autotest_common.sh@931 -- # uname 00:17:30.086 16:01:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:30.086 16:01:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2411243 00:17:30.086 16:01:19 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:30.086 16:01:19 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:30.086 16:01:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2411243' 00:17:30.086 killing process with pid 2411243 00:17:30.086 16:01:19 -- common/autotest_common.sh@945 -- # kill 2411243 00:17:30.086 Received shutdown signal, test time was about 10.000000 seconds 00:17:30.086 00:17:30.086 Latency(us) 00:17:30.086 [2024-10-30T15:01:19.962Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:30.086 [2024-10-30T15:01:19.962Z] =================================================================================================================== 00:17:30.086 [2024-10-30T15:01:19.962Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:30.086 16:01:19 -- common/autotest_common.sh@950 -- # wait 2411243 00:17:30.344 16:01:20 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:30.602 16:01:20 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c198f22-864e-4d5f-807a-68d793120b3a 00:17:30.602 16:01:20 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:30.861 16:01:20 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:30.861 16:01:20 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:30.861 16:01:20 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:31.119 [2024-10-30 16:01:20.855186] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:31.119 16:01:20 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c198f22-864e-4d5f-807a-68d793120b3a 00:17:31.119 16:01:20 -- common/autotest_common.sh@640 -- # local es=0 00:17:31.119 16:01:20 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c198f22-864e-4d5f-807a-68d793120b3a 00:17:31.119 16:01:20 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:31.119 16:01:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:31.119 16:01:20 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:31.119 16:01:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:31.119 16:01:20 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:31.119 16:01:20 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:31.119 16:01:20 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:31.119 16:01:20 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:31.119 16:01:20 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c198f22-864e-4d5f-807a-68d793120b3a 00:17:31.378 request: 00:17:31.378 { 00:17:31.378 "uuid": "6c198f22-864e-4d5f-807a-68d793120b3a", 00:17:31.378 "method": "bdev_lvol_get_lvstores", 00:17:31.378 "req_id": 1 00:17:31.378 } 00:17:31.378 Got JSON-RPC error response 00:17:31.378 response: 00:17:31.378 { 00:17:31.378 "code": -19, 00:17:31.378 "message": "No such device" 00:17:31.378 } 00:17:31.378 16:01:21 -- common/autotest_common.sh@643 -- # es=1 00:17:31.379 16:01:21 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:31.379 16:01:21 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:31.379 16:01:21 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:31.379 16:01:21 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:31.637 aio_bdev 00:17:31.637 16:01:21 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev c314cbc5-adce-4e87-b3a2-9ec55d018e38 00:17:31.637 16:01:21 -- common/autotest_common.sh@887 -- # local bdev_name=c314cbc5-adce-4e87-b3a2-9ec55d018e38 00:17:31.637 16:01:21 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:17:31.637 16:01:21 -- common/autotest_common.sh@889 -- # local i 00:17:31.637 16:01:21 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:17:31.637 16:01:21 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:17:31.637 16:01:21 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:31.896 16:01:21 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c314cbc5-adce-4e87-b3a2-9ec55d018e38 -t 2000 00:17:32.154 [ 00:17:32.154 { 00:17:32.154 "name": "c314cbc5-adce-4e87-b3a2-9ec55d018e38", 00:17:32.154 "aliases": [ 00:17:32.154 "lvs/lvol" 00:17:32.154 ], 00:17:32.154 "product_name": "Logical Volume", 00:17:32.154 "block_size": 4096, 00:17:32.154 "num_blocks": 38912, 00:17:32.154 "uuid": "c314cbc5-adce-4e87-b3a2-9ec55d018e38", 00:17:32.154 "assigned_rate_limits": { 00:17:32.154 "rw_ios_per_sec": 0, 00:17:32.154 "rw_mbytes_per_sec": 0, 00:17:32.154 "r_mbytes_per_sec": 0, 00:17:32.155 "w_mbytes_per_sec": 0 00:17:32.155 }, 00:17:32.155 "claimed": false, 00:17:32.155 "zoned": false, 00:17:32.155 "supported_io_types": { 00:17:32.155 "read": true, 00:17:32.155 "write": true, 00:17:32.155 "unmap": true, 00:17:32.155 "write_zeroes": true, 00:17:32.155 "flush": false, 00:17:32.155 "reset": true, 00:17:32.155 "compare": false, 00:17:32.155 "compare_and_write": false, 00:17:32.155 "abort": false, 00:17:32.155 "nvme_admin": false, 00:17:32.155 "nvme_io": false 00:17:32.155 }, 00:17:32.155 "driver_specific": { 00:17:32.155 "lvol": { 00:17:32.155 "lvol_store_uuid": "6c198f22-864e-4d5f-807a-68d793120b3a", 00:17:32.155 "base_bdev": "aio_bdev", 00:17:32.155 "thin_provision": false, 00:17:32.155 "snapshot": false, 00:17:32.155 "clone": false, 00:17:32.155 "esnap_clone": false 00:17:32.155 } 00:17:32.155 } 00:17:32.155 } 00:17:32.155 ] 00:17:32.155 16:01:21 -- common/autotest_common.sh@895 -- # return 0 00:17:32.155 16:01:21 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c198f22-864e-4d5f-807a-68d793120b3a 00:17:32.155 16:01:21 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:32.414 16:01:22 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:32.414 16:01:22 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 6c198f22-864e-4d5f-807a-68d793120b3a 00:17:32.414 16:01:22 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:32.673 16:01:22 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:32.673 16:01:22 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete c314cbc5-adce-4e87-b3a2-9ec55d018e38 00:17:32.932 16:01:22 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 6c198f22-864e-4d5f-807a-68d793120b3a 00:17:33.190 16:01:22 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:33.450 16:01:23 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:33.450 00:17:33.450 real 0m17.896s 00:17:33.450 user 0m17.846s 00:17:33.450 sys 0m1.807s 00:17:33.450 16:01:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:33.450 16:01:23 -- common/autotest_common.sh@10 -- # set +x 00:17:33.450 ************************************ 00:17:33.450 END TEST lvs_grow_clean 00:17:33.450 ************************************ 00:17:33.450 16:01:23 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:33.450 16:01:23 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:33.450 16:01:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:33.450 16:01:23 -- common/autotest_common.sh@10 -- # set +x 00:17:33.450 ************************************ 00:17:33.450 START TEST lvs_grow_dirty 00:17:33.450 ************************************ 00:17:33.450 16:01:23 -- common/autotest_common.sh@1104 -- # lvs_grow dirty 00:17:33.450 16:01:23 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:33.450 16:01:23 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:33.450 16:01:23 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:33.450 16:01:23 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:33.450 16:01:23 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:33.450 16:01:23 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:33.450 16:01:23 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:33.450 16:01:23 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:33.450 16:01:23 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:33.709 16:01:23 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:33.709 16:01:23 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:33.967 16:01:23 -- target/nvmf_lvs_grow.sh@28 -- # lvs=5238181e-11e0-48fc-976c-7c5c9d32cafa 00:17:33.967 16:01:23 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5238181e-11e0-48fc-976c-7c5c9d32cafa 00:17:33.967 16:01:23 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:34.226 16:01:24 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:34.226 16:01:24 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:34.226 16:01:24 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 5238181e-11e0-48fc-976c-7c5c9d32cafa lvol 150 00:17:34.484 16:01:24 -- target/nvmf_lvs_grow.sh@33 -- # lvol=bb348b38-f951-4ee2-9a85-3e4336e033a5 00:17:34.484 16:01:24 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:34.484 16:01:24 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:34.742 [2024-10-30 16:01:24.578622] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:34.742 [2024-10-30 16:01:24.578726] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:34.742 true 00:17:34.742 16:01:24 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5238181e-11e0-48fc-976c-7c5c9d32cafa 00:17:34.742 16:01:24 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:35.310 16:01:24 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:35.310 16:01:24 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:35.310 16:01:25 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bb348b38-f951-4ee2-9a85-3e4336e033a5 00:17:35.569 16:01:25 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:35.829 16:01:25 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:36.088 16:01:25 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2413487 00:17:36.088 16:01:25 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:36.088 16:01:25 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:36.088 16:01:25 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2413487 /var/tmp/bdevperf.sock 00:17:36.088 16:01:25 -- common/autotest_common.sh@819 -- # '[' -z 2413487 ']' 00:17:36.088 16:01:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:36.088 16:01:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:36.088 16:01:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:36.088 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:36.088 16:01:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:36.088 16:01:25 -- common/autotest_common.sh@10 -- # set +x 00:17:36.347 [2024-10-30 16:01:25.982408] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:36.347 [2024-10-30 16:01:25.982480] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2413487 ] 00:17:36.347 EAL: No free 2048 kB hugepages reported on node 1 00:17:36.347 [2024-10-30 16:01:26.043326] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:36.347 [2024-10-30 16:01:26.132021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:37.280 16:01:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:37.280 16:01:26 -- common/autotest_common.sh@852 -- # return 0 00:17:37.280 16:01:26 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:37.849 Nvme0n1 00:17:37.849 16:01:27 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:38.109 [ 00:17:38.109 { 00:17:38.109 "name": "Nvme0n1", 00:17:38.109 "aliases": [ 00:17:38.109 "bb348b38-f951-4ee2-9a85-3e4336e033a5" 00:17:38.109 ], 00:17:38.109 "product_name": "NVMe disk", 00:17:38.109 "block_size": 4096, 00:17:38.109 "num_blocks": 38912, 00:17:38.109 "uuid": "bb348b38-f951-4ee2-9a85-3e4336e033a5", 00:17:38.109 "assigned_rate_limits": { 00:17:38.109 "rw_ios_per_sec": 0, 00:17:38.109 "rw_mbytes_per_sec": 0, 00:17:38.109 "r_mbytes_per_sec": 0, 00:17:38.109 "w_mbytes_per_sec": 0 00:17:38.109 }, 00:17:38.109 "claimed": false, 00:17:38.109 "zoned": false, 00:17:38.109 "supported_io_types": { 00:17:38.109 "read": true, 00:17:38.109 "write": true, 00:17:38.109 "unmap": true, 00:17:38.109 "write_zeroes": true, 00:17:38.109 "flush": true, 00:17:38.109 "reset": true, 00:17:38.109 "compare": true, 00:17:38.109 "compare_and_write": true, 00:17:38.109 "abort": true, 00:17:38.109 "nvme_admin": true, 00:17:38.109 "nvme_io": true 00:17:38.109 }, 00:17:38.109 "driver_specific": { 00:17:38.109 "nvme": [ 00:17:38.109 { 00:17:38.109 "trid": { 00:17:38.109 "trtype": "TCP", 00:17:38.109 "adrfam": "IPv4", 00:17:38.109 "traddr": "10.0.0.2", 00:17:38.109 "trsvcid": "4420", 00:17:38.109 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:38.109 }, 00:17:38.109 "ctrlr_data": { 00:17:38.109 "cntlid": 1, 00:17:38.109 "vendor_id": "0x8086", 00:17:38.109 "model_number": "SPDK bdev Controller", 00:17:38.109 "serial_number": "SPDK0", 00:17:38.109 "firmware_revision": "24.01.1", 00:17:38.109 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:38.109 "oacs": { 00:17:38.109 "security": 0, 00:17:38.109 "format": 0, 00:17:38.109 "firmware": 0, 00:17:38.109 "ns_manage": 0 00:17:38.109 }, 00:17:38.109 "multi_ctrlr": true, 00:17:38.109 "ana_reporting": false 00:17:38.109 }, 00:17:38.109 "vs": { 00:17:38.109 "nvme_version": "1.3" 00:17:38.109 }, 00:17:38.109 "ns_data": { 00:17:38.109 "id": 1, 00:17:38.109 "can_share": true 00:17:38.109 } 00:17:38.109 } 00:17:38.109 ], 00:17:38.109 "mp_policy": "active_passive" 00:17:38.109 } 00:17:38.109 } 00:17:38.109 ] 00:17:38.109 16:01:27 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2413652 00:17:38.109 16:01:27 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:38.109 16:01:27 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:38.109 Running I/O for 10 seconds... 00:17:39.050 Latency(us) 00:17:39.050 [2024-10-30T15:01:28.926Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:39.050 [2024-10-30T15:01:28.926Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:39.050 Nvme0n1 : 1.00 14637.00 57.18 0.00 0.00 0.00 0.00 0.00 00:17:39.050 [2024-10-30T15:01:28.926Z] =================================================================================================================== 00:17:39.050 [2024-10-30T15:01:28.926Z] Total : 14637.00 57.18 0.00 0.00 0.00 0.00 0.00 00:17:39.050 00:17:39.983 16:01:29 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 5238181e-11e0-48fc-976c-7c5c9d32cafa 00:17:40.241 [2024-10-30T15:01:30.117Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.241 Nvme0n1 : 2.00 14814.50 57.87 0.00 0.00 0.00 0.00 0.00 00:17:40.241 [2024-10-30T15:01:30.117Z] =================================================================================================================== 00:17:40.241 [2024-10-30T15:01:30.117Z] Total : 14814.50 57.87 0.00 0.00 0.00 0.00 0.00 00:17:40.241 00:17:40.241 true 00:17:40.241 16:01:30 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5238181e-11e0-48fc-976c-7c5c9d32cafa 00:17:40.241 16:01:30 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:40.498 16:01:30 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:40.498 16:01:30 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:40.498 16:01:30 -- target/nvmf_lvs_grow.sh@65 -- # wait 2413652 00:17:41.063 [2024-10-30T15:01:30.939Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:41.063 Nvme0n1 : 3.00 14957.33 58.43 0.00 0.00 0.00 0.00 0.00 00:17:41.063 [2024-10-30T15:01:30.939Z] =================================================================================================================== 00:17:41.063 [2024-10-30T15:01:30.939Z] Total : 14957.33 58.43 0.00 0.00 0.00 0.00 0.00 00:17:41.063 00:17:42.437 [2024-10-30T15:01:32.313Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:42.437 Nvme0n1 : 4.00 15012.25 58.64 0.00 0.00 0.00 0.00 0.00 00:17:42.437 [2024-10-30T15:01:32.313Z] =================================================================================================================== 00:17:42.437 [2024-10-30T15:01:32.313Z] Total : 15012.25 58.64 0.00 0.00 0.00 0.00 0.00 00:17:42.437 00:17:43.371 [2024-10-30T15:01:33.247Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:43.371 Nvme0n1 : 5.00 15061.60 58.83 0.00 0.00 0.00 0.00 0.00 00:17:43.371 [2024-10-30T15:01:33.247Z] =================================================================================================================== 00:17:43.371 [2024-10-30T15:01:33.247Z] Total : 15061.60 58.83 0.00 0.00 0.00 0.00 0.00 00:17:43.371 00:17:44.305 [2024-10-30T15:01:34.181Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:44.305 Nvme0n1 : 6.00 15103.83 59.00 0.00 0.00 0.00 0.00 0.00 00:17:44.305 [2024-10-30T15:01:34.181Z] =================================================================================================================== 00:17:44.305 [2024-10-30T15:01:34.181Z] Total : 15103.83 59.00 0.00 0.00 0.00 0.00 0.00 00:17:44.305 00:17:45.238 [2024-10-30T15:01:35.114Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.238 Nvme0n1 : 7.00 15142.86 59.15 0.00 0.00 0.00 0.00 0.00 00:17:45.238 [2024-10-30T15:01:35.114Z] =================================================================================================================== 00:17:45.238 [2024-10-30T15:01:35.114Z] Total : 15142.86 59.15 0.00 0.00 0.00 0.00 0.00 00:17:45.238 00:17:46.171 [2024-10-30T15:01:36.047Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:46.171 Nvme0n1 : 8.00 15187.12 59.32 0.00 0.00 0.00 0.00 0.00 00:17:46.171 [2024-10-30T15:01:36.047Z] =================================================================================================================== 00:17:46.171 [2024-10-30T15:01:36.047Z] Total : 15187.12 59.32 0.00 0.00 0.00 0.00 0.00 00:17:46.171 00:17:47.106 [2024-10-30T15:01:36.982Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:47.106 Nvme0n1 : 9.00 15201.78 59.38 0.00 0.00 0.00 0.00 0.00 00:17:47.106 [2024-10-30T15:01:36.982Z] =================================================================================================================== 00:17:47.106 [2024-10-30T15:01:36.982Z] Total : 15201.78 59.38 0.00 0.00 0.00 0.00 0.00 00:17:47.106 00:17:48.039 [2024-10-30T15:01:37.915Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:48.039 Nvme0n1 : 10.00 15224.80 59.47 0.00 0.00 0.00 0.00 0.00 00:17:48.039 [2024-10-30T15:01:37.915Z] =================================================================================================================== 00:17:48.039 [2024-10-30T15:01:37.915Z] Total : 15224.80 59.47 0.00 0.00 0.00 0.00 0.00 00:17:48.039 00:17:48.296 00:17:48.296 Latency(us) 00:17:48.296 [2024-10-30T15:01:38.172Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:48.296 [2024-10-30T15:01:38.172Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:48.296 Nvme0n1 : 10.01 15227.58 59.48 0.00 0.00 8401.16 2888.44 22233.69 00:17:48.296 [2024-10-30T15:01:38.172Z] =================================================================================================================== 00:17:48.296 [2024-10-30T15:01:38.172Z] Total : 15227.58 59.48 0.00 0.00 8401.16 2888.44 22233.69 00:17:48.296 0 00:17:48.296 16:01:37 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2413487 00:17:48.296 16:01:37 -- common/autotest_common.sh@926 -- # '[' -z 2413487 ']' 00:17:48.296 16:01:37 -- common/autotest_common.sh@930 -- # kill -0 2413487 00:17:48.296 16:01:37 -- common/autotest_common.sh@931 -- # uname 00:17:48.296 16:01:37 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:48.296 16:01:37 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2413487 00:17:48.296 16:01:37 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:48.296 16:01:37 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:48.296 16:01:37 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2413487' 00:17:48.296 killing process with pid 2413487 00:17:48.296 16:01:37 -- common/autotest_common.sh@945 -- # kill 2413487 00:17:48.296 Received shutdown signal, test time was about 10.000000 seconds 00:17:48.296 00:17:48.296 Latency(us) 00:17:48.296 [2024-10-30T15:01:38.172Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:48.296 [2024-10-30T15:01:38.172Z] =================================================================================================================== 00:17:48.296 [2024-10-30T15:01:38.172Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:48.296 16:01:37 -- common/autotest_common.sh@950 -- # wait 2413487 00:17:48.553 16:01:38 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:48.811 16:01:38 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5238181e-11e0-48fc-976c-7c5c9d32cafa 00:17:48.811 16:01:38 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:49.068 16:01:38 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:49.068 16:01:38 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:17:49.068 16:01:38 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 2410739 00:17:49.068 16:01:38 -- target/nvmf_lvs_grow.sh@74 -- # wait 2410739 00:17:49.068 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 2410739 Killed "${NVMF_APP[@]}" "$@" 00:17:49.068 16:01:38 -- target/nvmf_lvs_grow.sh@74 -- # true 00:17:49.068 16:01:38 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:17:49.068 16:01:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:49.068 16:01:38 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:49.068 16:01:38 -- common/autotest_common.sh@10 -- # set +x 00:17:49.068 16:01:38 -- nvmf/common.sh@469 -- # nvmfpid=2415002 00:17:49.068 16:01:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:49.068 16:01:38 -- nvmf/common.sh@470 -- # waitforlisten 2415002 00:17:49.068 16:01:38 -- common/autotest_common.sh@819 -- # '[' -z 2415002 ']' 00:17:49.068 16:01:38 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:49.068 16:01:38 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:49.068 16:01:38 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:49.068 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:49.068 16:01:38 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:49.068 16:01:38 -- common/autotest_common.sh@10 -- # set +x 00:17:49.068 [2024-10-30 16:01:38.764508] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:49.068 [2024-10-30 16:01:38.764606] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:49.068 EAL: No free 2048 kB hugepages reported on node 1 00:17:49.068 [2024-10-30 16:01:38.829643] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:49.068 [2024-10-30 16:01:38.916740] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:49.068 [2024-10-30 16:01:38.916887] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:49.068 [2024-10-30 16:01:38.916903] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:49.068 [2024-10-30 16:01:38.916917] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:49.068 [2024-10-30 16:01:38.916944] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:49.999 16:01:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:49.999 16:01:39 -- common/autotest_common.sh@852 -- # return 0 00:17:49.999 16:01:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:49.999 16:01:39 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:49.999 16:01:39 -- common/autotest_common.sh@10 -- # set +x 00:17:49.999 16:01:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:49.999 16:01:39 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:50.256 [2024-10-30 16:01:39.982610] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:17:50.256 [2024-10-30 16:01:39.982761] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:17:50.256 [2024-10-30 16:01:39.982819] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:17:50.256 16:01:40 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:17:50.256 16:01:40 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev bb348b38-f951-4ee2-9a85-3e4336e033a5 00:17:50.256 16:01:40 -- common/autotest_common.sh@887 -- # local bdev_name=bb348b38-f951-4ee2-9a85-3e4336e033a5 00:17:50.256 16:01:40 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:17:50.256 16:01:40 -- common/autotest_common.sh@889 -- # local i 00:17:50.256 16:01:40 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:17:50.256 16:01:40 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:17:50.256 16:01:40 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:50.520 16:01:40 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b bb348b38-f951-4ee2-9a85-3e4336e033a5 -t 2000 00:17:50.776 [ 00:17:50.776 { 00:17:50.776 "name": "bb348b38-f951-4ee2-9a85-3e4336e033a5", 00:17:50.776 "aliases": [ 00:17:50.777 "lvs/lvol" 00:17:50.777 ], 00:17:50.777 "product_name": "Logical Volume", 00:17:50.777 "block_size": 4096, 00:17:50.777 "num_blocks": 38912, 00:17:50.777 "uuid": "bb348b38-f951-4ee2-9a85-3e4336e033a5", 00:17:50.777 "assigned_rate_limits": { 00:17:50.777 "rw_ios_per_sec": 0, 00:17:50.777 "rw_mbytes_per_sec": 0, 00:17:50.777 "r_mbytes_per_sec": 0, 00:17:50.777 "w_mbytes_per_sec": 0 00:17:50.777 }, 00:17:50.777 "claimed": false, 00:17:50.777 "zoned": false, 00:17:50.777 "supported_io_types": { 00:17:50.777 "read": true, 00:17:50.777 "write": true, 00:17:50.777 "unmap": true, 00:17:50.777 "write_zeroes": true, 00:17:50.777 "flush": false, 00:17:50.777 "reset": true, 00:17:50.777 "compare": false, 00:17:50.777 "compare_and_write": false, 00:17:50.777 "abort": false, 00:17:50.777 "nvme_admin": false, 00:17:50.777 "nvme_io": false 00:17:50.777 }, 00:17:50.777 "driver_specific": { 00:17:50.777 "lvol": { 00:17:50.777 "lvol_store_uuid": "5238181e-11e0-48fc-976c-7c5c9d32cafa", 00:17:50.777 "base_bdev": "aio_bdev", 00:17:50.777 "thin_provision": false, 00:17:50.777 "snapshot": false, 00:17:50.777 "clone": false, 00:17:50.777 "esnap_clone": false 00:17:50.777 } 00:17:50.777 } 00:17:50.777 } 00:17:50.777 ] 00:17:50.777 16:01:40 -- common/autotest_common.sh@895 -- # return 0 00:17:50.777 16:01:40 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5238181e-11e0-48fc-976c-7c5c9d32cafa 00:17:50.777 16:01:40 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:17:51.034 16:01:40 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:17:51.034 16:01:40 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5238181e-11e0-48fc-976c-7c5c9d32cafa 00:17:51.034 16:01:40 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:17:51.293 16:01:41 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:17:51.293 16:01:41 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:51.551 [2024-10-30 16:01:41.360019] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:51.551 16:01:41 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5238181e-11e0-48fc-976c-7c5c9d32cafa 00:17:51.551 16:01:41 -- common/autotest_common.sh@640 -- # local es=0 00:17:51.551 16:01:41 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5238181e-11e0-48fc-976c-7c5c9d32cafa 00:17:51.551 16:01:41 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:51.551 16:01:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:51.551 16:01:41 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:51.551 16:01:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:51.551 16:01:41 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:51.551 16:01:41 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:51.551 16:01:41 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:51.551 16:01:41 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:51.551 16:01:41 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5238181e-11e0-48fc-976c-7c5c9d32cafa 00:17:51.810 request: 00:17:51.810 { 00:17:51.810 "uuid": "5238181e-11e0-48fc-976c-7c5c9d32cafa", 00:17:51.810 "method": "bdev_lvol_get_lvstores", 00:17:51.810 "req_id": 1 00:17:51.810 } 00:17:51.810 Got JSON-RPC error response 00:17:51.810 response: 00:17:51.810 { 00:17:51.810 "code": -19, 00:17:51.810 "message": "No such device" 00:17:51.810 } 00:17:51.810 16:01:41 -- common/autotest_common.sh@643 -- # es=1 00:17:51.810 16:01:41 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:51.810 16:01:41 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:51.810 16:01:41 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:51.810 16:01:41 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:52.068 aio_bdev 00:17:52.068 16:01:41 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev bb348b38-f951-4ee2-9a85-3e4336e033a5 00:17:52.068 16:01:41 -- common/autotest_common.sh@887 -- # local bdev_name=bb348b38-f951-4ee2-9a85-3e4336e033a5 00:17:52.068 16:01:41 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:17:52.068 16:01:41 -- common/autotest_common.sh@889 -- # local i 00:17:52.068 16:01:41 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:17:52.068 16:01:41 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:17:52.068 16:01:41 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:52.386 16:01:42 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b bb348b38-f951-4ee2-9a85-3e4336e033a5 -t 2000 00:17:52.664 [ 00:17:52.664 { 00:17:52.664 "name": "bb348b38-f951-4ee2-9a85-3e4336e033a5", 00:17:52.664 "aliases": [ 00:17:52.664 "lvs/lvol" 00:17:52.664 ], 00:17:52.664 "product_name": "Logical Volume", 00:17:52.664 "block_size": 4096, 00:17:52.664 "num_blocks": 38912, 00:17:52.664 "uuid": "bb348b38-f951-4ee2-9a85-3e4336e033a5", 00:17:52.664 "assigned_rate_limits": { 00:17:52.664 "rw_ios_per_sec": 0, 00:17:52.664 "rw_mbytes_per_sec": 0, 00:17:52.664 "r_mbytes_per_sec": 0, 00:17:52.664 "w_mbytes_per_sec": 0 00:17:52.664 }, 00:17:52.664 "claimed": false, 00:17:52.664 "zoned": false, 00:17:52.664 "supported_io_types": { 00:17:52.664 "read": true, 00:17:52.664 "write": true, 00:17:52.664 "unmap": true, 00:17:52.664 "write_zeroes": true, 00:17:52.664 "flush": false, 00:17:52.664 "reset": true, 00:17:52.664 "compare": false, 00:17:52.664 "compare_and_write": false, 00:17:52.664 "abort": false, 00:17:52.664 "nvme_admin": false, 00:17:52.664 "nvme_io": false 00:17:52.664 }, 00:17:52.664 "driver_specific": { 00:17:52.664 "lvol": { 00:17:52.664 "lvol_store_uuid": "5238181e-11e0-48fc-976c-7c5c9d32cafa", 00:17:52.664 "base_bdev": "aio_bdev", 00:17:52.664 "thin_provision": false, 00:17:52.664 "snapshot": false, 00:17:52.664 "clone": false, 00:17:52.664 "esnap_clone": false 00:17:52.664 } 00:17:52.664 } 00:17:52.664 } 00:17:52.664 ] 00:17:52.664 16:01:42 -- common/autotest_common.sh@895 -- # return 0 00:17:52.664 16:01:42 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5238181e-11e0-48fc-976c-7c5c9d32cafa 00:17:52.664 16:01:42 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:52.922 16:01:42 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:52.922 16:01:42 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 5238181e-11e0-48fc-976c-7c5c9d32cafa 00:17:52.922 16:01:42 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:53.180 16:01:43 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:53.180 16:01:43 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete bb348b38-f951-4ee2-9a85-3e4336e033a5 00:17:53.438 16:01:43 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 5238181e-11e0-48fc-976c-7c5c9d32cafa 00:17:53.696 16:01:43 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:54.262 16:01:43 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:54.262 00:17:54.262 real 0m20.568s 00:17:54.262 user 0m51.525s 00:17:54.262 sys 0m4.453s 00:17:54.262 16:01:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:54.262 16:01:43 -- common/autotest_common.sh@10 -- # set +x 00:17:54.262 ************************************ 00:17:54.262 END TEST lvs_grow_dirty 00:17:54.262 ************************************ 00:17:54.262 16:01:43 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:17:54.262 16:01:43 -- common/autotest_common.sh@796 -- # type=--id 00:17:54.262 16:01:43 -- common/autotest_common.sh@797 -- # id=0 00:17:54.262 16:01:43 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:17:54.262 16:01:43 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:54.262 16:01:43 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:17:54.262 16:01:43 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:17:54.262 16:01:43 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:17:54.262 16:01:43 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:54.262 nvmf_trace.0 00:17:54.262 16:01:43 -- common/autotest_common.sh@811 -- # return 0 00:17:54.262 16:01:43 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:17:54.262 16:01:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:54.262 16:01:43 -- nvmf/common.sh@116 -- # sync 00:17:54.262 16:01:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:54.262 16:01:43 -- nvmf/common.sh@119 -- # set +e 00:17:54.262 16:01:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:54.262 16:01:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:54.262 rmmod nvme_tcp 00:17:54.262 rmmod nvme_fabrics 00:17:54.262 rmmod nvme_keyring 00:17:54.262 16:01:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:54.262 16:01:43 -- nvmf/common.sh@123 -- # set -e 00:17:54.262 16:01:43 -- nvmf/common.sh@124 -- # return 0 00:17:54.262 16:01:43 -- nvmf/common.sh@477 -- # '[' -n 2415002 ']' 00:17:54.262 16:01:43 -- nvmf/common.sh@478 -- # killprocess 2415002 00:17:54.262 16:01:43 -- common/autotest_common.sh@926 -- # '[' -z 2415002 ']' 00:17:54.262 16:01:43 -- common/autotest_common.sh@930 -- # kill -0 2415002 00:17:54.262 16:01:43 -- common/autotest_common.sh@931 -- # uname 00:17:54.262 16:01:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:54.262 16:01:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2415002 00:17:54.262 16:01:44 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:17:54.262 16:01:44 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:17:54.262 16:01:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2415002' 00:17:54.262 killing process with pid 2415002 00:17:54.262 16:01:44 -- common/autotest_common.sh@945 -- # kill 2415002 00:17:54.262 16:01:44 -- common/autotest_common.sh@950 -- # wait 2415002 00:17:54.521 16:01:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:54.521 16:01:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:54.521 16:01:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:54.521 16:01:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:54.521 16:01:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:54.521 16:01:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:54.521 16:01:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:54.521 16:01:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:56.426 16:01:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:56.426 00:17:56.426 real 0m44.317s 00:17:56.426 user 1m16.022s 00:17:56.426 sys 0m8.152s 00:17:56.426 16:01:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:56.426 16:01:46 -- common/autotest_common.sh@10 -- # set +x 00:17:56.426 ************************************ 00:17:56.426 END TEST nvmf_lvs_grow 00:17:56.426 ************************************ 00:17:56.426 16:01:46 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:56.426 16:01:46 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:56.426 16:01:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:56.426 16:01:46 -- common/autotest_common.sh@10 -- # set +x 00:17:56.426 ************************************ 00:17:56.427 START TEST nvmf_bdev_io_wait 00:17:56.427 ************************************ 00:17:56.427 16:01:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:56.685 * Looking for test storage... 00:17:56.685 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:56.685 16:01:46 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:56.685 16:01:46 -- nvmf/common.sh@7 -- # uname -s 00:17:56.685 16:01:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:56.685 16:01:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:56.685 16:01:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:56.685 16:01:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:56.685 16:01:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:56.685 16:01:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:56.685 16:01:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:56.685 16:01:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:56.685 16:01:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:56.685 16:01:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:56.685 16:01:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:56.685 16:01:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:56.685 16:01:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:56.685 16:01:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:56.685 16:01:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:56.685 16:01:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:56.685 16:01:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:56.685 16:01:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:56.685 16:01:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:56.685 16:01:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.685 16:01:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.685 16:01:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.686 16:01:46 -- paths/export.sh@5 -- # export PATH 00:17:56.686 16:01:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.686 16:01:46 -- nvmf/common.sh@46 -- # : 0 00:17:56.686 16:01:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:56.686 16:01:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:56.686 16:01:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:56.686 16:01:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:56.686 16:01:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:56.686 16:01:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:56.686 16:01:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:56.686 16:01:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:56.686 16:01:46 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:56.686 16:01:46 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:56.686 16:01:46 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:17:56.686 16:01:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:56.686 16:01:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:56.686 16:01:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:56.686 16:01:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:56.686 16:01:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:56.686 16:01:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:56.686 16:01:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:56.686 16:01:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:56.686 16:01:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:56.686 16:01:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:56.686 16:01:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:56.686 16:01:46 -- common/autotest_common.sh@10 -- # set +x 00:17:58.587 16:01:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:58.587 16:01:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:58.587 16:01:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:58.587 16:01:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:58.587 16:01:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:58.587 16:01:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:58.587 16:01:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:58.587 16:01:48 -- nvmf/common.sh@294 -- # net_devs=() 00:17:58.587 16:01:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:58.587 16:01:48 -- nvmf/common.sh@295 -- # e810=() 00:17:58.587 16:01:48 -- nvmf/common.sh@295 -- # local -ga e810 00:17:58.587 16:01:48 -- nvmf/common.sh@296 -- # x722=() 00:17:58.588 16:01:48 -- nvmf/common.sh@296 -- # local -ga x722 00:17:58.588 16:01:48 -- nvmf/common.sh@297 -- # mlx=() 00:17:58.588 16:01:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:58.588 16:01:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:58.588 16:01:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:58.588 16:01:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:58.588 16:01:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:58.588 16:01:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:58.588 16:01:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:58.588 16:01:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:58.588 16:01:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:58.588 16:01:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:58.588 16:01:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:58.588 16:01:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:58.588 16:01:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:58.588 16:01:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:58.588 16:01:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:58.588 16:01:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:58.588 16:01:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:58.588 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:58.588 16:01:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:58.588 16:01:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:58.588 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:58.588 16:01:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:58.588 16:01:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:58.588 16:01:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:58.588 16:01:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:58.588 16:01:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:58.588 16:01:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:58.588 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:58.588 16:01:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:58.588 16:01:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:58.588 16:01:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:58.588 16:01:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:58.588 16:01:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:58.588 16:01:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:58.588 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:58.588 16:01:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:58.588 16:01:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:58.588 16:01:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:58.588 16:01:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:58.588 16:01:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:58.588 16:01:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:58.588 16:01:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:58.588 16:01:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:58.588 16:01:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:58.588 16:01:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:58.588 16:01:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:58.588 16:01:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:58.588 16:01:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:58.588 16:01:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:58.588 16:01:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:58.588 16:01:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:58.588 16:01:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:58.588 16:01:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:58.588 16:01:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:58.588 16:01:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:58.588 16:01:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:58.588 16:01:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:58.588 16:01:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:58.588 16:01:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:58.588 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:58.588 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.289 ms 00:17:58.588 00:17:58.588 --- 10.0.0.2 ping statistics --- 00:17:58.588 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:58.588 rtt min/avg/max/mdev = 0.289/0.289/0.289/0.000 ms 00:17:58.588 16:01:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:58.588 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:58.588 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:17:58.588 00:17:58.588 --- 10.0.0.1 ping statistics --- 00:17:58.588 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:58.588 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:17:58.588 16:01:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:58.588 16:01:48 -- nvmf/common.sh@410 -- # return 0 00:17:58.588 16:01:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:58.588 16:01:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:58.588 16:01:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:58.588 16:01:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:58.588 16:01:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:58.588 16:01:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:58.846 16:01:48 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:17:58.846 16:01:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:58.846 16:01:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:58.846 16:01:48 -- common/autotest_common.sh@10 -- # set +x 00:17:58.846 16:01:48 -- nvmf/common.sh@469 -- # nvmfpid=2417679 00:17:58.846 16:01:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:17:58.846 16:01:48 -- nvmf/common.sh@470 -- # waitforlisten 2417679 00:17:58.846 16:01:48 -- common/autotest_common.sh@819 -- # '[' -z 2417679 ']' 00:17:58.846 16:01:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:58.846 16:01:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:58.846 16:01:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:58.846 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:58.846 16:01:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:58.846 16:01:48 -- common/autotest_common.sh@10 -- # set +x 00:17:58.846 [2024-10-30 16:01:48.533950] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:58.846 [2024-10-30 16:01:48.534033] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:58.846 EAL: No free 2048 kB hugepages reported on node 1 00:17:58.846 [2024-10-30 16:01:48.598069] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:58.846 [2024-10-30 16:01:48.682920] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:58.846 [2024-10-30 16:01:48.683066] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:58.846 [2024-10-30 16:01:48.683082] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:58.846 [2024-10-30 16:01:48.683098] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:58.846 [2024-10-30 16:01:48.683343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:58.846 [2024-10-30 16:01:48.683370] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:58.846 [2024-10-30 16:01:48.683421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:58.846 [2024-10-30 16:01:48.683424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:59.105 16:01:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:59.105 16:01:48 -- common/autotest_common.sh@852 -- # return 0 00:17:59.105 16:01:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:59.105 16:01:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:59.105 16:01:48 -- common/autotest_common.sh@10 -- # set +x 00:17:59.105 16:01:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:17:59.105 16:01:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:59.105 16:01:48 -- common/autotest_common.sh@10 -- # set +x 00:17:59.105 16:01:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:17:59.105 16:01:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:59.105 16:01:48 -- common/autotest_common.sh@10 -- # set +x 00:17:59.105 16:01:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:59.105 16:01:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:59.105 16:01:48 -- common/autotest_common.sh@10 -- # set +x 00:17:59.105 [2024-10-30 16:01:48.852406] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:59.105 16:01:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:59.105 16:01:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:59.105 16:01:48 -- common/autotest_common.sh@10 -- # set +x 00:17:59.105 Malloc0 00:17:59.105 16:01:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:59.105 16:01:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:59.105 16:01:48 -- common/autotest_common.sh@10 -- # set +x 00:17:59.105 16:01:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:59.105 16:01:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:59.105 16:01:48 -- common/autotest_common.sh@10 -- # set +x 00:17:59.105 16:01:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:59.105 16:01:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:17:59.105 16:01:48 -- common/autotest_common.sh@10 -- # set +x 00:17:59.105 [2024-10-30 16:01:48.918944] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:59.105 16:01:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=2417710 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@30 -- # READ_PID=2417711 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:17:59.105 16:01:48 -- nvmf/common.sh@520 -- # config=() 00:17:59.105 16:01:48 -- nvmf/common.sh@520 -- # local subsystem config 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=2417714 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:17:59.105 16:01:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:59.105 16:01:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:59.105 { 00:17:59.105 "params": { 00:17:59.105 "name": "Nvme$subsystem", 00:17:59.105 "trtype": "$TEST_TRANSPORT", 00:17:59.105 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:59.105 "adrfam": "ipv4", 00:17:59.105 "trsvcid": "$NVMF_PORT", 00:17:59.105 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:59.105 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:59.105 "hdgst": ${hdgst:-false}, 00:17:59.105 "ddgst": ${ddgst:-false} 00:17:59.105 }, 00:17:59.105 "method": "bdev_nvme_attach_controller" 00:17:59.105 } 00:17:59.105 EOF 00:17:59.105 )") 00:17:59.105 16:01:48 -- nvmf/common.sh@520 -- # config=() 00:17:59.105 16:01:48 -- nvmf/common.sh@520 -- # local subsystem config 00:17:59.105 16:01:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:59.105 16:01:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:59.105 { 00:17:59.105 "params": { 00:17:59.105 "name": "Nvme$subsystem", 00:17:59.105 "trtype": "$TEST_TRANSPORT", 00:17:59.105 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:59.105 "adrfam": "ipv4", 00:17:59.105 "trsvcid": "$NVMF_PORT", 00:17:59.105 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:59.105 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:59.105 "hdgst": ${hdgst:-false}, 00:17:59.105 "ddgst": ${ddgst:-false} 00:17:59.105 }, 00:17:59.105 "method": "bdev_nvme_attach_controller" 00:17:59.105 } 00:17:59.105 EOF 00:17:59.105 )") 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=2417716 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@35 -- # sync 00:17:59.105 16:01:48 -- nvmf/common.sh@520 -- # config=() 00:17:59.105 16:01:48 -- nvmf/common.sh@520 -- # local subsystem config 00:17:59.105 16:01:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:17:59.105 16:01:48 -- nvmf/common.sh@542 -- # cat 00:17:59.105 16:01:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:59.105 { 00:17:59.105 "params": { 00:17:59.105 "name": "Nvme$subsystem", 00:17:59.105 "trtype": "$TEST_TRANSPORT", 00:17:59.105 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:59.105 "adrfam": "ipv4", 00:17:59.105 "trsvcid": "$NVMF_PORT", 00:17:59.105 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:59.105 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:59.105 "hdgst": ${hdgst:-false}, 00:17:59.105 "ddgst": ${ddgst:-false} 00:17:59.105 }, 00:17:59.105 "method": "bdev_nvme_attach_controller" 00:17:59.105 } 00:17:59.105 EOF 00:17:59.105 )") 00:17:59.105 16:01:48 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:17:59.105 16:01:48 -- nvmf/common.sh@520 -- # config=() 00:17:59.105 16:01:48 -- nvmf/common.sh@520 -- # local subsystem config 00:17:59.105 16:01:48 -- nvmf/common.sh@542 -- # cat 00:17:59.105 16:01:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:59.105 16:01:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:59.105 { 00:17:59.105 "params": { 00:17:59.105 "name": "Nvme$subsystem", 00:17:59.105 "trtype": "$TEST_TRANSPORT", 00:17:59.105 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:59.105 "adrfam": "ipv4", 00:17:59.106 "trsvcid": "$NVMF_PORT", 00:17:59.106 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:59.106 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:59.106 "hdgst": ${hdgst:-false}, 00:17:59.106 "ddgst": ${ddgst:-false} 00:17:59.106 }, 00:17:59.106 "method": "bdev_nvme_attach_controller" 00:17:59.106 } 00:17:59.106 EOF 00:17:59.106 )") 00:17:59.106 16:01:48 -- nvmf/common.sh@542 -- # cat 00:17:59.106 16:01:48 -- target/bdev_io_wait.sh@37 -- # wait 2417710 00:17:59.106 16:01:48 -- nvmf/common.sh@542 -- # cat 00:17:59.106 16:01:48 -- nvmf/common.sh@544 -- # jq . 00:17:59.106 16:01:48 -- nvmf/common.sh@544 -- # jq . 00:17:59.106 16:01:48 -- nvmf/common.sh@544 -- # jq . 00:17:59.106 16:01:48 -- nvmf/common.sh@545 -- # IFS=, 00:17:59.106 16:01:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:59.106 "params": { 00:17:59.106 "name": "Nvme1", 00:17:59.106 "trtype": "tcp", 00:17:59.106 "traddr": "10.0.0.2", 00:17:59.106 "adrfam": "ipv4", 00:17:59.106 "trsvcid": "4420", 00:17:59.106 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:59.106 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:59.106 "hdgst": false, 00:17:59.106 "ddgst": false 00:17:59.106 }, 00:17:59.106 "method": "bdev_nvme_attach_controller" 00:17:59.106 }' 00:17:59.106 16:01:48 -- nvmf/common.sh@544 -- # jq . 00:17:59.106 16:01:48 -- nvmf/common.sh@545 -- # IFS=, 00:17:59.106 16:01:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:59.106 "params": { 00:17:59.106 "name": "Nvme1", 00:17:59.106 "trtype": "tcp", 00:17:59.106 "traddr": "10.0.0.2", 00:17:59.106 "adrfam": "ipv4", 00:17:59.106 "trsvcid": "4420", 00:17:59.106 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:59.106 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:59.106 "hdgst": false, 00:17:59.106 "ddgst": false 00:17:59.106 }, 00:17:59.106 "method": "bdev_nvme_attach_controller" 00:17:59.106 }' 00:17:59.106 16:01:48 -- nvmf/common.sh@545 -- # IFS=, 00:17:59.106 16:01:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:59.106 "params": { 00:17:59.106 "name": "Nvme1", 00:17:59.106 "trtype": "tcp", 00:17:59.106 "traddr": "10.0.0.2", 00:17:59.106 "adrfam": "ipv4", 00:17:59.106 "trsvcid": "4420", 00:17:59.106 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:59.106 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:59.106 "hdgst": false, 00:17:59.106 "ddgst": false 00:17:59.106 }, 00:17:59.106 "method": "bdev_nvme_attach_controller" 00:17:59.106 }' 00:17:59.106 16:01:48 -- nvmf/common.sh@545 -- # IFS=, 00:17:59.106 16:01:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:59.106 "params": { 00:17:59.106 "name": "Nvme1", 00:17:59.106 "trtype": "tcp", 00:17:59.106 "traddr": "10.0.0.2", 00:17:59.106 "adrfam": "ipv4", 00:17:59.106 "trsvcid": "4420", 00:17:59.106 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:59.106 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:59.106 "hdgst": false, 00:17:59.106 "ddgst": false 00:17:59.106 }, 00:17:59.106 "method": "bdev_nvme_attach_controller" 00:17:59.106 }' 00:17:59.106 [2024-10-30 16:01:48.964731] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:59.106 [2024-10-30 16:01:48.964810] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:17:59.106 [2024-10-30 16:01:48.965113] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:59.106 [2024-10-30 16:01:48.965112] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:59.106 [2024-10-30 16:01:48.965113] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:17:59.106 [2024-10-30 16:01:48.965198] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-10-30 16:01:48.965199] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-10-30 16:01:48.965199] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:17:59.106 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:17:59.106 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:17:59.364 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.364 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.364 [2024-10-30 16:01:49.140140] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:59.364 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.364 [2024-10-30 16:01:49.212207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:59.364 [2024-10-30 16:01:49.239313] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:59.622 [2024-10-30 16:01:49.315692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:59.622 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.622 [2024-10-30 16:01:49.344877] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:59.622 [2024-10-30 16:01:49.415122] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:59.622 [2024-10-30 16:01:49.419741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:59.622 [2024-10-30 16:01:49.483975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:17:59.881 Running I/O for 1 seconds... 00:17:59.881 Running I/O for 1 seconds... 00:17:59.881 Running I/O for 1 seconds... 00:18:00.138 Running I/O for 1 seconds... 00:18:01.071 00:18:01.071 Latency(us) 00:18:01.071 [2024-10-30T15:01:50.947Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:01.071 [2024-10-30T15:01:50.947Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:01.071 Nvme1n1 : 1.00 194885.53 761.27 0.00 0.00 654.28 257.90 928.43 00:18:01.071 [2024-10-30T15:01:50.947Z] =================================================================================================================== 00:18:01.071 [2024-10-30T15:01:50.947Z] Total : 194885.53 761.27 0.00 0.00 654.28 257.90 928.43 00:18:01.071 00:18:01.071 Latency(us) 00:18:01.071 [2024-10-30T15:01:50.947Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:01.071 [2024-10-30T15:01:50.947Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:01.072 Nvme1n1 : 1.01 8448.03 33.00 0.00 0.00 15084.01 8349.77 22233.69 00:18:01.072 [2024-10-30T15:01:50.948Z] =================================================================================================================== 00:18:01.072 [2024-10-30T15:01:50.948Z] Total : 8448.03 33.00 0.00 0.00 15084.01 8349.77 22233.69 00:18:01.072 00:18:01.072 Latency(us) 00:18:01.072 [2024-10-30T15:01:50.948Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:01.072 [2024-10-30T15:01:50.948Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:01.072 Nvme1n1 : 1.01 10075.70 39.36 0.00 0.00 12656.10 6602.15 25049.32 00:18:01.072 [2024-10-30T15:01:50.948Z] =================================================================================================================== 00:18:01.072 [2024-10-30T15:01:50.948Z] Total : 10075.70 39.36 0.00 0.00 12656.10 6602.15 25049.32 00:18:01.072 00:18:01.072 Latency(us) 00:18:01.072 [2024-10-30T15:01:50.948Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:01.072 [2024-10-30T15:01:50.948Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:01.072 Nvme1n1 : 1.01 8958.07 34.99 0.00 0.00 14222.51 8252.68 27379.48 00:18:01.072 [2024-10-30T15:01:50.948Z] =================================================================================================================== 00:18:01.072 [2024-10-30T15:01:50.948Z] Total : 8958.07 34.99 0.00 0.00 14222.51 8252.68 27379.48 00:18:01.329 16:01:51 -- target/bdev_io_wait.sh@38 -- # wait 2417711 00:18:01.329 16:01:51 -- target/bdev_io_wait.sh@39 -- # wait 2417714 00:18:01.329 16:01:51 -- target/bdev_io_wait.sh@40 -- # wait 2417716 00:18:01.329 16:01:51 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:01.329 16:01:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:01.329 16:01:51 -- common/autotest_common.sh@10 -- # set +x 00:18:01.330 16:01:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:01.330 16:01:51 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:01.330 16:01:51 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:01.330 16:01:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:01.330 16:01:51 -- nvmf/common.sh@116 -- # sync 00:18:01.330 16:01:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:01.330 16:01:51 -- nvmf/common.sh@119 -- # set +e 00:18:01.330 16:01:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:01.330 16:01:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:01.330 rmmod nvme_tcp 00:18:01.330 rmmod nvme_fabrics 00:18:01.330 rmmod nvme_keyring 00:18:01.330 16:01:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:01.330 16:01:51 -- nvmf/common.sh@123 -- # set -e 00:18:01.330 16:01:51 -- nvmf/common.sh@124 -- # return 0 00:18:01.330 16:01:51 -- nvmf/common.sh@477 -- # '[' -n 2417679 ']' 00:18:01.330 16:01:51 -- nvmf/common.sh@478 -- # killprocess 2417679 00:18:01.330 16:01:51 -- common/autotest_common.sh@926 -- # '[' -z 2417679 ']' 00:18:01.330 16:01:51 -- common/autotest_common.sh@930 -- # kill -0 2417679 00:18:01.587 16:01:51 -- common/autotest_common.sh@931 -- # uname 00:18:01.587 16:01:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:01.587 16:01:51 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2417679 00:18:01.587 16:01:51 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:18:01.587 16:01:51 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:18:01.587 16:01:51 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2417679' 00:18:01.587 killing process with pid 2417679 00:18:01.587 16:01:51 -- common/autotest_common.sh@945 -- # kill 2417679 00:18:01.587 16:01:51 -- common/autotest_common.sh@950 -- # wait 2417679 00:18:01.845 16:01:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:01.845 16:01:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:01.845 16:01:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:01.845 16:01:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:01.845 16:01:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:01.845 16:01:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:01.845 16:01:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:01.845 16:01:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:03.747 16:01:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:03.747 00:18:03.747 real 0m7.234s 00:18:03.747 user 0m16.669s 00:18:03.747 sys 0m3.730s 00:18:03.747 16:01:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:03.747 16:01:53 -- common/autotest_common.sh@10 -- # set +x 00:18:03.747 ************************************ 00:18:03.747 END TEST nvmf_bdev_io_wait 00:18:03.747 ************************************ 00:18:03.747 16:01:53 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:03.747 16:01:53 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:03.747 16:01:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:03.747 16:01:53 -- common/autotest_common.sh@10 -- # set +x 00:18:03.747 ************************************ 00:18:03.747 START TEST nvmf_queue_depth 00:18:03.747 ************************************ 00:18:03.747 16:01:53 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:03.747 * Looking for test storage... 00:18:03.747 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:03.747 16:01:53 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:03.747 16:01:53 -- nvmf/common.sh@7 -- # uname -s 00:18:03.747 16:01:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:03.747 16:01:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:03.747 16:01:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:03.747 16:01:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:03.747 16:01:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:03.747 16:01:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:03.747 16:01:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:03.747 16:01:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:03.747 16:01:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:03.747 16:01:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:03.747 16:01:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:03.747 16:01:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:03.747 16:01:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:03.747 16:01:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:03.747 16:01:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:03.747 16:01:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:03.747 16:01:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:03.747 16:01:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:03.747 16:01:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:03.747 16:01:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:03.747 16:01:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:03.747 16:01:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:03.747 16:01:53 -- paths/export.sh@5 -- # export PATH 00:18:03.747 16:01:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:03.747 16:01:53 -- nvmf/common.sh@46 -- # : 0 00:18:03.747 16:01:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:03.747 16:01:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:03.747 16:01:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:03.747 16:01:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:03.747 16:01:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:03.747 16:01:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:03.747 16:01:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:03.747 16:01:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:03.747 16:01:53 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:03.747 16:01:53 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:03.747 16:01:53 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:03.747 16:01:53 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:03.747 16:01:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:03.747 16:01:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:03.747 16:01:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:03.747 16:01:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:03.747 16:01:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:03.747 16:01:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:03.747 16:01:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:03.747 16:01:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:03.747 16:01:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:03.747 16:01:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:03.747 16:01:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:03.747 16:01:53 -- common/autotest_common.sh@10 -- # set +x 00:18:06.276 16:01:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:06.276 16:01:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:06.276 16:01:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:06.276 16:01:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:06.276 16:01:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:06.276 16:01:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:06.276 16:01:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:06.276 16:01:55 -- nvmf/common.sh@294 -- # net_devs=() 00:18:06.276 16:01:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:06.276 16:01:55 -- nvmf/common.sh@295 -- # e810=() 00:18:06.276 16:01:55 -- nvmf/common.sh@295 -- # local -ga e810 00:18:06.276 16:01:55 -- nvmf/common.sh@296 -- # x722=() 00:18:06.276 16:01:55 -- nvmf/common.sh@296 -- # local -ga x722 00:18:06.276 16:01:55 -- nvmf/common.sh@297 -- # mlx=() 00:18:06.276 16:01:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:06.276 16:01:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:06.276 16:01:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:06.276 16:01:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:06.276 16:01:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:06.276 16:01:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:06.276 16:01:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:06.276 16:01:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:06.276 16:01:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:06.276 16:01:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:06.276 16:01:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:06.276 16:01:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:06.276 16:01:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:06.276 16:01:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:06.276 16:01:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:06.276 16:01:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:06.276 16:01:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:06.276 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:06.276 16:01:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:06.276 16:01:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:06.276 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:06.276 16:01:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:06.276 16:01:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:06.276 16:01:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:06.276 16:01:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:06.276 16:01:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:06.276 16:01:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:06.276 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:06.276 16:01:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:06.276 16:01:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:06.276 16:01:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:06.276 16:01:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:06.276 16:01:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:06.276 16:01:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:06.276 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:06.276 16:01:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:06.276 16:01:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:06.276 16:01:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:06.276 16:01:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:06.276 16:01:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:06.276 16:01:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:06.276 16:01:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:06.276 16:01:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:06.276 16:01:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:06.276 16:01:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:06.276 16:01:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:06.276 16:01:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:06.276 16:01:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:06.276 16:01:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:06.276 16:01:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:06.276 16:01:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:06.276 16:01:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:06.276 16:01:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:06.276 16:01:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:06.276 16:01:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:06.276 16:01:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:06.276 16:01:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:06.276 16:01:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:06.276 16:01:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:06.276 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:06.276 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.211 ms 00:18:06.276 00:18:06.276 --- 10.0.0.2 ping statistics --- 00:18:06.276 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:06.276 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:18:06.276 16:01:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:06.276 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:06.276 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.143 ms 00:18:06.276 00:18:06.276 --- 10.0.0.1 ping statistics --- 00:18:06.276 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:06.276 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:18:06.276 16:01:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:06.276 16:01:55 -- nvmf/common.sh@410 -- # return 0 00:18:06.276 16:01:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:06.276 16:01:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:06.276 16:01:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:06.276 16:01:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:06.276 16:01:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:06.276 16:01:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:06.276 16:01:55 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:06.276 16:01:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:06.276 16:01:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:06.276 16:01:55 -- common/autotest_common.sh@10 -- # set +x 00:18:06.276 16:01:55 -- nvmf/common.sh@469 -- # nvmfpid=2419953 00:18:06.276 16:01:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:06.276 16:01:55 -- nvmf/common.sh@470 -- # waitforlisten 2419953 00:18:06.276 16:01:55 -- common/autotest_common.sh@819 -- # '[' -z 2419953 ']' 00:18:06.276 16:01:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:06.276 16:01:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:06.276 16:01:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:06.276 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:06.276 16:01:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:06.276 16:01:55 -- common/autotest_common.sh@10 -- # set +x 00:18:06.276 [2024-10-30 16:01:55.938211] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:18:06.276 [2024-10-30 16:01:55.938314] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:06.276 EAL: No free 2048 kB hugepages reported on node 1 00:18:06.276 [2024-10-30 16:01:56.002857] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:06.276 [2024-10-30 16:01:56.091442] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:06.276 [2024-10-30 16:01:56.091585] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:06.276 [2024-10-30 16:01:56.091601] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:06.276 [2024-10-30 16:01:56.091613] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:06.276 [2024-10-30 16:01:56.091640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:07.210 16:01:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:07.210 16:01:56 -- common/autotest_common.sh@852 -- # return 0 00:18:07.210 16:01:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:07.210 16:01:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:07.210 16:01:56 -- common/autotest_common.sh@10 -- # set +x 00:18:07.210 16:01:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:07.210 16:01:56 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:07.210 16:01:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:07.210 16:01:56 -- common/autotest_common.sh@10 -- # set +x 00:18:07.210 [2024-10-30 16:01:56.933182] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:07.210 16:01:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:07.210 16:01:56 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:07.210 16:01:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:07.210 16:01:56 -- common/autotest_common.sh@10 -- # set +x 00:18:07.210 Malloc0 00:18:07.210 16:01:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:07.210 16:01:56 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:07.210 16:01:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:07.210 16:01:56 -- common/autotest_common.sh@10 -- # set +x 00:18:07.210 16:01:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:07.210 16:01:56 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:07.210 16:01:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:07.210 16:01:56 -- common/autotest_common.sh@10 -- # set +x 00:18:07.210 16:01:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:07.210 16:01:56 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:07.210 16:01:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:07.210 16:01:56 -- common/autotest_common.sh@10 -- # set +x 00:18:07.211 [2024-10-30 16:01:56.991017] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:07.211 16:01:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:07.211 16:01:56 -- target/queue_depth.sh@30 -- # bdevperf_pid=2420109 00:18:07.211 16:01:56 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:07.211 16:01:56 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:07.211 16:01:56 -- target/queue_depth.sh@33 -- # waitforlisten 2420109 /var/tmp/bdevperf.sock 00:18:07.211 16:01:56 -- common/autotest_common.sh@819 -- # '[' -z 2420109 ']' 00:18:07.211 16:01:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:07.211 16:01:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:07.211 16:01:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:07.211 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:07.211 16:01:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:07.211 16:01:56 -- common/autotest_common.sh@10 -- # set +x 00:18:07.211 [2024-10-30 16:01:57.034779] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:18:07.211 [2024-10-30 16:01:57.034841] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2420109 ] 00:18:07.211 EAL: No free 2048 kB hugepages reported on node 1 00:18:07.469 [2024-10-30 16:01:57.096440] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:07.469 [2024-10-30 16:01:57.186020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:08.402 16:01:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:08.402 16:01:58 -- common/autotest_common.sh@852 -- # return 0 00:18:08.402 16:01:58 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:08.402 16:01:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:08.402 16:01:58 -- common/autotest_common.sh@10 -- # set +x 00:18:08.402 NVMe0n1 00:18:08.402 16:01:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:08.402 16:01:58 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:08.402 Running I/O for 10 seconds... 00:18:20.594 00:18:20.594 Latency(us) 00:18:20.594 [2024-10-30T15:02:10.470Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:20.594 [2024-10-30T15:02:10.470Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:20.594 Verification LBA range: start 0x0 length 0x4000 00:18:20.594 NVMe0n1 : 10.07 12264.07 47.91 0.00 0.00 83160.62 14563.56 62914.56 00:18:20.594 [2024-10-30T15:02:10.470Z] =================================================================================================================== 00:18:20.594 [2024-10-30T15:02:10.470Z] Total : 12264.07 47.91 0.00 0.00 83160.62 14563.56 62914.56 00:18:20.594 0 00:18:20.594 16:02:08 -- target/queue_depth.sh@39 -- # killprocess 2420109 00:18:20.594 16:02:08 -- common/autotest_common.sh@926 -- # '[' -z 2420109 ']' 00:18:20.594 16:02:08 -- common/autotest_common.sh@930 -- # kill -0 2420109 00:18:20.594 16:02:08 -- common/autotest_common.sh@931 -- # uname 00:18:20.594 16:02:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:20.594 16:02:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2420109 00:18:20.594 16:02:08 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:18:20.594 16:02:08 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:18:20.594 16:02:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2420109' 00:18:20.594 killing process with pid 2420109 00:18:20.594 16:02:08 -- common/autotest_common.sh@945 -- # kill 2420109 00:18:20.594 Received shutdown signal, test time was about 10.000000 seconds 00:18:20.594 00:18:20.594 Latency(us) 00:18:20.594 [2024-10-30T15:02:10.470Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:20.594 [2024-10-30T15:02:10.470Z] =================================================================================================================== 00:18:20.594 [2024-10-30T15:02:10.470Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:20.594 16:02:08 -- common/autotest_common.sh@950 -- # wait 2420109 00:18:20.594 16:02:08 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:20.594 16:02:08 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:20.594 16:02:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:20.594 16:02:08 -- nvmf/common.sh@116 -- # sync 00:18:20.594 16:02:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:20.595 16:02:08 -- nvmf/common.sh@119 -- # set +e 00:18:20.595 16:02:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:20.595 16:02:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:20.595 rmmod nvme_tcp 00:18:20.595 rmmod nvme_fabrics 00:18:20.595 rmmod nvme_keyring 00:18:20.595 16:02:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:20.595 16:02:08 -- nvmf/common.sh@123 -- # set -e 00:18:20.595 16:02:08 -- nvmf/common.sh@124 -- # return 0 00:18:20.595 16:02:08 -- nvmf/common.sh@477 -- # '[' -n 2419953 ']' 00:18:20.595 16:02:08 -- nvmf/common.sh@478 -- # killprocess 2419953 00:18:20.595 16:02:08 -- common/autotest_common.sh@926 -- # '[' -z 2419953 ']' 00:18:20.595 16:02:08 -- common/autotest_common.sh@930 -- # kill -0 2419953 00:18:20.595 16:02:08 -- common/autotest_common.sh@931 -- # uname 00:18:20.595 16:02:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:20.595 16:02:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2419953 00:18:20.595 16:02:08 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:20.595 16:02:08 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:20.595 16:02:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2419953' 00:18:20.595 killing process with pid 2419953 00:18:20.595 16:02:08 -- common/autotest_common.sh@945 -- # kill 2419953 00:18:20.595 16:02:08 -- common/autotest_common.sh@950 -- # wait 2419953 00:18:20.595 16:02:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:20.595 16:02:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:20.595 16:02:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:20.595 16:02:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:20.595 16:02:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:20.595 16:02:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:20.595 16:02:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:20.595 16:02:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:21.160 16:02:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:21.160 00:18:21.160 real 0m17.403s 00:18:21.160 user 0m24.927s 00:18:21.160 sys 0m3.150s 00:18:21.160 16:02:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:21.160 16:02:10 -- common/autotest_common.sh@10 -- # set +x 00:18:21.160 ************************************ 00:18:21.160 END TEST nvmf_queue_depth 00:18:21.160 ************************************ 00:18:21.161 16:02:10 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:21.161 16:02:10 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:21.161 16:02:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:21.161 16:02:10 -- common/autotest_common.sh@10 -- # set +x 00:18:21.161 ************************************ 00:18:21.161 START TEST nvmf_multipath 00:18:21.161 ************************************ 00:18:21.161 16:02:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:21.161 * Looking for test storage... 00:18:21.161 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:21.161 16:02:11 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:21.161 16:02:11 -- nvmf/common.sh@7 -- # uname -s 00:18:21.161 16:02:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:21.161 16:02:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:21.161 16:02:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:21.161 16:02:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:21.161 16:02:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:21.161 16:02:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:21.161 16:02:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:21.161 16:02:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:21.161 16:02:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:21.161 16:02:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:21.161 16:02:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:21.161 16:02:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:21.161 16:02:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:21.419 16:02:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:21.419 16:02:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:21.419 16:02:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:21.419 16:02:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:21.419 16:02:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:21.419 16:02:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:21.419 16:02:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.419 16:02:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.419 16:02:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.419 16:02:11 -- paths/export.sh@5 -- # export PATH 00:18:21.419 16:02:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:21.419 16:02:11 -- nvmf/common.sh@46 -- # : 0 00:18:21.419 16:02:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:21.419 16:02:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:21.419 16:02:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:21.419 16:02:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:21.419 16:02:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:21.419 16:02:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:21.419 16:02:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:21.419 16:02:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:21.419 16:02:11 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:21.419 16:02:11 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:21.419 16:02:11 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:21.419 16:02:11 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:21.419 16:02:11 -- target/multipath.sh@43 -- # nvmftestinit 00:18:21.419 16:02:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:21.419 16:02:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:21.419 16:02:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:21.419 16:02:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:21.419 16:02:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:21.419 16:02:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:21.419 16:02:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:21.419 16:02:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:21.419 16:02:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:21.419 16:02:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:21.419 16:02:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:21.419 16:02:11 -- common/autotest_common.sh@10 -- # set +x 00:18:23.319 16:02:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:23.319 16:02:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:23.319 16:02:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:23.319 16:02:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:23.319 16:02:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:23.319 16:02:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:23.319 16:02:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:23.319 16:02:12 -- nvmf/common.sh@294 -- # net_devs=() 00:18:23.319 16:02:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:23.319 16:02:12 -- nvmf/common.sh@295 -- # e810=() 00:18:23.319 16:02:12 -- nvmf/common.sh@295 -- # local -ga e810 00:18:23.319 16:02:12 -- nvmf/common.sh@296 -- # x722=() 00:18:23.319 16:02:12 -- nvmf/common.sh@296 -- # local -ga x722 00:18:23.319 16:02:12 -- nvmf/common.sh@297 -- # mlx=() 00:18:23.319 16:02:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:23.319 16:02:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:23.319 16:02:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:23.319 16:02:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:23.319 16:02:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:23.319 16:02:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:23.319 16:02:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:23.319 16:02:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:23.319 16:02:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:23.319 16:02:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:23.319 16:02:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:23.319 16:02:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:23.319 16:02:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:23.319 16:02:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:23.319 16:02:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:23.319 16:02:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:23.319 16:02:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:23.319 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:23.319 16:02:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:23.319 16:02:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:23.319 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:23.319 16:02:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:23.319 16:02:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:23.319 16:02:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:23.319 16:02:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:23.319 16:02:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:23.319 16:02:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:23.319 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:23.319 16:02:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:23.319 16:02:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:23.319 16:02:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:23.319 16:02:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:23.319 16:02:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:23.319 16:02:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:23.319 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:23.319 16:02:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:23.319 16:02:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:23.319 16:02:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:23.319 16:02:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:23.319 16:02:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:23.319 16:02:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:23.319 16:02:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:23.319 16:02:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:23.319 16:02:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:23.319 16:02:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:23.319 16:02:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:23.319 16:02:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:23.319 16:02:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:23.319 16:02:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:23.319 16:02:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:23.319 16:02:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:23.319 16:02:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:23.319 16:02:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:23.319 16:02:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:23.319 16:02:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:23.319 16:02:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:23.319 16:02:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:23.319 16:02:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:23.319 16:02:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:23.319 16:02:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:23.319 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:23.319 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.403 ms 00:18:23.319 00:18:23.319 --- 10.0.0.2 ping statistics --- 00:18:23.319 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:23.319 rtt min/avg/max/mdev = 0.403/0.403/0.403/0.000 ms 00:18:23.319 16:02:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:23.319 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:23.319 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.147 ms 00:18:23.319 00:18:23.319 --- 10.0.0.1 ping statistics --- 00:18:23.319 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:23.319 rtt min/avg/max/mdev = 0.147/0.147/0.147/0.000 ms 00:18:23.320 16:02:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:23.320 16:02:13 -- nvmf/common.sh@410 -- # return 0 00:18:23.320 16:02:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:23.320 16:02:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:23.320 16:02:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:23.320 16:02:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:23.320 16:02:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:23.320 16:02:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:23.320 16:02:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:23.320 16:02:13 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:23.320 16:02:13 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:23.320 only one NIC for nvmf test 00:18:23.320 16:02:13 -- target/multipath.sh@47 -- # nvmftestfini 00:18:23.320 16:02:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:23.320 16:02:13 -- nvmf/common.sh@116 -- # sync 00:18:23.320 16:02:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:23.320 16:02:13 -- nvmf/common.sh@119 -- # set +e 00:18:23.320 16:02:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:23.320 16:02:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:23.320 rmmod nvme_tcp 00:18:23.320 rmmod nvme_fabrics 00:18:23.320 rmmod nvme_keyring 00:18:23.320 16:02:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:23.320 16:02:13 -- nvmf/common.sh@123 -- # set -e 00:18:23.320 16:02:13 -- nvmf/common.sh@124 -- # return 0 00:18:23.320 16:02:13 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:23.320 16:02:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:23.320 16:02:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:23.320 16:02:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:23.320 16:02:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:23.320 16:02:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:23.320 16:02:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:23.320 16:02:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:23.320 16:02:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:25.848 16:02:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:25.849 16:02:15 -- target/multipath.sh@48 -- # exit 0 00:18:25.849 16:02:15 -- target/multipath.sh@1 -- # nvmftestfini 00:18:25.849 16:02:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:25.849 16:02:15 -- nvmf/common.sh@116 -- # sync 00:18:25.849 16:02:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:25.849 16:02:15 -- nvmf/common.sh@119 -- # set +e 00:18:25.849 16:02:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:25.849 16:02:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:25.849 16:02:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:25.849 16:02:15 -- nvmf/common.sh@123 -- # set -e 00:18:25.849 16:02:15 -- nvmf/common.sh@124 -- # return 0 00:18:25.849 16:02:15 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:25.849 16:02:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:25.849 16:02:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:25.849 16:02:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:25.849 16:02:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:25.849 16:02:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:25.849 16:02:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:25.849 16:02:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:25.849 16:02:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:25.849 16:02:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:25.849 00:18:25.849 real 0m4.241s 00:18:25.849 user 0m0.771s 00:18:25.849 sys 0m1.468s 00:18:25.849 16:02:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:25.849 16:02:15 -- common/autotest_common.sh@10 -- # set +x 00:18:25.849 ************************************ 00:18:25.849 END TEST nvmf_multipath 00:18:25.849 ************************************ 00:18:25.849 16:02:15 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:25.849 16:02:15 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:25.849 16:02:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:25.849 16:02:15 -- common/autotest_common.sh@10 -- # set +x 00:18:25.849 ************************************ 00:18:25.849 START TEST nvmf_zcopy 00:18:25.849 ************************************ 00:18:25.849 16:02:15 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:25.849 * Looking for test storage... 00:18:25.849 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:25.849 16:02:15 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:25.849 16:02:15 -- nvmf/common.sh@7 -- # uname -s 00:18:25.849 16:02:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:25.849 16:02:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:25.849 16:02:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:25.849 16:02:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:25.849 16:02:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:25.849 16:02:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:25.849 16:02:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:25.849 16:02:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:25.849 16:02:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:25.849 16:02:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:25.849 16:02:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:25.849 16:02:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:25.849 16:02:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:25.849 16:02:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:25.849 16:02:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:25.849 16:02:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:25.849 16:02:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:25.849 16:02:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:25.849 16:02:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:25.849 16:02:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:25.849 16:02:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:25.849 16:02:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:25.849 16:02:15 -- paths/export.sh@5 -- # export PATH 00:18:25.849 16:02:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:25.849 16:02:15 -- nvmf/common.sh@46 -- # : 0 00:18:25.849 16:02:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:25.849 16:02:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:25.849 16:02:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:25.849 16:02:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:25.849 16:02:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:25.849 16:02:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:25.849 16:02:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:25.849 16:02:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:25.849 16:02:15 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:25.849 16:02:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:25.849 16:02:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:25.849 16:02:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:25.849 16:02:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:25.849 16:02:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:25.849 16:02:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:25.849 16:02:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:25.849 16:02:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:25.849 16:02:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:25.849 16:02:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:25.849 16:02:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:25.849 16:02:15 -- common/autotest_common.sh@10 -- # set +x 00:18:27.752 16:02:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:27.752 16:02:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:27.752 16:02:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:27.752 16:02:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:27.752 16:02:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:27.752 16:02:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:27.752 16:02:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:27.752 16:02:17 -- nvmf/common.sh@294 -- # net_devs=() 00:18:27.752 16:02:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:27.752 16:02:17 -- nvmf/common.sh@295 -- # e810=() 00:18:27.752 16:02:17 -- nvmf/common.sh@295 -- # local -ga e810 00:18:27.752 16:02:17 -- nvmf/common.sh@296 -- # x722=() 00:18:27.752 16:02:17 -- nvmf/common.sh@296 -- # local -ga x722 00:18:27.752 16:02:17 -- nvmf/common.sh@297 -- # mlx=() 00:18:27.752 16:02:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:27.752 16:02:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:27.752 16:02:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:27.752 16:02:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:27.752 16:02:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:27.752 16:02:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:27.752 16:02:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:27.752 16:02:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:27.752 16:02:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:27.752 16:02:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:27.752 16:02:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:27.752 16:02:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:27.752 16:02:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:27.752 16:02:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:27.752 16:02:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:27.752 16:02:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:27.752 16:02:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:27.752 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:27.752 16:02:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:27.752 16:02:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:27.752 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:27.752 16:02:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:27.752 16:02:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:27.752 16:02:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:27.752 16:02:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:27.752 16:02:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:27.752 16:02:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:27.752 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:27.752 16:02:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:27.752 16:02:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:27.752 16:02:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:27.752 16:02:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:27.752 16:02:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:27.752 16:02:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:27.752 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:27.752 16:02:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:27.752 16:02:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:27.752 16:02:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:27.752 16:02:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:27.752 16:02:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:27.752 16:02:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:27.752 16:02:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:27.752 16:02:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:27.752 16:02:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:27.752 16:02:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:27.753 16:02:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:27.753 16:02:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:27.753 16:02:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:27.753 16:02:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:27.753 16:02:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:27.753 16:02:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:27.753 16:02:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:27.753 16:02:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:27.753 16:02:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:27.753 16:02:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:27.753 16:02:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:27.753 16:02:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:27.753 16:02:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:27.753 16:02:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:27.753 16:02:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:27.753 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:27.753 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:18:27.753 00:18:27.753 --- 10.0.0.2 ping statistics --- 00:18:27.753 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:27.753 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:18:27.753 16:02:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:27.753 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:27.753 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:18:27.753 00:18:27.753 --- 10.0.0.1 ping statistics --- 00:18:27.753 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:27.753 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:18:27.753 16:02:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:27.753 16:02:17 -- nvmf/common.sh@410 -- # return 0 00:18:27.753 16:02:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:27.753 16:02:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:27.753 16:02:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:27.753 16:02:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:27.753 16:02:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:27.753 16:02:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:27.753 16:02:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:27.753 16:02:17 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:27.753 16:02:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:27.753 16:02:17 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:27.753 16:02:17 -- common/autotest_common.sh@10 -- # set +x 00:18:27.753 16:02:17 -- nvmf/common.sh@469 -- # nvmfpid=2425346 00:18:27.753 16:02:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:27.753 16:02:17 -- nvmf/common.sh@470 -- # waitforlisten 2425346 00:18:27.753 16:02:17 -- common/autotest_common.sh@819 -- # '[' -z 2425346 ']' 00:18:27.753 16:02:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:27.753 16:02:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:27.753 16:02:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:27.753 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:27.753 16:02:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:27.753 16:02:17 -- common/autotest_common.sh@10 -- # set +x 00:18:27.753 [2024-10-30 16:02:17.589657] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:18:27.753 [2024-10-30 16:02:17.589741] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:27.753 EAL: No free 2048 kB hugepages reported on node 1 00:18:28.010 [2024-10-30 16:02:17.660643] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:28.010 [2024-10-30 16:02:17.753934] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:28.010 [2024-10-30 16:02:17.754091] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:28.010 [2024-10-30 16:02:17.754121] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:28.010 [2024-10-30 16:02:17.754135] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:28.010 [2024-10-30 16:02:17.754171] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:28.942 16:02:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:28.942 16:02:18 -- common/autotest_common.sh@852 -- # return 0 00:18:28.942 16:02:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:28.942 16:02:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:28.942 16:02:18 -- common/autotest_common.sh@10 -- # set +x 00:18:28.942 16:02:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:28.942 16:02:18 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:28.942 16:02:18 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:28.942 16:02:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:28.942 16:02:18 -- common/autotest_common.sh@10 -- # set +x 00:18:28.942 [2024-10-30 16:02:18.577641] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:28.942 16:02:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:28.942 16:02:18 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:28.942 16:02:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:28.942 16:02:18 -- common/autotest_common.sh@10 -- # set +x 00:18:28.942 16:02:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:28.942 16:02:18 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:28.942 16:02:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:28.942 16:02:18 -- common/autotest_common.sh@10 -- # set +x 00:18:28.942 [2024-10-30 16:02:18.593828] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:28.942 16:02:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:28.942 16:02:18 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:28.942 16:02:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:28.942 16:02:18 -- common/autotest_common.sh@10 -- # set +x 00:18:28.942 16:02:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:28.942 16:02:18 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:28.942 16:02:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:28.942 16:02:18 -- common/autotest_common.sh@10 -- # set +x 00:18:28.942 malloc0 00:18:28.942 16:02:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:28.942 16:02:18 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:28.942 16:02:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:28.942 16:02:18 -- common/autotest_common.sh@10 -- # set +x 00:18:28.942 16:02:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:28.942 16:02:18 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:28.942 16:02:18 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:28.942 16:02:18 -- nvmf/common.sh@520 -- # config=() 00:18:28.942 16:02:18 -- nvmf/common.sh@520 -- # local subsystem config 00:18:28.942 16:02:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:28.942 16:02:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:28.942 { 00:18:28.942 "params": { 00:18:28.942 "name": "Nvme$subsystem", 00:18:28.942 "trtype": "$TEST_TRANSPORT", 00:18:28.942 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:28.942 "adrfam": "ipv4", 00:18:28.942 "trsvcid": "$NVMF_PORT", 00:18:28.942 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:28.942 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:28.942 "hdgst": ${hdgst:-false}, 00:18:28.942 "ddgst": ${ddgst:-false} 00:18:28.942 }, 00:18:28.942 "method": "bdev_nvme_attach_controller" 00:18:28.942 } 00:18:28.942 EOF 00:18:28.942 )") 00:18:28.942 16:02:18 -- nvmf/common.sh@542 -- # cat 00:18:28.942 16:02:18 -- nvmf/common.sh@544 -- # jq . 00:18:28.942 16:02:18 -- nvmf/common.sh@545 -- # IFS=, 00:18:28.942 16:02:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:28.942 "params": { 00:18:28.942 "name": "Nvme1", 00:18:28.942 "trtype": "tcp", 00:18:28.942 "traddr": "10.0.0.2", 00:18:28.942 "adrfam": "ipv4", 00:18:28.942 "trsvcid": "4420", 00:18:28.942 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:28.942 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:28.942 "hdgst": false, 00:18:28.942 "ddgst": false 00:18:28.942 }, 00:18:28.942 "method": "bdev_nvme_attach_controller" 00:18:28.942 }' 00:18:28.942 [2024-10-30 16:02:18.672477] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:18:28.942 [2024-10-30 16:02:18.672563] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2425504 ] 00:18:28.942 EAL: No free 2048 kB hugepages reported on node 1 00:18:28.942 [2024-10-30 16:02:18.737868] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:29.218 [2024-10-30 16:02:18.833175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:29.218 Running I/O for 10 seconds... 00:18:39.244 00:18:39.244 Latency(us) 00:18:39.244 [2024-10-30T15:02:29.120Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:39.244 [2024-10-30T15:02:29.120Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:39.244 Verification LBA range: start 0x0 length 0x1000 00:18:39.244 Nvme1n1 : 10.01 8593.28 67.13 0.00 0.00 14859.73 1462.42 22719.15 00:18:39.244 [2024-10-30T15:02:29.120Z] =================================================================================================================== 00:18:39.244 [2024-10-30T15:02:29.120Z] Total : 8593.28 67.13 0.00 0.00 14859.73 1462.42 22719.15 00:18:39.503 16:02:29 -- target/zcopy.sh@39 -- # perfpid=2426852 00:18:39.503 16:02:29 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:39.503 16:02:29 -- common/autotest_common.sh@10 -- # set +x 00:18:39.503 16:02:29 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:39.503 16:02:29 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:39.503 16:02:29 -- nvmf/common.sh@520 -- # config=() 00:18:39.503 16:02:29 -- nvmf/common.sh@520 -- # local subsystem config 00:18:39.503 16:02:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:39.503 16:02:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:39.503 { 00:18:39.503 "params": { 00:18:39.503 "name": "Nvme$subsystem", 00:18:39.503 "trtype": "$TEST_TRANSPORT", 00:18:39.503 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:39.503 "adrfam": "ipv4", 00:18:39.503 "trsvcid": "$NVMF_PORT", 00:18:39.503 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:39.503 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:39.503 "hdgst": ${hdgst:-false}, 00:18:39.503 "ddgst": ${ddgst:-false} 00:18:39.503 }, 00:18:39.503 "method": "bdev_nvme_attach_controller" 00:18:39.503 } 00:18:39.503 EOF 00:18:39.503 )") 00:18:39.503 16:02:29 -- nvmf/common.sh@542 -- # cat 00:18:39.503 [2024-10-30 16:02:29.310714] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.503 [2024-10-30 16:02:29.310763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.503 16:02:29 -- nvmf/common.sh@544 -- # jq . 00:18:39.503 16:02:29 -- nvmf/common.sh@545 -- # IFS=, 00:18:39.503 16:02:29 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:39.503 "params": { 00:18:39.503 "name": "Nvme1", 00:18:39.503 "trtype": "tcp", 00:18:39.503 "traddr": "10.0.0.2", 00:18:39.503 "adrfam": "ipv4", 00:18:39.503 "trsvcid": "4420", 00:18:39.503 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:39.503 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:39.503 "hdgst": false, 00:18:39.503 "ddgst": false 00:18:39.503 }, 00:18:39.503 "method": "bdev_nvme_attach_controller" 00:18:39.503 }' 00:18:39.503 [2024-10-30 16:02:29.318669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.503 [2024-10-30 16:02:29.318695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.503 [2024-10-30 16:02:29.326690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.503 [2024-10-30 16:02:29.326714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.503 [2024-10-30 16:02:29.334705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.503 [2024-10-30 16:02:29.334728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.503 [2024-10-30 16:02:29.342722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.503 [2024-10-30 16:02:29.342744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.503 [2024-10-30 16:02:29.347118] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:18:39.503 [2024-10-30 16:02:29.347192] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2426852 ] 00:18:39.503 [2024-10-30 16:02:29.350743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.503 [2024-10-30 16:02:29.350764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.503 [2024-10-30 16:02:29.358763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.503 [2024-10-30 16:02:29.358782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.503 [2024-10-30 16:02:29.366785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.503 [2024-10-30 16:02:29.366805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.503 [2024-10-30 16:02:29.374806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.503 [2024-10-30 16:02:29.374826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.503 EAL: No free 2048 kB hugepages reported on node 1 00:18:39.762 [2024-10-30 16:02:29.382850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.382876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.390866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.390892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.398890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.398915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.406913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.406938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.410899] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:39.763 [2024-10-30 16:02:29.414946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.414973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.422998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.423054] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.430985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.431010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.439004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.439029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.447046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.447072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.455047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.455072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.463100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.463140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.471115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.471150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.479114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.479139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.487137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.487162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.495158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.495183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.500006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:39.763 [2024-10-30 16:02:29.503182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.503207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.511203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.511228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.519263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.519317] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.527322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.527360] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.535329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.535368] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.543347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.543386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.551367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.551405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.559384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.559422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.567370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.567393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.575415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.575450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.583443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.583481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.591465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.591501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.599455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.599476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.607477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.607498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.615508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.615558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.623543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.623570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.631569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.631596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.763 [2024-10-30 16:02:29.639607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.763 [2024-10-30 16:02:29.639635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.647621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.647648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.655650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.655676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.663674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.663698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.671686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.671711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.679715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.679743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.687743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.687776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.695764] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.695791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.703783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.703808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.711816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.711847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.719833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.719868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 Running I/O for 5 seconds... 00:18:40.023 [2024-10-30 16:02:29.727856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.727882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.742444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.742473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.753445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.753473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.766713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.766744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.776964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.776995] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.787978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.788008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.801224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.801263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.811550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.811576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.822277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.822321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.834829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.834859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.845221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.845252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.856808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.856838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.868267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.868311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.881508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.881551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.023 [2024-10-30 16:02:29.892052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.023 [2024-10-30 16:02:29.892082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:29.903314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:29.903343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:29.916046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:29.916076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:29.925677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:29.925708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:29.937658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:29.937699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:29.949086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:29.949116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:29.962626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:29.962657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:29.973488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:29.973514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:29.984400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:29.984427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:29.997169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:29.997200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:30.007442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:30.007472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:30.018334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:30.018362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:30.030895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:30.030925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:30.040911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:30.040942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:30.052710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:30.052740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:30.063382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:30.063410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:30.074515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:30.074561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:30.085323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:30.085351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:30.096266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:30.096296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:30.107375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:30.107402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:30.117970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:30.118000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:30.128910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:30.128939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:30.139794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:30.139826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.282 [2024-10-30 16:02:30.150389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.282 [2024-10-30 16:02:30.150425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.161730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.161778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.172828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.172858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.183766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.183796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.194603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.194633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.205483] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.205511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.216486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.216514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.227236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.227278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.240148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.240178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.250266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.250311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.261887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.261918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.273417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.273445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.284180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.284210] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.295525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.295570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.306810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.306839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.317564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.317595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.328676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.328707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.341465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.341493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.351007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.351039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.363301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.363333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.374462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.374489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.385537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.385586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.396839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.396870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.409686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.409717] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.543 [2024-10-30 16:02:30.419657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.543 [2024-10-30 16:02:30.419688] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.430359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.430387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.441580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.441611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.455147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.455177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.465591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.465622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.476498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.476525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.489230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.489268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.499933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.499963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.510899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.510929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.521589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.521620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.532446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.532474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.543480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.543508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.554744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.554774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.565836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.565866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.576860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.576890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.587585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.587616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.600322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.600349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.610511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.610555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.621734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.621764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.634577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.634608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.644613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.644644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.655227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.655266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.668931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.668962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.803 [2024-10-30 16:02:30.679520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.803 [2024-10-30 16:02:30.679567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.690567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.690598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.701400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.701428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.712425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.712453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.724985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.725014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.736384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.736410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.744729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.744756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.757520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.757562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.767770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.767796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.778218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.778267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.788889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.788916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.799266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.799293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.810035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.810065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.821725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.821755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.832947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.832979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.844446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.844474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.855631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.855661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.868598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.868629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.878676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.878707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.890081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.890110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.901034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.901064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.912309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.912337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.923529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.923575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.063 [2024-10-30 16:02:30.934160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.063 [2024-10-30 16:02:30.934190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:30.945224] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:30.945264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:30.958209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:30.958239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:30.968678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:30.968708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:30.979671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:30.979702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:30.990565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:30.990596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.001405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.001433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.012513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.012558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.023806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.023836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.036443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.036470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.046450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.046480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.057461] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.057488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.068380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.068407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.079144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.079174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.089878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.089908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.100360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.100387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.111495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.111522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.122487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.122514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.135247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.135286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.146917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.146948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.156086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.156117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.167846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.167876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.180484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.323 [2024-10-30 16:02:31.180512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.323 [2024-10-30 16:02:31.190105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.324 [2024-10-30 16:02:31.190135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.324 [2024-10-30 16:02:31.201444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.324 [2024-10-30 16:02:31.201480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.214136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.214167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.224402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.224429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.235298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.235341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.248496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.248523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.258917] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.258947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.269393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.269420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.280084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.280116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.291109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.291140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.304157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.304189] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.314657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.314688] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.325545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.325575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.337275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.337319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.348157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.348187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.360473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.360502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.371312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.371340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.382251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.382305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.395774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.395804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.406787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.406818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.417957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.417996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.428835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.428866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.441569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.441599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.583 [2024-10-30 16:02:31.452274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.583 [2024-10-30 16:02:31.452320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.463057] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.463088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.475724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.475754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.485781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.485812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.496846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.496876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.509836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.509866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.519998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.520027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.531489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.531516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.542842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.542872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.555772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.555802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.565871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.565901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.577347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.577373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.588336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.588364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.601440] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.601467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.611823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.611853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.622475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.622502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.633154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.633193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.644055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.644085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.656618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.656648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.665868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.665898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.678015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.843 [2024-10-30 16:02:31.678045] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.843 [2024-10-30 16:02:31.689203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.844 [2024-10-30 16:02:31.689233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.844 [2024-10-30 16:02:31.699840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.844 [2024-10-30 16:02:31.699871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.844 [2024-10-30 16:02:31.710879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.844 [2024-10-30 16:02:31.710908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.844 [2024-10-30 16:02:31.721570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.844 [2024-10-30 16:02:31.721600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.102 [2024-10-30 16:02:31.734507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.102 [2024-10-30 16:02:31.734550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.102 [2024-10-30 16:02:31.744348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.102 [2024-10-30 16:02:31.744375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.102 [2024-10-30 16:02:31.754957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.102 [2024-10-30 16:02:31.754986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.102 [2024-10-30 16:02:31.767914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.102 [2024-10-30 16:02:31.767944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.102 [2024-10-30 16:02:31.777928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.102 [2024-10-30 16:02:31.777958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.102 [2024-10-30 16:02:31.789128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.102 [2024-10-30 16:02:31.789158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.102 [2024-10-30 16:02:31.800313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.102 [2024-10-30 16:02:31.800340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.102 [2024-10-30 16:02:31.811457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.102 [2024-10-30 16:02:31.811484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.102 [2024-10-30 16:02:31.824296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.102 [2024-10-30 16:02:31.824339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.102 [2024-10-30 16:02:31.834671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.103 [2024-10-30 16:02:31.834701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.103 [2024-10-30 16:02:31.845578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.103 [2024-10-30 16:02:31.845622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.103 [2024-10-30 16:02:31.858313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.103 [2024-10-30 16:02:31.858340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.103 [2024-10-30 16:02:31.868703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.103 [2024-10-30 16:02:31.868734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.103 [2024-10-30 16:02:31.879688] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.103 [2024-10-30 16:02:31.879718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.103 [2024-10-30 16:02:31.892486] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.103 [2024-10-30 16:02:31.892513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.103 [2024-10-30 16:02:31.902639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.103 [2024-10-30 16:02:31.902681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.103 [2024-10-30 16:02:31.913704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.103 [2024-10-30 16:02:31.913735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.103 [2024-10-30 16:02:31.925234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.103 [2024-10-30 16:02:31.925274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.103 [2024-10-30 16:02:31.936608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.103 [2024-10-30 16:02:31.936639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.103 [2024-10-30 16:02:31.947247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.103 [2024-10-30 16:02:31.947286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.103 [2024-10-30 16:02:31.958515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.103 [2024-10-30 16:02:31.958557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.103 [2024-10-30 16:02:31.969287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.103 [2024-10-30 16:02:31.969331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.103 [2024-10-30 16:02:31.980568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.103 [2024-10-30 16:02:31.980599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:31.992043] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:31.992074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.005313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.005340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.016202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.016232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.026817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.026847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.039556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.039587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.049629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.049659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.061129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.061159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.071876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.071907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.083312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.083339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.094493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.094521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.107549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.107579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.117396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.117423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.128327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.128353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.141169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.141199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.151887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.151918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.162619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.162649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.173906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.173936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.184777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.184808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.197646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.197676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.207771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.207800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.218494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.218522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.360 [2024-10-30 16:02:32.231427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.360 [2024-10-30 16:02:32.231454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.241236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.241278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.252422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.252449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.265313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.265341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.275697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.275728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.286456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.286483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.297201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.297231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.308167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.308197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.320847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.320877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.330386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.330414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.341792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.341822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.352402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.352429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.363278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.363322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.375846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.375877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.385418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.385446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.398588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.398618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.408582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.408612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.419474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.419502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.432710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.432741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.443417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.443445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.454144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.454175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.464945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.464975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.475914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.475944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.618 [2024-10-30 16:02:32.486892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.618 [2024-10-30 16:02:32.486925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.498243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.498301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.511393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.511421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.522377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.522405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.533846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.533876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.545131] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.545160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.558110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.558140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.568390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.568417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.578705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.578735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.589367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.589394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.600345] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.600371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.611140] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.611170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.621586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.621630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.632959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.632990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.645989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.646019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.656166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.656195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.667133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.667162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.679389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.679416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.689730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.689760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.701087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.701117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.712285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.712328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.723382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.723409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.735611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.878 [2024-10-30 16:02:32.735641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.878 [2024-10-30 16:02:32.745793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.879 [2024-10-30 16:02:32.745822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.879 [2024-10-30 16:02:32.756571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.879 [2024-10-30 16:02:32.756602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.139 [2024-10-30 16:02:32.769316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.139 [2024-10-30 16:02:32.769343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.780973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.781003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.790160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.790190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.801905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.801935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.814781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.814810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.824794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.824824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.835645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.835675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.848381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.848408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.859136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.859166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.869779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.869810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.880870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.880900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.891739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.891769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.902637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.902676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.913607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.913637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.924276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.924319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.935431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.935458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.948669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.948699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.959242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.959280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.970240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.970279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.982500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.982527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:32.991397] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:32.991424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:33.003501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:33.003528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.140 [2024-10-30 16:02:33.014709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.140 [2024-10-30 16:02:33.014739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-10-30 16:02:33.026500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.400 [2024-10-30 16:02:33.026543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-10-30 16:02:33.037182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.400 [2024-10-30 16:02:33.037213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-10-30 16:02:33.050189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.400 [2024-10-30 16:02:33.050218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-10-30 16:02:33.060472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.400 [2024-10-30 16:02:33.060499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-10-30 16:02:33.071792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.400 [2024-10-30 16:02:33.071822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.400 [2024-10-30 16:02:33.085017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.085047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.095561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.095591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.106005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.106035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.117028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.117067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.130692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.130722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.141062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.141092] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.152312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.152339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.163596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.163626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.174795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.174825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.185501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.185556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.195915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.195945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.206816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.206846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.217904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.217934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.230632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.230662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.240385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.240413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.251276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.251320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.263866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.263896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.401 [2024-10-30 16:02:33.273889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.401 [2024-10-30 16:02:33.273919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.284816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.284847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.297746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.297777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.308268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.308313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.319188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.319218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.330171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.330210] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.340816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.340846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.352063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.352093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.363173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.363204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.375926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.375956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.385929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.385959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.396438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.396466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.407366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.407402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.418104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.418134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.429614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.429644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.443267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.443297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.453972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.454001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.465052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.465082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.477778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.477808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.487647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.487678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.499656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.499686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.510644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.510674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.521791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.521820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.660 [2024-10-30 16:02:33.534777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.660 [2024-10-30 16:02:33.534808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.545672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.545714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.556927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.556958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.568020] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.568051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.579245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.579285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.592104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.592134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.602607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.602637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.614002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.614032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.625505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.625533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.638199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.638231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.648434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.648461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.659428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.659456] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.670805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.670836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.682355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.682383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.693727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.693758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.707147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.707177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.717331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.717358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.728527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.728575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.742243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.742283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.752466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.752493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.763819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.763848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.774979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.775008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.918 [2024-10-30 16:02:33.785895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.918 [2024-10-30 16:02:33.785925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.176 [2024-10-30 16:02:33.798487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.176 [2024-10-30 16:02:33.798514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.176 [2024-10-30 16:02:33.808804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.176 [2024-10-30 16:02:33.808834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.176 [2024-10-30 16:02:33.819762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.176 [2024-10-30 16:02:33.819792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.176 [2024-10-30 16:02:33.832463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.176 [2024-10-30 16:02:33.832490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.176 [2024-10-30 16:02:33.842620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.176 [2024-10-30 16:02:33.842650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.176 [2024-10-30 16:02:33.853409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.176 [2024-10-30 16:02:33.853436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.176 [2024-10-30 16:02:33.866582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.176 [2024-10-30 16:02:33.866612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.176 [2024-10-30 16:02:33.876885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.176 [2024-10-30 16:02:33.876915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.176 [2024-10-30 16:02:33.887978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.176 [2024-10-30 16:02:33.888008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.176 [2024-10-30 16:02:33.901199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.176 [2024-10-30 16:02:33.901229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.176 [2024-10-30 16:02:33.911717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.176 [2024-10-30 16:02:33.911747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.176 [2024-10-30 16:02:33.922480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.176 [2024-10-30 16:02:33.922508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.176 [2024-10-30 16:02:33.934655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.176 [2024-10-30 16:02:33.934685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-10-30 16:02:33.944044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-10-30 16:02:33.944074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-10-30 16:02:33.957784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-10-30 16:02:33.957814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-10-30 16:02:33.968377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-10-30 16:02:33.968405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-10-30 16:02:33.979567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-10-30 16:02:33.979597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-10-30 16:02:33.990568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-10-30 16:02:33.990595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-10-30 16:02:34.001318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-10-30 16:02:34.001346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-10-30 16:02:34.014155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-10-30 16:02:34.014185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-10-30 16:02:34.024133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-10-30 16:02:34.024162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-10-30 16:02:34.034912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-10-30 16:02:34.034941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.177 [2024-10-30 16:02:34.046005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.177 [2024-10-30 16:02:34.046035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.435 [2024-10-30 16:02:34.056785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.435 [2024-10-30 16:02:34.056817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.435 [2024-10-30 16:02:34.069721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.435 [2024-10-30 16:02:34.069752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.435 [2024-10-30 16:02:34.079533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.435 [2024-10-30 16:02:34.079579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.435 [2024-10-30 16:02:34.090662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.435 [2024-10-30 16:02:34.090689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.435 [2024-10-30 16:02:34.102121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.435 [2024-10-30 16:02:34.102151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.435 [2024-10-30 16:02:34.113161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.435 [2024-10-30 16:02:34.113191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.435 [2024-10-30 16:02:34.124138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.435 [2024-10-30 16:02:34.124169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.435 [2024-10-30 16:02:34.135520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.435 [2024-10-30 16:02:34.135564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.435 [2024-10-30 16:02:34.146757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.435 [2024-10-30 16:02:34.146787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.435 [2024-10-30 16:02:34.159514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-10-30 16:02:34.159558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-10-30 16:02:34.169618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-10-30 16:02:34.169648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-10-30 16:02:34.180873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-10-30 16:02:34.180903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-10-30 16:02:34.191886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-10-30 16:02:34.191920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-10-30 16:02:34.202390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-10-30 16:02:34.202418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-10-30 16:02:34.213368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-10-30 16:02:34.213396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-10-30 16:02:34.224460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-10-30 16:02:34.224488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-10-30 16:02:34.237574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-10-30 16:02:34.237605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-10-30 16:02:34.247715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-10-30 16:02:34.247745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-10-30 16:02:34.258836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-10-30 16:02:34.258866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-10-30 16:02:34.269716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-10-30 16:02:34.269746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-10-30 16:02:34.280963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-10-30 16:02:34.280993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-10-30 16:02:34.293951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-10-30 16:02:34.293981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.436 [2024-10-30 16:02:34.304413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.436 [2024-10-30 16:02:34.304440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.316295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.316344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.327847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.327877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.338963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.338994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.350378] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.350410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.361149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.361179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.372122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.372152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.382957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.382987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.393988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.394018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.406779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.406810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.417130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.417161] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.427823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.427853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.438770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.438801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.449865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.449895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.460731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.460761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.471852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.471883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.483133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.483163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.496060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.496091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.506664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.506694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.517905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.517935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.531325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.531353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.541456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.541483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.552059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.552089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.562682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.562712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.696 [2024-10-30 16:02:34.573640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.696 [2024-10-30 16:02:34.573671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.584193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.584223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.595007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.595037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.606064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.606104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.617011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.617041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.630230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.630268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.640701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.640730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.651514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.651558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.662574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.662604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.673870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.673900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.684937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.684967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.695681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.695712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.707086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.707117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.718087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.718118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.729326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.729354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.740545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.740576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 00:18:44.955 Latency(us) 00:18:44.955 [2024-10-30T15:02:34.831Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:44.955 [2024-10-30T15:02:34.831Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:18:44.955 Nvme1n1 : 5.01 11582.76 90.49 0.00 0.00 11035.41 4563.25 23010.42 00:18:44.955 [2024-10-30T15:02:34.831Z] =================================================================================================================== 00:18:44.955 [2024-10-30T15:02:34.831Z] Total : 11582.76 90.49 0.00 0.00 11035.41 4563.25 23010.42 00:18:44.955 [2024-10-30 16:02:34.747684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.747713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.759724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.759758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.767778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.767828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.775818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.775894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.783820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.783871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.791842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.791890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.799864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.799913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.807895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.955 [2024-10-30 16:02:34.807958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.955 [2024-10-30 16:02:34.815910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.956 [2024-10-30 16:02:34.815958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.956 [2024-10-30 16:02:34.823947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.956 [2024-10-30 16:02:34.824001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:44.956 [2024-10-30 16:02:34.831984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:44.956 [2024-10-30 16:02:34.832044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.839995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.840055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.848015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.848073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.856032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.856087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.864066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.864123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.872071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.872122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.880100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.880155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.888078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.888111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.896094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.896122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.904161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.904215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.912184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.912241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.920197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.920249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.928178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.928224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.936215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.936251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.944290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.944346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.952296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.952349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.960272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.960298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.968291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.968316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 [2024-10-30 16:02:34.976316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:45.220 [2024-10-30 16:02:34.976340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:45.220 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (2426852) - No such process 00:18:45.220 16:02:34 -- target/zcopy.sh@49 -- # wait 2426852 00:18:45.220 16:02:34 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:18:45.220 16:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:45.220 16:02:34 -- common/autotest_common.sh@10 -- # set +x 00:18:45.220 16:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:45.220 16:02:34 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:18:45.220 16:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:45.220 16:02:34 -- common/autotest_common.sh@10 -- # set +x 00:18:45.220 delay0 00:18:45.221 16:02:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:45.221 16:02:34 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:18:45.221 16:02:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:45.221 16:02:34 -- common/autotest_common.sh@10 -- # set +x 00:18:45.221 16:02:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:45.221 16:02:35 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:18:45.221 EAL: No free 2048 kB hugepages reported on node 1 00:18:45.221 [2024-10-30 16:02:35.097088] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:18:51.786 Initializing NVMe Controllers 00:18:51.786 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:51.786 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:51.786 Initialization complete. Launching workers. 00:18:51.786 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 835 00:18:51.786 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 1122, failed to submit 33 00:18:51.786 success 939, unsuccess 183, failed 0 00:18:51.787 16:02:41 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:18:51.787 16:02:41 -- target/zcopy.sh@60 -- # nvmftestfini 00:18:51.787 16:02:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:51.787 16:02:41 -- nvmf/common.sh@116 -- # sync 00:18:51.787 16:02:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:51.787 16:02:41 -- nvmf/common.sh@119 -- # set +e 00:18:51.787 16:02:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:51.787 16:02:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:51.787 rmmod nvme_tcp 00:18:51.787 rmmod nvme_fabrics 00:18:51.787 rmmod nvme_keyring 00:18:51.787 16:02:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:51.787 16:02:41 -- nvmf/common.sh@123 -- # set -e 00:18:51.787 16:02:41 -- nvmf/common.sh@124 -- # return 0 00:18:51.787 16:02:41 -- nvmf/common.sh@477 -- # '[' -n 2425346 ']' 00:18:51.787 16:02:41 -- nvmf/common.sh@478 -- # killprocess 2425346 00:18:51.787 16:02:41 -- common/autotest_common.sh@926 -- # '[' -z 2425346 ']' 00:18:51.787 16:02:41 -- common/autotest_common.sh@930 -- # kill -0 2425346 00:18:51.787 16:02:41 -- common/autotest_common.sh@931 -- # uname 00:18:51.787 16:02:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:51.787 16:02:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2425346 00:18:51.787 16:02:41 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:51.787 16:02:41 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:51.787 16:02:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2425346' 00:18:51.787 killing process with pid 2425346 00:18:51.787 16:02:41 -- common/autotest_common.sh@945 -- # kill 2425346 00:18:51.787 16:02:41 -- common/autotest_common.sh@950 -- # wait 2425346 00:18:51.787 16:02:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:51.787 16:02:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:51.787 16:02:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:51.787 16:02:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:51.787 16:02:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:51.787 16:02:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:51.787 16:02:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:51.787 16:02:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:54.329 16:02:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:54.329 00:18:54.329 real 0m28.450s 00:18:54.329 user 0m42.137s 00:18:54.329 sys 0m7.982s 00:18:54.329 16:02:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:54.329 16:02:43 -- common/autotest_common.sh@10 -- # set +x 00:18:54.329 ************************************ 00:18:54.329 END TEST nvmf_zcopy 00:18:54.329 ************************************ 00:18:54.329 16:02:43 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:54.329 16:02:43 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:54.329 16:02:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:54.329 16:02:43 -- common/autotest_common.sh@10 -- # set +x 00:18:54.329 ************************************ 00:18:54.329 START TEST nvmf_nmic 00:18:54.329 ************************************ 00:18:54.329 16:02:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:54.329 * Looking for test storage... 00:18:54.329 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:54.329 16:02:43 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:54.329 16:02:43 -- nvmf/common.sh@7 -- # uname -s 00:18:54.329 16:02:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:54.329 16:02:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:54.329 16:02:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:54.329 16:02:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:54.329 16:02:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:54.329 16:02:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:54.329 16:02:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:54.329 16:02:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:54.329 16:02:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:54.329 16:02:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:54.329 16:02:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:54.329 16:02:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:54.329 16:02:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:54.329 16:02:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:54.329 16:02:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:54.329 16:02:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:54.330 16:02:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:54.330 16:02:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:54.330 16:02:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:54.330 16:02:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.330 16:02:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.330 16:02:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.330 16:02:43 -- paths/export.sh@5 -- # export PATH 00:18:54.330 16:02:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.330 16:02:43 -- nvmf/common.sh@46 -- # : 0 00:18:54.330 16:02:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:54.330 16:02:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:54.330 16:02:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:54.330 16:02:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:54.330 16:02:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:54.330 16:02:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:54.330 16:02:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:54.330 16:02:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:54.330 16:02:43 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:54.330 16:02:43 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:54.330 16:02:43 -- target/nmic.sh@14 -- # nvmftestinit 00:18:54.330 16:02:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:54.330 16:02:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:54.330 16:02:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:54.330 16:02:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:54.330 16:02:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:54.330 16:02:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:54.330 16:02:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:54.330 16:02:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:54.330 16:02:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:54.330 16:02:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:54.330 16:02:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:54.330 16:02:43 -- common/autotest_common.sh@10 -- # set +x 00:18:56.233 16:02:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:56.233 16:02:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:56.233 16:02:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:56.233 16:02:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:56.233 16:02:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:56.233 16:02:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:56.233 16:02:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:56.233 16:02:45 -- nvmf/common.sh@294 -- # net_devs=() 00:18:56.233 16:02:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:56.233 16:02:45 -- nvmf/common.sh@295 -- # e810=() 00:18:56.233 16:02:45 -- nvmf/common.sh@295 -- # local -ga e810 00:18:56.233 16:02:45 -- nvmf/common.sh@296 -- # x722=() 00:18:56.233 16:02:45 -- nvmf/common.sh@296 -- # local -ga x722 00:18:56.233 16:02:45 -- nvmf/common.sh@297 -- # mlx=() 00:18:56.233 16:02:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:56.233 16:02:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:56.233 16:02:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:56.233 16:02:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:56.233 16:02:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:56.233 16:02:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:56.233 16:02:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:56.233 16:02:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:56.233 16:02:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:56.233 16:02:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:56.233 16:02:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:56.233 16:02:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:56.233 16:02:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:56.233 16:02:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:56.233 16:02:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:56.233 16:02:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:56.233 16:02:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:56.233 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:56.233 16:02:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:56.233 16:02:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:56.233 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:56.233 16:02:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:56.233 16:02:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:56.233 16:02:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:56.233 16:02:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:56.233 16:02:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:56.233 16:02:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:56.233 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:56.233 16:02:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:56.233 16:02:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:56.233 16:02:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:56.233 16:02:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:56.233 16:02:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:56.233 16:02:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:56.233 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:56.233 16:02:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:56.233 16:02:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:56.233 16:02:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:56.233 16:02:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:56.233 16:02:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:56.233 16:02:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:56.233 16:02:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:56.233 16:02:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:56.233 16:02:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:56.233 16:02:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:56.233 16:02:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:56.233 16:02:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:56.233 16:02:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:56.233 16:02:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:56.233 16:02:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:56.233 16:02:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:56.233 16:02:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:56.233 16:02:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:56.233 16:02:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:56.233 16:02:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:56.233 16:02:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:56.233 16:02:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:56.233 16:02:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:56.233 16:02:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:56.233 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:56.233 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.243 ms 00:18:56.233 00:18:56.233 --- 10.0.0.2 ping statistics --- 00:18:56.233 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:56.233 rtt min/avg/max/mdev = 0.243/0.243/0.243/0.000 ms 00:18:56.233 16:02:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:56.233 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:56.233 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:18:56.233 00:18:56.233 --- 10.0.0.1 ping statistics --- 00:18:56.233 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:56.233 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:18:56.233 16:02:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:56.233 16:02:45 -- nvmf/common.sh@410 -- # return 0 00:18:56.233 16:02:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:56.233 16:02:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:56.233 16:02:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:56.233 16:02:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:56.233 16:02:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:56.233 16:02:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:56.233 16:02:46 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:18:56.233 16:02:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:56.233 16:02:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:56.233 16:02:46 -- common/autotest_common.sh@10 -- # set +x 00:18:56.233 16:02:46 -- nvmf/common.sh@469 -- # nvmfpid=2430168 00:18:56.233 16:02:46 -- nvmf/common.sh@470 -- # waitforlisten 2430168 00:18:56.233 16:02:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:56.233 16:02:46 -- common/autotest_common.sh@819 -- # '[' -z 2430168 ']' 00:18:56.233 16:02:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:56.233 16:02:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:56.233 16:02:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:56.233 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:56.233 16:02:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:56.233 16:02:46 -- common/autotest_common.sh@10 -- # set +x 00:18:56.233 [2024-10-30 16:02:46.061164] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:18:56.233 [2024-10-30 16:02:46.061250] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:56.233 EAL: No free 2048 kB hugepages reported on node 1 00:18:56.492 [2024-10-30 16:02:46.133473] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:56.492 [2024-10-30 16:02:46.231373] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:56.492 [2024-10-30 16:02:46.231530] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:56.492 [2024-10-30 16:02:46.231559] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:56.492 [2024-10-30 16:02:46.231578] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:56.493 [2024-10-30 16:02:46.231649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:56.493 [2024-10-30 16:02:46.231709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:56.493 [2024-10-30 16:02:46.231763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:56.493 [2024-10-30 16:02:46.231766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:57.430 16:02:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:57.430 16:02:47 -- common/autotest_common.sh@852 -- # return 0 00:18:57.430 16:02:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:57.430 16:02:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:57.430 16:02:47 -- common/autotest_common.sh@10 -- # set +x 00:18:57.430 16:02:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:57.430 16:02:47 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:57.430 16:02:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:57.430 16:02:47 -- common/autotest_common.sh@10 -- # set +x 00:18:57.430 [2024-10-30 16:02:47.073972] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:57.430 16:02:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:57.430 16:02:47 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:57.430 16:02:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:57.430 16:02:47 -- common/autotest_common.sh@10 -- # set +x 00:18:57.430 Malloc0 00:18:57.430 16:02:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:57.430 16:02:47 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:18:57.430 16:02:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:57.430 16:02:47 -- common/autotest_common.sh@10 -- # set +x 00:18:57.430 16:02:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:57.430 16:02:47 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:57.430 16:02:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:57.430 16:02:47 -- common/autotest_common.sh@10 -- # set +x 00:18:57.430 16:02:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:57.430 16:02:47 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:57.430 16:02:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:57.430 16:02:47 -- common/autotest_common.sh@10 -- # set +x 00:18:57.430 [2024-10-30 16:02:47.127730] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:57.430 16:02:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:57.430 16:02:47 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:18:57.430 test case1: single bdev can't be used in multiple subsystems 00:18:57.430 16:02:47 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:57.430 16:02:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:57.430 16:02:47 -- common/autotest_common.sh@10 -- # set +x 00:18:57.430 16:02:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:57.430 16:02:47 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:18:57.430 16:02:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:57.430 16:02:47 -- common/autotest_common.sh@10 -- # set +x 00:18:57.430 16:02:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:57.430 16:02:47 -- target/nmic.sh@28 -- # nmic_status=0 00:18:57.430 16:02:47 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:18:57.430 16:02:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:57.430 16:02:47 -- common/autotest_common.sh@10 -- # set +x 00:18:57.430 [2024-10-30 16:02:47.151562] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:18:57.430 [2024-10-30 16:02:47.151593] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:18:57.430 [2024-10-30 16:02:47.151609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.430 request: 00:18:57.430 { 00:18:57.430 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:18:57.430 "namespace": { 00:18:57.430 "bdev_name": "Malloc0" 00:18:57.430 }, 00:18:57.430 "method": "nvmf_subsystem_add_ns", 00:18:57.430 "req_id": 1 00:18:57.430 } 00:18:57.430 Got JSON-RPC error response 00:18:57.430 response: 00:18:57.430 { 00:18:57.430 "code": -32602, 00:18:57.430 "message": "Invalid parameters" 00:18:57.430 } 00:18:57.430 16:02:47 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:18:57.430 16:02:47 -- target/nmic.sh@29 -- # nmic_status=1 00:18:57.430 16:02:47 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:18:57.431 16:02:47 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:18:57.431 Adding namespace failed - expected result. 00:18:57.431 16:02:47 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:18:57.431 test case2: host connect to nvmf target in multiple paths 00:18:57.431 16:02:47 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:18:57.431 16:02:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:57.431 16:02:47 -- common/autotest_common.sh@10 -- # set +x 00:18:57.431 [2024-10-30 16:02:47.159695] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:18:57.431 16:02:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:57.431 16:02:47 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:18:58.000 16:02:47 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:18:58.936 16:02:48 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:18:58.936 16:02:48 -- common/autotest_common.sh@1177 -- # local i=0 00:18:58.936 16:02:48 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:58.936 16:02:48 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:58.936 16:02:48 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:00.842 16:02:50 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:00.842 16:02:50 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:00.842 16:02:50 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:19:00.842 16:02:50 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:00.842 16:02:50 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:00.842 16:02:50 -- common/autotest_common.sh@1187 -- # return 0 00:19:00.842 16:02:50 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:00.842 [global] 00:19:00.842 thread=1 00:19:00.842 invalidate=1 00:19:00.842 rw=write 00:19:00.842 time_based=1 00:19:00.842 runtime=1 00:19:00.842 ioengine=libaio 00:19:00.842 direct=1 00:19:00.842 bs=4096 00:19:00.842 iodepth=1 00:19:00.842 norandommap=0 00:19:00.842 numjobs=1 00:19:00.842 00:19:00.842 verify_dump=1 00:19:00.842 verify_backlog=512 00:19:00.842 verify_state_save=0 00:19:00.842 do_verify=1 00:19:00.842 verify=crc32c-intel 00:19:00.842 [job0] 00:19:00.842 filename=/dev/nvme0n1 00:19:00.842 Could not set queue depth (nvme0n1) 00:19:00.842 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:00.842 fio-3.35 00:19:00.842 Starting 1 thread 00:19:02.220 00:19:02.220 job0: (groupid=0, jobs=1): err= 0: pid=2430917: Wed Oct 30 16:02:51 2024 00:19:02.220 read: IOPS=20, BW=83.8KiB/s (85.8kB/s)(84.0KiB/1002msec) 00:19:02.220 slat (nsec): min=8356, max=36830, avg=21379.14, stdev=10982.47 00:19:02.220 clat (usec): min=40851, max=42169, avg=41740.49, stdev=463.61 00:19:02.220 lat (usec): min=40886, max=42177, avg=41761.87, stdev=459.35 00:19:02.220 clat percentiles (usec): 00:19:02.220 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:19:02.220 | 30.00th=[41681], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:19:02.220 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:02.220 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:02.220 | 99.99th=[42206] 00:19:02.220 write: IOPS=510, BW=2044KiB/s (2093kB/s)(2048KiB/1002msec); 0 zone resets 00:19:02.220 slat (usec): min=7, max=29918, avg=68.98, stdev=1321.77 00:19:02.220 clat (usec): min=126, max=346, avg=170.94, stdev=39.95 00:19:02.220 lat (usec): min=134, max=30193, avg=239.93, stdev=1327.08 00:19:02.220 clat percentiles (usec): 00:19:02.220 | 1.00th=[ 129], 5.00th=[ 133], 10.00th=[ 135], 20.00th=[ 139], 00:19:02.220 | 30.00th=[ 145], 40.00th=[ 149], 50.00th=[ 155], 60.00th=[ 174], 00:19:02.220 | 70.00th=[ 186], 80.00th=[ 202], 90.00th=[ 235], 95.00th=[ 251], 00:19:02.220 | 99.00th=[ 297], 99.50th=[ 322], 99.90th=[ 347], 99.95th=[ 347], 00:19:02.220 | 99.99th=[ 347] 00:19:02.220 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:19:02.220 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:02.220 lat (usec) : 250=91.18%, 500=4.88% 00:19:02.220 lat (msec) : 50=3.94% 00:19:02.220 cpu : usr=0.40%, sys=0.70%, ctx=536, majf=0, minf=1 00:19:02.220 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:02.220 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:02.220 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:02.220 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:02.220 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:02.220 00:19:02.220 Run status group 0 (all jobs): 00:19:02.220 READ: bw=83.8KiB/s (85.8kB/s), 83.8KiB/s-83.8KiB/s (85.8kB/s-85.8kB/s), io=84.0KiB (86.0kB), run=1002-1002msec 00:19:02.220 WRITE: bw=2044KiB/s (2093kB/s), 2044KiB/s-2044KiB/s (2093kB/s-2093kB/s), io=2048KiB (2097kB), run=1002-1002msec 00:19:02.220 00:19:02.220 Disk stats (read/write): 00:19:02.220 nvme0n1: ios=70/512, merge=0/0, ticks=1899/86, in_queue=1985, util=98.80% 00:19:02.220 16:02:51 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:02.220 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:02.220 16:02:51 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:02.220 16:02:51 -- common/autotest_common.sh@1198 -- # local i=0 00:19:02.220 16:02:51 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:02.220 16:02:51 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:02.220 16:02:51 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:02.220 16:02:51 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:02.220 16:02:51 -- common/autotest_common.sh@1210 -- # return 0 00:19:02.220 16:02:51 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:02.220 16:02:51 -- target/nmic.sh@53 -- # nvmftestfini 00:19:02.220 16:02:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:02.220 16:02:51 -- nvmf/common.sh@116 -- # sync 00:19:02.220 16:02:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:02.220 16:02:51 -- nvmf/common.sh@119 -- # set +e 00:19:02.220 16:02:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:02.220 16:02:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:02.220 rmmod nvme_tcp 00:19:02.220 rmmod nvme_fabrics 00:19:02.220 rmmod nvme_keyring 00:19:02.220 16:02:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:02.220 16:02:51 -- nvmf/common.sh@123 -- # set -e 00:19:02.220 16:02:51 -- nvmf/common.sh@124 -- # return 0 00:19:02.220 16:02:51 -- nvmf/common.sh@477 -- # '[' -n 2430168 ']' 00:19:02.220 16:02:51 -- nvmf/common.sh@478 -- # killprocess 2430168 00:19:02.220 16:02:51 -- common/autotest_common.sh@926 -- # '[' -z 2430168 ']' 00:19:02.220 16:02:51 -- common/autotest_common.sh@930 -- # kill -0 2430168 00:19:02.220 16:02:51 -- common/autotest_common.sh@931 -- # uname 00:19:02.220 16:02:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:02.220 16:02:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2430168 00:19:02.220 16:02:52 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:19:02.220 16:02:52 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:19:02.220 16:02:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2430168' 00:19:02.220 killing process with pid 2430168 00:19:02.220 16:02:52 -- common/autotest_common.sh@945 -- # kill 2430168 00:19:02.220 16:02:52 -- common/autotest_common.sh@950 -- # wait 2430168 00:19:02.478 16:02:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:02.478 16:02:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:02.478 16:02:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:02.478 16:02:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:02.478 16:02:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:02.478 16:02:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:02.478 16:02:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:02.478 16:02:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:05.012 16:02:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:05.012 00:19:05.012 real 0m10.631s 00:19:05.012 user 0m25.237s 00:19:05.012 sys 0m2.461s 00:19:05.012 16:02:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:05.012 16:02:54 -- common/autotest_common.sh@10 -- # set +x 00:19:05.012 ************************************ 00:19:05.012 END TEST nvmf_nmic 00:19:05.012 ************************************ 00:19:05.012 16:02:54 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:05.012 16:02:54 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:05.012 16:02:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:05.012 16:02:54 -- common/autotest_common.sh@10 -- # set +x 00:19:05.012 ************************************ 00:19:05.012 START TEST nvmf_fio_target 00:19:05.012 ************************************ 00:19:05.012 16:02:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:05.012 * Looking for test storage... 00:19:05.012 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:05.012 16:02:54 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:05.012 16:02:54 -- nvmf/common.sh@7 -- # uname -s 00:19:05.012 16:02:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:05.012 16:02:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:05.012 16:02:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:05.012 16:02:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:05.012 16:02:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:05.012 16:02:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:05.012 16:02:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:05.012 16:02:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:05.012 16:02:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:05.012 16:02:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:05.012 16:02:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:05.012 16:02:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:05.012 16:02:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:05.012 16:02:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:05.012 16:02:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:05.012 16:02:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:05.012 16:02:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:05.012 16:02:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:05.012 16:02:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:05.012 16:02:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:05.012 16:02:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:05.012 16:02:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:05.012 16:02:54 -- paths/export.sh@5 -- # export PATH 00:19:05.013 16:02:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:05.013 16:02:54 -- nvmf/common.sh@46 -- # : 0 00:19:05.013 16:02:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:05.013 16:02:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:05.013 16:02:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:05.013 16:02:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:05.013 16:02:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:05.013 16:02:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:05.013 16:02:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:05.013 16:02:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:05.013 16:02:54 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:05.013 16:02:54 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:05.013 16:02:54 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:05.013 16:02:54 -- target/fio.sh@16 -- # nvmftestinit 00:19:05.013 16:02:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:05.013 16:02:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:05.013 16:02:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:05.013 16:02:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:05.013 16:02:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:05.013 16:02:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:05.013 16:02:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:05.013 16:02:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:05.013 16:02:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:05.013 16:02:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:05.013 16:02:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:05.013 16:02:54 -- common/autotest_common.sh@10 -- # set +x 00:19:06.917 16:02:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:06.917 16:02:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:06.917 16:02:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:06.917 16:02:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:06.917 16:02:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:06.917 16:02:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:06.917 16:02:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:06.917 16:02:56 -- nvmf/common.sh@294 -- # net_devs=() 00:19:06.917 16:02:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:06.917 16:02:56 -- nvmf/common.sh@295 -- # e810=() 00:19:06.917 16:02:56 -- nvmf/common.sh@295 -- # local -ga e810 00:19:06.917 16:02:56 -- nvmf/common.sh@296 -- # x722=() 00:19:06.917 16:02:56 -- nvmf/common.sh@296 -- # local -ga x722 00:19:06.917 16:02:56 -- nvmf/common.sh@297 -- # mlx=() 00:19:06.917 16:02:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:06.917 16:02:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:06.917 16:02:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:06.917 16:02:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:06.917 16:02:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:06.917 16:02:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:06.917 16:02:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:06.917 16:02:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:06.917 16:02:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:06.917 16:02:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:06.917 16:02:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:06.917 16:02:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:06.917 16:02:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:06.917 16:02:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:06.917 16:02:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:06.917 16:02:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:06.917 16:02:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:06.917 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:06.917 16:02:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:06.917 16:02:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:06.917 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:06.917 16:02:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:06.917 16:02:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:06.917 16:02:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:06.917 16:02:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:06.917 16:02:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:06.917 16:02:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:06.917 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:06.917 16:02:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:06.917 16:02:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:06.917 16:02:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:06.917 16:02:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:06.917 16:02:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:06.917 16:02:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:06.917 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:06.917 16:02:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:06.917 16:02:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:06.917 16:02:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:06.917 16:02:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:06.917 16:02:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:06.917 16:02:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:06.917 16:02:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:06.917 16:02:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:06.917 16:02:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:06.917 16:02:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:06.917 16:02:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:06.917 16:02:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:06.917 16:02:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:06.917 16:02:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:06.917 16:02:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:06.917 16:02:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:06.917 16:02:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:06.917 16:02:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:06.917 16:02:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:06.917 16:02:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:06.917 16:02:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:06.917 16:02:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:06.917 16:02:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:06.917 16:02:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:06.917 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:06.917 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.233 ms 00:19:06.917 00:19:06.917 --- 10.0.0.2 ping statistics --- 00:19:06.917 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:06.917 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:19:06.917 16:02:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:06.917 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:06.917 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:19:06.917 00:19:06.917 --- 10.0.0.1 ping statistics --- 00:19:06.917 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:06.917 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:19:06.917 16:02:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:06.917 16:02:56 -- nvmf/common.sh@410 -- # return 0 00:19:06.917 16:02:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:06.917 16:02:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:06.917 16:02:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:06.917 16:02:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:06.917 16:02:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:06.917 16:02:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:06.917 16:02:56 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:06.917 16:02:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:06.917 16:02:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:06.917 16:02:56 -- common/autotest_common.sh@10 -- # set +x 00:19:06.917 16:02:56 -- nvmf/common.sh@469 -- # nvmfpid=2433031 00:19:06.917 16:02:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:06.917 16:02:56 -- nvmf/common.sh@470 -- # waitforlisten 2433031 00:19:06.917 16:02:56 -- common/autotest_common.sh@819 -- # '[' -z 2433031 ']' 00:19:06.917 16:02:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:06.917 16:02:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:06.917 16:02:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:06.917 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:06.917 16:02:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:06.917 16:02:56 -- common/autotest_common.sh@10 -- # set +x 00:19:06.917 [2024-10-30 16:02:56.701017] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:19:06.917 [2024-10-30 16:02:56.701091] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:06.917 EAL: No free 2048 kB hugepages reported on node 1 00:19:06.917 [2024-10-30 16:02:56.772261] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:07.175 [2024-10-30 16:02:56.864760] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:07.175 [2024-10-30 16:02:56.864943] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:07.175 [2024-10-30 16:02:56.864964] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:07.175 [2024-10-30 16:02:56.864978] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:07.175 [2024-10-30 16:02:56.865074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:07.175 [2024-10-30 16:02:56.865128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:07.175 [2024-10-30 16:02:56.865184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:07.175 [2024-10-30 16:02:56.865188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:07.796 16:02:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:07.796 16:02:57 -- common/autotest_common.sh@852 -- # return 0 00:19:07.796 16:02:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:07.796 16:02:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:07.796 16:02:57 -- common/autotest_common.sh@10 -- # set +x 00:19:08.055 16:02:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:08.055 16:02:57 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:08.055 [2024-10-30 16:02:57.917713] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:08.316 16:02:57 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:08.574 16:02:58 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:08.574 16:02:58 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:08.832 16:02:58 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:08.832 16:02:58 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:09.090 16:02:58 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:09.090 16:02:58 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:09.347 16:02:59 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:09.347 16:02:59 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:09.606 16:02:59 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:09.864 16:02:59 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:09.864 16:02:59 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:10.120 16:02:59 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:10.120 16:02:59 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:10.378 16:03:00 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:10.378 16:03:00 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:10.637 16:03:00 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:10.895 16:03:00 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:10.895 16:03:00 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:11.154 16:03:00 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:11.154 16:03:00 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:11.412 16:03:01 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:11.671 [2024-10-30 16:03:01.445113] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:11.671 16:03:01 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:11.928 16:03:01 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:12.187 16:03:02 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:12.755 16:03:02 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:12.755 16:03:02 -- common/autotest_common.sh@1177 -- # local i=0 00:19:12.755 16:03:02 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:12.755 16:03:02 -- common/autotest_common.sh@1179 -- # [[ -n 4 ]] 00:19:12.755 16:03:02 -- common/autotest_common.sh@1180 -- # nvme_device_counter=4 00:19:12.755 16:03:02 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:15.291 16:03:04 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:15.291 16:03:04 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:15.291 16:03:04 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:19:15.291 16:03:04 -- common/autotest_common.sh@1186 -- # nvme_devices=4 00:19:15.291 16:03:04 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:15.291 16:03:04 -- common/autotest_common.sh@1187 -- # return 0 00:19:15.291 16:03:04 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:15.291 [global] 00:19:15.291 thread=1 00:19:15.291 invalidate=1 00:19:15.291 rw=write 00:19:15.291 time_based=1 00:19:15.291 runtime=1 00:19:15.291 ioengine=libaio 00:19:15.291 direct=1 00:19:15.291 bs=4096 00:19:15.291 iodepth=1 00:19:15.291 norandommap=0 00:19:15.291 numjobs=1 00:19:15.291 00:19:15.291 verify_dump=1 00:19:15.291 verify_backlog=512 00:19:15.291 verify_state_save=0 00:19:15.291 do_verify=1 00:19:15.291 verify=crc32c-intel 00:19:15.291 [job0] 00:19:15.291 filename=/dev/nvme0n1 00:19:15.291 [job1] 00:19:15.291 filename=/dev/nvme0n2 00:19:15.291 [job2] 00:19:15.291 filename=/dev/nvme0n3 00:19:15.291 [job3] 00:19:15.291 filename=/dev/nvme0n4 00:19:15.291 Could not set queue depth (nvme0n1) 00:19:15.291 Could not set queue depth (nvme0n2) 00:19:15.291 Could not set queue depth (nvme0n3) 00:19:15.291 Could not set queue depth (nvme0n4) 00:19:15.291 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:15.291 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:15.291 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:15.291 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:15.291 fio-3.35 00:19:15.291 Starting 4 threads 00:19:16.230 00:19:16.230 job0: (groupid=0, jobs=1): err= 0: pid=2434262: Wed Oct 30 16:03:06 2024 00:19:16.230 read: IOPS=24, BW=96.2KiB/s (98.5kB/s)(100KiB/1040msec) 00:19:16.230 slat (nsec): min=6542, max=38264, avg=22865.28, stdev=9995.12 00:19:16.230 clat (usec): min=251, max=42041, avg=38161.62, stdev=11395.25 00:19:16.230 lat (usec): min=267, max=42054, avg=38184.48, stdev=11398.77 00:19:16.230 clat percentiles (usec): 00:19:16.230 | 1.00th=[ 253], 5.00th=[ 420], 10.00th=[40633], 20.00th=[41157], 00:19:16.230 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:19:16.230 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:16.230 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:16.230 | 99.99th=[42206] 00:19:16.230 write: IOPS=492, BW=1969KiB/s (2016kB/s)(2048KiB/1040msec); 0 zone resets 00:19:16.230 slat (nsec): min=6077, max=29425, avg=7196.38, stdev=1635.16 00:19:16.230 clat (usec): min=120, max=250, avg=157.09, stdev=32.48 00:19:16.230 lat (usec): min=126, max=279, avg=164.29, stdev=32.78 00:19:16.230 clat percentiles (usec): 00:19:16.230 | 1.00th=[ 123], 5.00th=[ 127], 10.00th=[ 130], 20.00th=[ 133], 00:19:16.230 | 30.00th=[ 137], 40.00th=[ 139], 50.00th=[ 145], 60.00th=[ 151], 00:19:16.230 | 70.00th=[ 161], 80.00th=[ 180], 90.00th=[ 219], 95.00th=[ 227], 00:19:16.230 | 99.00th=[ 239], 99.50th=[ 243], 99.90th=[ 251], 99.95th=[ 251], 00:19:16.230 | 99.99th=[ 251] 00:19:16.230 bw ( KiB/s): min= 4096, max= 4096, per=28.11%, avg=4096.00, stdev= 0.00, samples=1 00:19:16.230 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:16.230 lat (usec) : 250=95.16%, 500=0.56% 00:19:16.230 lat (msec) : 50=4.28% 00:19:16.230 cpu : usr=0.19%, sys=0.38%, ctx=537, majf=0, minf=1 00:19:16.230 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:16.230 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.230 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.230 issued rwts: total=25,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:16.230 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:16.230 job1: (groupid=0, jobs=1): err= 0: pid=2434263: Wed Oct 30 16:03:06 2024 00:19:16.230 read: IOPS=21, BW=85.9KiB/s (87.9kB/s)(88.0KiB/1025msec) 00:19:16.230 slat (nsec): min=6973, max=34274, avg=23315.86, stdev=9396.31 00:19:16.230 clat (usec): min=237, max=44542, avg=39872.43, stdev=8888.41 00:19:16.230 lat (usec): min=256, max=44560, avg=39895.74, stdev=8889.36 00:19:16.230 clat percentiles (usec): 00:19:16.230 | 1.00th=[ 239], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:19:16.230 | 30.00th=[41157], 40.00th=[41681], 50.00th=[41681], 60.00th=[42206], 00:19:16.230 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:16.230 | 99.00th=[44303], 99.50th=[44303], 99.90th=[44303], 99.95th=[44303], 00:19:16.230 | 99.99th=[44303] 00:19:16.230 write: IOPS=499, BW=1998KiB/s (2046kB/s)(2048KiB/1025msec); 0 zone resets 00:19:16.230 slat (usec): min=6, max=41737, avg=126.24, stdev=2028.14 00:19:16.230 clat (usec): min=128, max=303, avg=152.49, stdev=13.12 00:19:16.230 lat (usec): min=135, max=41915, avg=278.73, stdev=2029.52 00:19:16.230 clat percentiles (usec): 00:19:16.230 | 1.00th=[ 133], 5.00th=[ 139], 10.00th=[ 141], 20.00th=[ 143], 00:19:16.230 | 30.00th=[ 147], 40.00th=[ 149], 50.00th=[ 151], 60.00th=[ 153], 00:19:16.230 | 70.00th=[ 157], 80.00th=[ 161], 90.00th=[ 167], 95.00th=[ 176], 00:19:16.230 | 99.00th=[ 190], 99.50th=[ 196], 99.90th=[ 306], 99.95th=[ 306], 00:19:16.230 | 99.99th=[ 306] 00:19:16.230 bw ( KiB/s): min= 4096, max= 4096, per=28.11%, avg=4096.00, stdev= 0.00, samples=1 00:19:16.230 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:16.230 lat (usec) : 250=95.88%, 500=0.19% 00:19:16.230 lat (msec) : 50=3.93% 00:19:16.230 cpu : usr=0.00%, sys=0.59%, ctx=540, majf=0, minf=1 00:19:16.230 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:16.230 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.230 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.230 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:16.230 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:16.230 job2: (groupid=0, jobs=1): err= 0: pid=2434264: Wed Oct 30 16:03:06 2024 00:19:16.230 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:19:16.230 slat (nsec): min=5975, max=49441, avg=13657.17, stdev=5463.69 00:19:16.230 clat (usec): min=176, max=646, avg=230.66, stdev=34.99 00:19:16.230 lat (usec): min=182, max=664, avg=244.32, stdev=37.59 00:19:16.230 clat percentiles (usec): 00:19:16.230 | 1.00th=[ 188], 5.00th=[ 194], 10.00th=[ 200], 20.00th=[ 208], 00:19:16.230 | 30.00th=[ 219], 40.00th=[ 227], 50.00th=[ 231], 60.00th=[ 235], 00:19:16.230 | 70.00th=[ 239], 80.00th=[ 245], 90.00th=[ 253], 95.00th=[ 262], 00:19:16.230 | 99.00th=[ 392], 99.50th=[ 498], 99.90th=[ 570], 99.95th=[ 627], 00:19:16.230 | 99.99th=[ 644] 00:19:16.230 write: IOPS=2250, BW=9003KiB/s (9219kB/s)(9012KiB/1001msec); 0 zone resets 00:19:16.230 slat (usec): min=7, max=41740, avg=42.63, stdev=966.69 00:19:16.230 clat (usec): min=130, max=280, avg=169.92, stdev=19.00 00:19:16.230 lat (usec): min=139, max=41996, avg=212.55, stdev=969.53 00:19:16.230 clat percentiles (usec): 00:19:16.230 | 1.00th=[ 139], 5.00th=[ 143], 10.00th=[ 147], 20.00th=[ 153], 00:19:16.230 | 30.00th=[ 159], 40.00th=[ 165], 50.00th=[ 169], 60.00th=[ 174], 00:19:16.230 | 70.00th=[ 178], 80.00th=[ 184], 90.00th=[ 192], 95.00th=[ 206], 00:19:16.230 | 99.00th=[ 229], 99.50th=[ 235], 99.90th=[ 255], 99.95th=[ 265], 00:19:16.230 | 99.99th=[ 281] 00:19:16.230 bw ( KiB/s): min= 8576, max= 8576, per=58.85%, avg=8576.00, stdev= 0.00, samples=1 00:19:16.230 iops : min= 2144, max= 2144, avg=2144.00, stdev= 0.00, samples=1 00:19:16.230 lat (usec) : 250=93.75%, 500=6.02%, 750=0.23% 00:19:16.230 cpu : usr=4.80%, sys=8.30%, ctx=4306, majf=0, minf=1 00:19:16.230 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:16.230 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.230 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.230 issued rwts: total=2048,2253,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:16.230 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:16.230 job3: (groupid=0, jobs=1): err= 0: pid=2434265: Wed Oct 30 16:03:06 2024 00:19:16.230 read: IOPS=417, BW=1672KiB/s (1712kB/s)(1692KiB/1012msec) 00:19:16.230 slat (nsec): min=4532, max=33887, avg=7183.63, stdev=4677.45 00:19:16.230 clat (usec): min=183, max=42035, avg=2126.53, stdev=8560.41 00:19:16.231 lat (usec): min=196, max=42052, avg=2133.71, stdev=8563.74 00:19:16.231 clat percentiles (usec): 00:19:16.231 | 1.00th=[ 200], 5.00th=[ 212], 10.00th=[ 219], 20.00th=[ 229], 00:19:16.231 | 30.00th=[ 243], 40.00th=[ 249], 50.00th=[ 255], 60.00th=[ 265], 00:19:16.231 | 70.00th=[ 281], 80.00th=[ 371], 90.00th=[ 396], 95.00th=[ 486], 00:19:16.231 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:16.231 | 99.99th=[42206] 00:19:16.231 write: IOPS=505, BW=2024KiB/s (2072kB/s)(2048KiB/1012msec); 0 zone resets 00:19:16.231 slat (nsec): min=5898, max=30954, avg=7071.42, stdev=1850.00 00:19:16.231 clat (usec): min=132, max=421, avg=202.29, stdev=45.68 00:19:16.231 lat (usec): min=139, max=452, avg=209.36, stdev=45.93 00:19:16.231 clat percentiles (usec): 00:19:16.231 | 1.00th=[ 139], 5.00th=[ 145], 10.00th=[ 149], 20.00th=[ 153], 00:19:16.231 | 30.00th=[ 159], 40.00th=[ 172], 50.00th=[ 198], 60.00th=[ 245], 00:19:16.231 | 70.00th=[ 245], 80.00th=[ 247], 90.00th=[ 247], 95.00th=[ 249], 00:19:16.231 | 99.00th=[ 251], 99.50th=[ 253], 99.90th=[ 420], 99.95th=[ 420], 00:19:16.231 | 99.99th=[ 420] 00:19:16.231 bw ( KiB/s): min= 4096, max= 4096, per=28.11%, avg=4096.00, stdev= 0.00, samples=1 00:19:16.231 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:16.231 lat (usec) : 250=73.80%, 500=24.17% 00:19:16.231 lat (msec) : 50=2.03% 00:19:16.231 cpu : usr=0.49%, sys=0.49%, ctx=935, majf=0, minf=2 00:19:16.231 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:16.231 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.231 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.231 issued rwts: total=423,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:16.231 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:16.231 00:19:16.231 Run status group 0 (all jobs): 00:19:16.231 READ: bw=9685KiB/s (9917kB/s), 85.9KiB/s-8184KiB/s (87.9kB/s-8380kB/s), io=9.84MiB (10.3MB), run=1001-1040msec 00:19:16.231 WRITE: bw=14.2MiB/s (14.9MB/s), 1969KiB/s-9003KiB/s (2016kB/s-9219kB/s), io=14.8MiB (15.5MB), run=1001-1040msec 00:19:16.231 00:19:16.231 Disk stats (read/write): 00:19:16.231 nvme0n1: ios=70/512, merge=0/0, ticks=774/72, in_queue=846, util=86.77% 00:19:16.231 nvme0n2: ios=40/512, merge=0/0, ticks=1574/76, in_queue=1650, util=92.88% 00:19:16.231 nvme0n3: ios=1662/2048, merge=0/0, ticks=1304/331, in_queue=1635, util=95.72% 00:19:16.231 nvme0n4: ios=476/512, merge=0/0, ticks=807/102, in_queue=909, util=94.95% 00:19:16.489 16:03:06 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:16.489 [global] 00:19:16.489 thread=1 00:19:16.489 invalidate=1 00:19:16.489 rw=randwrite 00:19:16.489 time_based=1 00:19:16.489 runtime=1 00:19:16.489 ioengine=libaio 00:19:16.489 direct=1 00:19:16.489 bs=4096 00:19:16.489 iodepth=1 00:19:16.489 norandommap=0 00:19:16.489 numjobs=1 00:19:16.489 00:19:16.489 verify_dump=1 00:19:16.489 verify_backlog=512 00:19:16.489 verify_state_save=0 00:19:16.489 do_verify=1 00:19:16.489 verify=crc32c-intel 00:19:16.489 [job0] 00:19:16.489 filename=/dev/nvme0n1 00:19:16.489 [job1] 00:19:16.489 filename=/dev/nvme0n2 00:19:16.489 [job2] 00:19:16.489 filename=/dev/nvme0n3 00:19:16.489 [job3] 00:19:16.489 filename=/dev/nvme0n4 00:19:16.489 Could not set queue depth (nvme0n1) 00:19:16.489 Could not set queue depth (nvme0n2) 00:19:16.489 Could not set queue depth (nvme0n3) 00:19:16.489 Could not set queue depth (nvme0n4) 00:19:16.489 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:16.489 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:16.489 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:16.489 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:16.489 fio-3.35 00:19:16.489 Starting 4 threads 00:19:17.863 00:19:17.863 job0: (groupid=0, jobs=1): err= 0: pid=2434493: Wed Oct 30 16:03:07 2024 00:19:17.863 read: IOPS=100, BW=402KiB/s (411kB/s)(404KiB/1006msec) 00:19:17.863 slat (nsec): min=4649, max=34925, avg=9825.01, stdev=8062.78 00:19:17.863 clat (usec): min=198, max=42013, avg=8749.40, stdev=16667.86 00:19:17.863 lat (usec): min=211, max=42029, avg=8759.22, stdev=16674.44 00:19:17.863 clat percentiles (usec): 00:19:17.863 | 1.00th=[ 219], 5.00th=[ 231], 10.00th=[ 235], 20.00th=[ 243], 00:19:17.863 | 30.00th=[ 247], 40.00th=[ 249], 50.00th=[ 251], 60.00th=[ 255], 00:19:17.863 | 70.00th=[ 269], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:17.863 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:17.863 | 99.99th=[42206] 00:19:17.863 write: IOPS=508, BW=2036KiB/s (2085kB/s)(2048KiB/1006msec); 0 zone resets 00:19:17.863 slat (nsec): min=6410, max=29873, avg=10118.93, stdev=2459.67 00:19:17.863 clat (usec): min=140, max=276, avg=223.30, stdev=23.76 00:19:17.863 lat (usec): min=148, max=286, avg=233.42, stdev=24.14 00:19:17.863 clat percentiles (usec): 00:19:17.863 | 1.00th=[ 145], 5.00th=[ 157], 10.00th=[ 204], 20.00th=[ 215], 00:19:17.863 | 30.00th=[ 221], 40.00th=[ 225], 50.00th=[ 227], 60.00th=[ 231], 00:19:17.863 | 70.00th=[ 235], 80.00th=[ 239], 90.00th=[ 247], 95.00th=[ 251], 00:19:17.863 | 99.00th=[ 265], 99.50th=[ 269], 99.90th=[ 277], 99.95th=[ 277], 00:19:17.863 | 99.99th=[ 277] 00:19:17.863 bw ( KiB/s): min= 4096, max= 4096, per=23.00%, avg=4096.00, stdev= 0.00, samples=1 00:19:17.863 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:17.863 lat (usec) : 250=86.79%, 500=9.79% 00:19:17.863 lat (msec) : 50=3.43% 00:19:17.863 cpu : usr=0.10%, sys=0.80%, ctx=615, majf=0, minf=1 00:19:17.863 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:17.863 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.864 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.864 issued rwts: total=101,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:17.864 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:17.864 job1: (groupid=0, jobs=1): err= 0: pid=2434494: Wed Oct 30 16:03:07 2024 00:19:17.864 read: IOPS=519, BW=2077KiB/s (2126kB/s)(2116KiB/1019msec) 00:19:17.864 slat (nsec): min=5416, max=35277, avg=7030.59, stdev=3858.26 00:19:17.864 clat (usec): min=186, max=42027, avg=1572.73, stdev=7205.34 00:19:17.864 lat (usec): min=192, max=42045, avg=1579.76, stdev=7208.18 00:19:17.864 clat percentiles (usec): 00:19:17.864 | 1.00th=[ 219], 5.00th=[ 233], 10.00th=[ 237], 20.00th=[ 241], 00:19:17.864 | 30.00th=[ 245], 40.00th=[ 249], 50.00th=[ 251], 60.00th=[ 253], 00:19:17.864 | 70.00th=[ 255], 80.00th=[ 260], 90.00th=[ 273], 95.00th=[ 506], 00:19:17.864 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:19:17.864 | 99.99th=[42206] 00:19:17.864 write: IOPS=1004, BW=4020KiB/s (4116kB/s)(4096KiB/1019msec); 0 zone resets 00:19:17.864 slat (nsec): min=6641, max=34707, avg=8900.18, stdev=3518.24 00:19:17.864 clat (usec): min=120, max=607, avg=166.19, stdev=33.30 00:19:17.864 lat (usec): min=127, max=619, avg=175.09, stdev=34.05 00:19:17.864 clat percentiles (usec): 00:19:17.864 | 1.00th=[ 127], 5.00th=[ 135], 10.00th=[ 139], 20.00th=[ 145], 00:19:17.864 | 30.00th=[ 149], 40.00th=[ 153], 50.00th=[ 157], 60.00th=[ 161], 00:19:17.864 | 70.00th=[ 169], 80.00th=[ 180], 90.00th=[ 215], 95.00th=[ 243], 00:19:17.864 | 99.00th=[ 247], 99.50th=[ 260], 99.90th=[ 371], 99.95th=[ 611], 00:19:17.864 | 99.99th=[ 611] 00:19:17.864 bw ( KiB/s): min= 8192, max= 8192, per=46.00%, avg=8192.00, stdev= 0.00, samples=1 00:19:17.864 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:17.864 lat (usec) : 250=81.71%, 500=16.36%, 750=0.84% 00:19:17.864 lat (msec) : 50=1.09% 00:19:17.864 cpu : usr=0.88%, sys=1.77%, ctx=1553, majf=0, minf=1 00:19:17.864 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:17.864 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.864 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.864 issued rwts: total=529,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:17.864 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:17.864 job2: (groupid=0, jobs=1): err= 0: pid=2434495: Wed Oct 30 16:03:07 2024 00:19:17.864 read: IOPS=21, BW=85.0KiB/s (87.1kB/s)(88.0KiB/1035msec) 00:19:17.864 slat (nsec): min=7762, max=34799, avg=20562.27, stdev=8805.01 00:19:17.864 clat (usec): min=40906, max=42039, avg=41558.45, stdev=509.95 00:19:17.864 lat (usec): min=40913, max=42054, avg=41579.01, stdev=510.80 00:19:17.864 clat percentiles (usec): 00:19:17.864 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:17.864 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41681], 60.00th=[42206], 00:19:17.864 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:17.864 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:17.864 | 99.99th=[42206] 00:19:17.864 write: IOPS=494, BW=1979KiB/s (2026kB/s)(2048KiB/1035msec); 0 zone resets 00:19:17.864 slat (nsec): min=7580, max=30596, avg=8827.79, stdev=2301.37 00:19:17.864 clat (usec): min=159, max=316, avg=222.96, stdev=23.18 00:19:17.864 lat (usec): min=167, max=325, avg=231.79, stdev=23.37 00:19:17.864 clat percentiles (usec): 00:19:17.864 | 1.00th=[ 169], 5.00th=[ 176], 10.00th=[ 184], 20.00th=[ 210], 00:19:17.864 | 30.00th=[ 219], 40.00th=[ 223], 50.00th=[ 229], 60.00th=[ 233], 00:19:17.864 | 70.00th=[ 237], 80.00th=[ 241], 90.00th=[ 247], 95.00th=[ 251], 00:19:17.864 | 99.00th=[ 269], 99.50th=[ 273], 99.90th=[ 318], 99.95th=[ 318], 00:19:17.864 | 99.99th=[ 318] 00:19:17.864 bw ( KiB/s): min= 4096, max= 4096, per=23.00%, avg=4096.00, stdev= 0.00, samples=1 00:19:17.864 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:17.864 lat (usec) : 250=90.26%, 500=5.62% 00:19:17.864 lat (msec) : 50=4.12% 00:19:17.864 cpu : usr=0.29%, sys=0.68%, ctx=534, majf=0, minf=1 00:19:17.864 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:17.864 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.864 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.864 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:17.864 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:17.864 job3: (groupid=0, jobs=1): err= 0: pid=2434496: Wed Oct 30 16:03:07 2024 00:19:17.864 read: IOPS=2299, BW=9199KiB/s (9420kB/s)(9208KiB/1001msec) 00:19:17.864 slat (nsec): min=4394, max=35705, avg=8248.18, stdev=4266.61 00:19:17.864 clat (usec): min=168, max=539, avg=227.09, stdev=51.83 00:19:17.864 lat (usec): min=173, max=552, avg=235.34, stdev=53.40 00:19:17.864 clat percentiles (usec): 00:19:17.864 | 1.00th=[ 174], 5.00th=[ 178], 10.00th=[ 182], 20.00th=[ 188], 00:19:17.864 | 30.00th=[ 192], 40.00th=[ 198], 50.00th=[ 208], 60.00th=[ 237], 00:19:17.864 | 70.00th=[ 253], 80.00th=[ 265], 90.00th=[ 273], 95.00th=[ 293], 00:19:17.864 | 99.00th=[ 453], 99.50th=[ 469], 99.90th=[ 519], 99.95th=[ 519], 00:19:17.864 | 99.99th=[ 537] 00:19:17.864 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:19:17.864 slat (nsec): min=5734, max=50818, avg=11766.56, stdev=5153.10 00:19:17.864 clat (usec): min=124, max=387, avg=161.89, stdev=31.63 00:19:17.864 lat (usec): min=133, max=403, avg=173.65, stdev=31.30 00:19:17.864 clat percentiles (usec): 00:19:17.864 | 1.00th=[ 129], 5.00th=[ 135], 10.00th=[ 139], 20.00th=[ 143], 00:19:17.864 | 30.00th=[ 145], 40.00th=[ 149], 50.00th=[ 153], 60.00th=[ 157], 00:19:17.864 | 70.00th=[ 165], 80.00th=[ 176], 90.00th=[ 198], 95.00th=[ 223], 00:19:17.864 | 99.00th=[ 314], 99.50th=[ 330], 99.90th=[ 347], 99.95th=[ 379], 00:19:17.864 | 99.99th=[ 388] 00:19:17.864 bw ( KiB/s): min= 8848, max= 8848, per=49.68%, avg=8848.00, stdev= 0.00, samples=1 00:19:17.864 iops : min= 2212, max= 2212, avg=2212.00, stdev= 0.00, samples=1 00:19:17.864 lat (usec) : 250=83.28%, 500=16.64%, 750=0.08% 00:19:17.864 cpu : usr=3.30%, sys=4.50%, ctx=4862, majf=0, minf=2 00:19:17.864 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:17.864 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.864 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:17.864 issued rwts: total=2302,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:17.864 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:17.864 00:19:17.864 Run status group 0 (all jobs): 00:19:17.864 READ: bw=11.1MiB/s (11.7MB/s), 85.0KiB/s-9199KiB/s (87.1kB/s-9420kB/s), io=11.5MiB (12.1MB), run=1001-1035msec 00:19:17.864 WRITE: bw=17.4MiB/s (18.2MB/s), 1979KiB/s-9.99MiB/s (2026kB/s-10.5MB/s), io=18.0MiB (18.9MB), run=1001-1035msec 00:19:17.864 00:19:17.864 Disk stats (read/write): 00:19:17.864 nvme0n1: ios=136/512, merge=0/0, ticks=1150/112, in_queue=1262, util=97.39% 00:19:17.864 nvme0n2: ios=524/1024, merge=0/0, ticks=627/166, in_queue=793, util=84.85% 00:19:17.864 nvme0n3: ios=17/512, merge=0/0, ticks=706/110, in_queue=816, util=88.38% 00:19:17.864 nvme0n4: ios=1893/2048, merge=0/0, ticks=437/317, in_queue=754, util=89.43% 00:19:17.864 16:03:07 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:17.864 [global] 00:19:17.864 thread=1 00:19:17.864 invalidate=1 00:19:17.864 rw=write 00:19:17.864 time_based=1 00:19:17.864 runtime=1 00:19:17.864 ioengine=libaio 00:19:17.864 direct=1 00:19:17.864 bs=4096 00:19:17.864 iodepth=128 00:19:17.864 norandommap=0 00:19:17.864 numjobs=1 00:19:17.864 00:19:17.864 verify_dump=1 00:19:17.864 verify_backlog=512 00:19:17.864 verify_state_save=0 00:19:17.864 do_verify=1 00:19:17.864 verify=crc32c-intel 00:19:17.864 [job0] 00:19:17.864 filename=/dev/nvme0n1 00:19:17.864 [job1] 00:19:17.864 filename=/dev/nvme0n2 00:19:17.864 [job2] 00:19:17.864 filename=/dev/nvme0n3 00:19:17.864 [job3] 00:19:17.864 filename=/dev/nvme0n4 00:19:17.864 Could not set queue depth (nvme0n1) 00:19:17.864 Could not set queue depth (nvme0n2) 00:19:17.864 Could not set queue depth (nvme0n3) 00:19:17.864 Could not set queue depth (nvme0n4) 00:19:18.123 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:18.123 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:18.123 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:18.123 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:18.123 fio-3.35 00:19:18.123 Starting 4 threads 00:19:19.498 00:19:19.498 job0: (groupid=0, jobs=1): err= 0: pid=2435149: Wed Oct 30 16:03:09 2024 00:19:19.498 read: IOPS=2614, BW=10.2MiB/s (10.7MB/s)(10.3MiB/1009msec) 00:19:19.498 slat (usec): min=3, max=30582, avg=194.43, stdev=1453.57 00:19:19.498 clat (usec): min=5293, max=62682, avg=22791.98, stdev=11203.93 00:19:19.498 lat (usec): min=5300, max=70749, avg=22986.41, stdev=11305.73 00:19:19.498 clat percentiles (usec): 00:19:19.498 | 1.00th=[ 6259], 5.00th=[11076], 10.00th=[11863], 20.00th=[12649], 00:19:19.498 | 30.00th=[15795], 40.00th=[19792], 50.00th=[20055], 60.00th=[20841], 00:19:19.498 | 70.00th=[22152], 80.00th=[30540], 90.00th=[41157], 95.00th=[46400], 00:19:19.498 | 99.00th=[57410], 99.50th=[61080], 99.90th=[62653], 99.95th=[62653], 00:19:19.498 | 99.99th=[62653] 00:19:19.498 write: IOPS=3044, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1009msec); 0 zone resets 00:19:19.498 slat (usec): min=5, max=27383, avg=151.99, stdev=989.84 00:19:19.498 clat (usec): min=2592, max=62687, avg=20550.93, stdev=6894.11 00:19:19.498 lat (usec): min=2599, max=62695, avg=20702.92, stdev=6975.68 00:19:19.498 clat percentiles (usec): 00:19:19.498 | 1.00th=[ 4228], 5.00th=[ 9503], 10.00th=[12518], 20.00th=[15139], 00:19:19.498 | 30.00th=[19006], 40.00th=[19792], 50.00th=[20841], 60.00th=[21627], 00:19:19.498 | 70.00th=[22152], 80.00th=[23200], 90.00th=[27657], 95.00th=[29492], 00:19:19.498 | 99.00th=[43779], 99.50th=[47973], 99.90th=[53740], 99.95th=[62653], 00:19:19.498 | 99.99th=[62653] 00:19:19.498 bw ( KiB/s): min=11896, max=12288, per=19.30%, avg=12092.00, stdev=277.19, samples=2 00:19:19.498 iops : min= 2974, max= 3072, avg=3023.00, stdev=69.30, samples=2 00:19:19.498 lat (msec) : 4=0.46%, 10=3.43%, 20=42.43%, 50=52.03%, 100=1.65% 00:19:19.498 cpu : usr=2.88%, sys=3.37%, ctx=313, majf=0, minf=1 00:19:19.498 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:19.498 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.498 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:19.498 issued rwts: total=2638,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:19.498 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:19.498 job1: (groupid=0, jobs=1): err= 0: pid=2435168: Wed Oct 30 16:03:09 2024 00:19:19.498 read: IOPS=2800, BW=10.9MiB/s (11.5MB/s)(11.0MiB/1004msec) 00:19:19.498 slat (usec): min=3, max=19058, avg=161.90, stdev=1155.33 00:19:19.498 clat (usec): min=2722, max=41985, avg=19722.99, stdev=6402.61 00:19:19.498 lat (usec): min=6087, max=42025, avg=19884.89, stdev=6494.50 00:19:19.498 clat percentiles (usec): 00:19:19.498 | 1.00th=[10290], 5.00th=[10290], 10.00th=[10421], 20.00th=[13566], 00:19:19.498 | 30.00th=[16581], 40.00th=[18482], 50.00th=[19530], 60.00th=[20317], 00:19:19.498 | 70.00th=[22676], 80.00th=[26346], 90.00th=[27919], 95.00th=[30540], 00:19:19.498 | 99.00th=[36439], 99.50th=[37487], 99.90th=[39584], 99.95th=[40633], 00:19:19.498 | 99.99th=[42206] 00:19:19.498 write: IOPS=3059, BW=12.0MiB/s (12.5MB/s)(12.0MiB/1004msec); 0 zone resets 00:19:19.498 slat (usec): min=4, max=22527, avg=170.22, stdev=1021.96 00:19:19.498 clat (usec): min=1141, max=58407, avg=22480.77, stdev=9657.74 00:19:19.498 lat (usec): min=1154, max=58416, avg=22651.00, stdev=9711.78 00:19:19.498 clat percentiles (usec): 00:19:19.498 | 1.00th=[ 8356], 5.00th=[ 9372], 10.00th=[10421], 20.00th=[17695], 00:19:19.498 | 30.00th=[19792], 40.00th=[20579], 50.00th=[21627], 60.00th=[22152], 00:19:19.498 | 70.00th=[22414], 80.00th=[27132], 90.00th=[29230], 95.00th=[46924], 00:19:19.498 | 99.00th=[55837], 99.50th=[56886], 99.90th=[58459], 99.95th=[58459], 00:19:19.498 | 99.99th=[58459] 00:19:19.498 bw ( KiB/s): min=12288, max=12288, per=19.61%, avg=12288.00, stdev= 0.00, samples=2 00:19:19.498 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=2 00:19:19.498 lat (msec) : 2=0.03%, 4=0.02%, 10=3.87%, 20=39.34%, 50=54.62% 00:19:19.498 lat (msec) : 100=2.11% 00:19:19.498 cpu : usr=2.79%, sys=4.49%, ctx=318, majf=0, minf=1 00:19:19.498 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:19:19.498 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.498 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:19.498 issued rwts: total=2812,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:19.498 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:19.498 job2: (groupid=0, jobs=1): err= 0: pid=2435175: Wed Oct 30 16:03:09 2024 00:19:19.498 read: IOPS=5104, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1003msec) 00:19:19.498 slat (usec): min=2, max=9493, avg=92.37, stdev=512.28 00:19:19.498 clat (usec): min=3942, max=22095, avg=12155.52, stdev=1695.85 00:19:19.498 lat (usec): min=3948, max=22102, avg=12247.89, stdev=1683.56 00:19:19.498 clat percentiles (usec): 00:19:19.498 | 1.00th=[ 7046], 5.00th=[ 9503], 10.00th=[10421], 20.00th=[11076], 00:19:19.498 | 30.00th=[11469], 40.00th=[11731], 50.00th=[12256], 60.00th=[12649], 00:19:19.498 | 70.00th=[12911], 80.00th=[13173], 90.00th=[13698], 95.00th=[14222], 00:19:19.498 | 99.00th=[17433], 99.50th=[19268], 99.90th=[22152], 99.95th=[22152], 00:19:19.498 | 99.99th=[22152] 00:19:19.498 write: IOPS=5599, BW=21.9MiB/s (22.9MB/s)(21.9MiB/1003msec); 0 zone resets 00:19:19.498 slat (usec): min=3, max=9259, avg=83.11, stdev=392.63 00:19:19.498 clat (usec): min=369, max=23914, avg=11580.02, stdev=2830.38 00:19:19.498 lat (usec): min=877, max=23919, avg=11663.13, stdev=2827.29 00:19:19.498 clat percentiles (usec): 00:19:19.498 | 1.00th=[ 3130], 5.00th=[ 5145], 10.00th=[ 7504], 20.00th=[10290], 00:19:19.498 | 30.00th=[11207], 40.00th=[11600], 50.00th=[12125], 60.00th=[12649], 00:19:19.498 | 70.00th=[13042], 80.00th=[13304], 90.00th=[13829], 95.00th=[14615], 00:19:19.498 | 99.00th=[19268], 99.50th=[21365], 99.90th=[23725], 99.95th=[23725], 00:19:19.498 | 99.99th=[23987] 00:19:19.498 bw ( KiB/s): min=21824, max=22080, per=35.04%, avg=21952.00, stdev=181.02, samples=2 00:19:19.498 iops : min= 5456, max= 5520, avg=5488.00, stdev=45.25, samples=2 00:19:19.498 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.07% 00:19:19.498 lat (msec) : 2=0.16%, 4=1.64%, 10=10.50%, 20=87.12%, 50=0.50% 00:19:19.498 cpu : usr=4.79%, sys=8.38%, ctx=612, majf=0, minf=1 00:19:19.498 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:19:19.498 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.498 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:19.498 issued rwts: total=5120,5616,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:19.498 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:19.498 job3: (groupid=0, jobs=1): err= 0: pid=2435176: Wed Oct 30 16:03:09 2024 00:19:19.498 read: IOPS=4349, BW=17.0MiB/s (17.8MB/s)(17.8MiB/1045msec) 00:19:19.498 slat (usec): min=2, max=21209, avg=117.62, stdev=864.90 00:19:19.499 clat (usec): min=4213, max=78546, avg=15519.51, stdev=10527.09 00:19:19.499 lat (usec): min=4224, max=78556, avg=15637.13, stdev=10579.80 00:19:19.499 clat percentiles (usec): 00:19:19.499 | 1.00th=[ 5473], 5.00th=[ 7898], 10.00th=[10159], 20.00th=[10683], 00:19:19.499 | 30.00th=[11338], 40.00th=[11600], 50.00th=[12649], 60.00th=[13304], 00:19:19.499 | 70.00th=[14222], 80.00th=[17171], 90.00th=[21365], 95.00th=[38536], 00:19:19.499 | 99.00th=[68682], 99.50th=[73925], 99.90th=[78119], 99.95th=[78119], 00:19:19.499 | 99.99th=[78119] 00:19:19.499 write: IOPS=4409, BW=17.2MiB/s (18.1MB/s)(18.0MiB/1045msec); 0 zone resets 00:19:19.499 slat (usec): min=3, max=10375, avg=88.74, stdev=485.82 00:19:19.499 clat (usec): min=897, max=78541, avg=13254.11, stdev=6900.64 00:19:19.499 lat (usec): min=903, max=78552, avg=13342.85, stdev=6940.25 00:19:19.499 clat percentiles (usec): 00:19:19.499 | 1.00th=[ 2737], 5.00th=[ 4883], 10.00th=[ 6587], 20.00th=[ 9634], 00:19:19.499 | 30.00th=[11076], 40.00th=[12125], 50.00th=[12518], 60.00th=[12780], 00:19:19.499 | 70.00th=[12911], 80.00th=[13829], 90.00th=[23200], 95.00th=[27395], 00:19:19.499 | 99.00th=[41157], 99.50th=[48497], 99.90th=[61604], 99.95th=[61604], 00:19:19.499 | 99.99th=[78119] 00:19:19.499 bw ( KiB/s): min=16336, max=20528, per=29.42%, avg=18432.00, stdev=2964.19, samples=2 00:19:19.499 iops : min= 4084, max= 5132, avg=4608.00, stdev=741.05, samples=2 00:19:19.499 lat (usec) : 1000=0.03% 00:19:19.499 lat (msec) : 2=0.28%, 4=1.37%, 10=14.01%, 20=72.12%, 50=10.55% 00:19:19.499 lat (msec) : 100=1.64% 00:19:19.499 cpu : usr=3.74%, sys=6.23%, ctx=539, majf=0, minf=1 00:19:19.499 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:19:19.499 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.499 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:19.499 issued rwts: total=4545,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:19.499 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:19.499 00:19:19.499 Run status group 0 (all jobs): 00:19:19.499 READ: bw=56.5MiB/s (59.2MB/s), 10.2MiB/s-19.9MiB/s (10.7MB/s-20.9MB/s), io=59.0MiB (61.9MB), run=1003-1045msec 00:19:19.499 WRITE: bw=61.2MiB/s (64.2MB/s), 11.9MiB/s-21.9MiB/s (12.5MB/s-22.9MB/s), io=63.9MiB (67.0MB), run=1003-1045msec 00:19:19.499 00:19:19.499 Disk stats (read/write): 00:19:19.499 nvme0n1: ios=2100/2560, merge=0/0, ticks=45152/50979, in_queue=96131, util=91.78% 00:19:19.499 nvme0n2: ios=2477/2560, merge=0/0, ticks=47914/53439, in_queue=101353, util=93.60% 00:19:19.499 nvme0n3: ios=4577/4608, merge=0/0, ticks=22461/19470, in_queue=41931, util=94.46% 00:19:19.499 nvme0n4: ios=3630/4079, merge=0/0, ticks=39627/47580, in_queue=87207, util=99.58% 00:19:19.499 16:03:09 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:19.499 [global] 00:19:19.499 thread=1 00:19:19.499 invalidate=1 00:19:19.499 rw=randwrite 00:19:19.499 time_based=1 00:19:19.499 runtime=1 00:19:19.499 ioengine=libaio 00:19:19.499 direct=1 00:19:19.499 bs=4096 00:19:19.499 iodepth=128 00:19:19.499 norandommap=0 00:19:19.499 numjobs=1 00:19:19.499 00:19:19.499 verify_dump=1 00:19:19.499 verify_backlog=512 00:19:19.499 verify_state_save=0 00:19:19.499 do_verify=1 00:19:19.499 verify=crc32c-intel 00:19:19.499 [job0] 00:19:19.499 filename=/dev/nvme0n1 00:19:19.499 [job1] 00:19:19.499 filename=/dev/nvme0n2 00:19:19.499 [job2] 00:19:19.499 filename=/dev/nvme0n3 00:19:19.499 [job3] 00:19:19.499 filename=/dev/nvme0n4 00:19:19.499 Could not set queue depth (nvme0n1) 00:19:19.499 Could not set queue depth (nvme0n2) 00:19:19.499 Could not set queue depth (nvme0n3) 00:19:19.499 Could not set queue depth (nvme0n4) 00:19:19.499 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:19.499 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:19.499 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:19.499 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:19.499 fio-3.35 00:19:19.499 Starting 4 threads 00:19:20.875 00:19:20.875 job0: (groupid=0, jobs=1): err= 0: pid=2435590: Wed Oct 30 16:03:10 2024 00:19:20.875 read: IOPS=5114, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1001msec) 00:19:20.875 slat (usec): min=2, max=12097, avg=89.15, stdev=544.57 00:19:20.875 clat (usec): min=5548, max=50079, avg=11511.90, stdev=4565.25 00:19:20.875 lat (usec): min=5559, max=50084, avg=11601.05, stdev=4590.06 00:19:20.875 clat percentiles (usec): 00:19:20.875 | 1.00th=[ 6915], 5.00th=[ 8225], 10.00th=[ 9110], 20.00th=[ 9765], 00:19:20.875 | 30.00th=[ 9896], 40.00th=[10159], 50.00th=[10290], 60.00th=[10552], 00:19:20.875 | 70.00th=[10945], 80.00th=[11994], 90.00th=[13960], 95.00th=[19268], 00:19:20.875 | 99.00th=[33817], 99.50th=[39060], 99.90th=[50070], 99.95th=[50070], 00:19:20.875 | 99.99th=[50070] 00:19:20.875 write: IOPS=5340, BW=20.9MiB/s (21.9MB/s)(20.9MiB/1001msec); 0 zone resets 00:19:20.875 slat (usec): min=3, max=20881, avg=94.63, stdev=591.58 00:19:20.875 clat (usec): min=424, max=35031, avg=12527.92, stdev=5266.96 00:19:20.875 lat (usec): min=2768, max=35752, avg=12622.55, stdev=5313.36 00:19:20.875 clat percentiles (usec): 00:19:20.875 | 1.00th=[ 4883], 5.00th=[ 7504], 10.00th=[ 8586], 20.00th=[10290], 00:19:20.875 | 30.00th=[10421], 40.00th=[10814], 50.00th=[10945], 60.00th=[11076], 00:19:20.875 | 70.00th=[11338], 80.00th=[12911], 90.00th=[20579], 95.00th=[26346], 00:19:20.875 | 99.00th=[32900], 99.50th=[33162], 99.90th=[34866], 99.95th=[34866], 00:19:20.875 | 99.99th=[34866] 00:19:20.875 bw ( KiB/s): min=20480, max=20480, per=30.61%, avg=20480.00, stdev= 0.00, samples=1 00:19:20.875 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:19:20.875 lat (usec) : 500=0.01% 00:19:20.875 lat (msec) : 4=0.41%, 10=25.23%, 20=67.15%, 50=7.06%, 100=0.13% 00:19:20.875 cpu : usr=4.00%, sys=7.70%, ctx=566, majf=0, minf=1 00:19:20.875 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:20.875 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:20.875 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:20.875 issued rwts: total=5120,5346,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:20.875 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:20.875 job1: (groupid=0, jobs=1): err= 0: pid=2435592: Wed Oct 30 16:03:10 2024 00:19:20.875 read: IOPS=4585, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1005msec) 00:19:20.875 slat (usec): min=2, max=11442, avg=96.30, stdev=607.60 00:19:20.875 clat (usec): min=6002, max=27003, avg=12138.88, stdev=3640.50 00:19:20.875 lat (usec): min=6011, max=27018, avg=12235.19, stdev=3685.94 00:19:20.875 clat percentiles (usec): 00:19:20.875 | 1.00th=[ 6718], 5.00th=[ 8029], 10.00th=[ 8979], 20.00th=[ 9634], 00:19:20.875 | 30.00th=[ 9765], 40.00th=[ 9896], 50.00th=[10290], 60.00th=[10945], 00:19:20.875 | 70.00th=[13566], 80.00th=[16581], 90.00th=[17695], 95.00th=[19006], 00:19:20.875 | 99.00th=[21627], 99.50th=[22414], 99.90th=[22414], 99.95th=[23987], 00:19:20.875 | 99.99th=[27132] 00:19:20.875 write: IOPS=4956, BW=19.4MiB/s (20.3MB/s)(19.5MiB/1005msec); 0 zone resets 00:19:20.875 slat (usec): min=3, max=13603, avg=105.67, stdev=735.76 00:19:20.875 clat (usec): min=857, max=58629, avg=14257.26, stdev=7009.88 00:19:20.875 lat (usec): min=866, max=58635, avg=14362.93, stdev=7068.04 00:19:20.875 clat percentiles (usec): 00:19:20.875 | 1.00th=[ 6259], 5.00th=[ 8586], 10.00th=[10028], 20.00th=[10421], 00:19:20.876 | 30.00th=[10552], 40.00th=[10814], 50.00th=[11338], 60.00th=[13566], 00:19:20.876 | 70.00th=[14353], 80.00th=[17433], 90.00th=[20841], 95.00th=[29754], 00:19:20.876 | 99.00th=[44827], 99.50th=[52691], 99.90th=[57934], 99.95th=[58459], 00:19:20.876 | 99.99th=[58459] 00:19:20.876 bw ( KiB/s): min=15472, max=23360, per=29.02%, avg=19416.00, stdev=5577.66, samples=2 00:19:20.876 iops : min= 3868, max= 5840, avg=4854.00, stdev=1394.41, samples=2 00:19:20.876 lat (usec) : 1000=0.06% 00:19:20.876 lat (msec) : 2=0.01%, 10=25.04%, 20=67.49%, 50=7.06%, 100=0.33% 00:19:20.876 cpu : usr=3.59%, sys=5.88%, ctx=346, majf=0, minf=1 00:19:20.876 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:19:20.876 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:20.876 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:20.876 issued rwts: total=4608,4981,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:20.876 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:20.876 job2: (groupid=0, jobs=1): err= 0: pid=2435594: Wed Oct 30 16:03:10 2024 00:19:20.876 read: IOPS=2570, BW=10.0MiB/s (10.5MB/s)(10.5MiB/1045msec) 00:19:20.876 slat (usec): min=2, max=44010, avg=174.86, stdev=1389.90 00:19:20.876 clat (usec): min=6871, max=81837, avg=22818.30, stdev=15445.14 00:19:20.876 lat (usec): min=6880, max=81845, avg=22993.17, stdev=15501.72 00:19:20.876 clat percentiles (usec): 00:19:20.876 | 1.00th=[ 7439], 5.00th=[12518], 10.00th=[12649], 20.00th=[13698], 00:19:20.876 | 30.00th=[14222], 40.00th=[14484], 50.00th=[15008], 60.00th=[16909], 00:19:20.876 | 70.00th=[20055], 80.00th=[34866], 90.00th=[50070], 95.00th=[55313], 00:19:20.876 | 99.00th=[77071], 99.50th=[79168], 99.90th=[82314], 99.95th=[82314], 00:19:20.876 | 99.99th=[82314] 00:19:20.876 write: IOPS=2939, BW=11.5MiB/s (12.0MB/s)(12.0MiB/1045msec); 0 zone resets 00:19:20.876 slat (usec): min=3, max=15083, avg=166.88, stdev=965.92 00:19:20.876 clat (usec): min=2886, max=81848, avg=22997.34, stdev=10675.56 00:19:20.876 lat (usec): min=2894, max=81856, avg=23164.22, stdev=10731.05 00:19:20.876 clat percentiles (usec): 00:19:20.876 | 1.00th=[ 7242], 5.00th=[10552], 10.00th=[11731], 20.00th=[12911], 00:19:20.876 | 30.00th=[13698], 40.00th=[14877], 50.00th=[24511], 60.00th=[26870], 00:19:20.876 | 70.00th=[29492], 80.00th=[31327], 90.00th=[35914], 95.00th=[43254], 00:19:20.876 | 99.00th=[51119], 99.50th=[54264], 99.90th=[54264], 99.95th=[54264], 00:19:20.876 | 99.99th=[82314] 00:19:20.876 bw ( KiB/s): min=10992, max=13568, per=18.36%, avg=12280.00, stdev=1821.51, samples=2 00:19:20.876 iops : min= 2748, max= 3392, avg=3070.00, stdev=455.38, samples=2 00:19:20.876 lat (msec) : 4=0.10%, 10=3.28%, 20=52.41%, 50=38.99%, 100=5.21% 00:19:20.876 cpu : usr=1.72%, sys=3.64%, ctx=242, majf=0, minf=1 00:19:20.876 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:20.876 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:20.876 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:20.876 issued rwts: total=2686,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:20.876 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:20.876 job3: (groupid=0, jobs=1): err= 0: pid=2435595: Wed Oct 30 16:03:10 2024 00:19:20.876 read: IOPS=3466, BW=13.5MiB/s (14.2MB/s)(14.2MiB/1046msec) 00:19:20.876 slat (usec): min=2, max=24435, avg=146.91, stdev=1042.45 00:19:20.876 clat (usec): min=1005, max=79256, avg=18245.11, stdev=14504.46 00:19:20.876 lat (usec): min=1013, max=79273, avg=18392.01, stdev=14603.97 00:19:20.876 clat percentiles (usec): 00:19:20.876 | 1.00th=[ 1205], 5.00th=[ 7242], 10.00th=[ 8848], 20.00th=[10028], 00:19:20.876 | 30.00th=[11076], 40.00th=[11600], 50.00th=[12256], 60.00th=[14746], 00:19:20.876 | 70.00th=[16909], 80.00th=[21890], 90.00th=[43254], 95.00th=[55313], 00:19:20.876 | 99.00th=[70779], 99.50th=[70779], 99.90th=[71828], 99.95th=[74974], 00:19:20.876 | 99.99th=[79168] 00:19:20.876 write: IOPS=3915, BW=15.3MiB/s (16.0MB/s)(16.0MiB/1046msec); 0 zone resets 00:19:20.876 slat (usec): min=4, max=10809, avg=103.15, stdev=521.38 00:19:20.876 clat (usec): min=1117, max=81160, avg=16240.28, stdev=11891.94 00:19:20.876 lat (usec): min=1136, max=81208, avg=16343.43, stdev=11932.66 00:19:20.876 clat percentiles (usec): 00:19:20.876 | 1.00th=[ 3818], 5.00th=[ 6456], 10.00th=[ 8356], 20.00th=[11731], 00:19:20.876 | 30.00th=[11994], 40.00th=[12518], 50.00th=[12649], 60.00th=[12911], 00:19:20.876 | 70.00th=[13304], 80.00th=[17433], 90.00th=[25822], 95.00th=[34866], 00:19:20.876 | 99.00th=[72877], 99.50th=[78119], 99.90th=[81265], 99.95th=[81265], 00:19:20.876 | 99.99th=[81265] 00:19:20.876 bw ( KiB/s): min=10144, max=21936, per=23.98%, avg=16040.00, stdev=8338.20, samples=2 00:19:20.876 iops : min= 2536, max= 5484, avg=4010.00, stdev=2084.55, samples=2 00:19:20.876 lat (msec) : 2=0.75%, 4=1.09%, 10=13.44%, 20=62.77%, 50=15.88% 00:19:20.876 lat (msec) : 100=6.07% 00:19:20.876 cpu : usr=3.25%, sys=6.60%, ctx=483, majf=0, minf=1 00:19:20.876 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:20.876 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:20.876 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:20.876 issued rwts: total=3626,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:20.876 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:20.876 00:19:20.876 Run status group 0 (all jobs): 00:19:20.876 READ: bw=59.9MiB/s (62.8MB/s), 10.0MiB/s-20.0MiB/s (10.5MB/s-20.9MB/s), io=62.7MiB (65.7MB), run=1001-1046msec 00:19:20.876 WRITE: bw=65.3MiB/s (68.5MB/s), 11.5MiB/s-20.9MiB/s (12.0MB/s-21.9MB/s), io=68.3MiB (71.7MB), run=1001-1046msec 00:19:20.876 00:19:20.876 Disk stats (read/write): 00:19:20.876 nvme0n1: ios=4147/4563, merge=0/0, ticks=19282/21173, in_queue=40455, util=97.39% 00:19:20.876 nvme0n2: ios=3626/4078, merge=0/0, ticks=23494/29542, in_queue=53036, util=97.26% 00:19:20.876 nvme0n3: ios=2340/2560, merge=0/0, ticks=28407/31038, in_queue=59445, util=96.77% 00:19:20.876 nvme0n4: ios=3562/3584, merge=0/0, ticks=41271/42114, in_queue=83385, util=97.06% 00:19:20.876 16:03:10 -- target/fio.sh@55 -- # sync 00:19:20.876 16:03:10 -- target/fio.sh@59 -- # fio_pid=2435737 00:19:20.876 16:03:10 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:20.876 16:03:10 -- target/fio.sh@61 -- # sleep 3 00:19:20.876 [global] 00:19:20.876 thread=1 00:19:20.876 invalidate=1 00:19:20.876 rw=read 00:19:20.876 time_based=1 00:19:20.876 runtime=10 00:19:20.876 ioengine=libaio 00:19:20.876 direct=1 00:19:20.876 bs=4096 00:19:20.876 iodepth=1 00:19:20.876 norandommap=1 00:19:20.876 numjobs=1 00:19:20.876 00:19:20.876 [job0] 00:19:20.876 filename=/dev/nvme0n1 00:19:20.876 [job1] 00:19:20.876 filename=/dev/nvme0n2 00:19:20.876 [job2] 00:19:20.876 filename=/dev/nvme0n3 00:19:20.876 [job3] 00:19:20.876 filename=/dev/nvme0n4 00:19:20.876 Could not set queue depth (nvme0n1) 00:19:20.876 Could not set queue depth (nvme0n2) 00:19:20.876 Could not set queue depth (nvme0n3) 00:19:20.876 Could not set queue depth (nvme0n4) 00:19:21.135 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:21.135 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:21.135 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:21.135 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:21.135 fio-3.35 00:19:21.135 Starting 4 threads 00:19:24.428 16:03:13 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:24.428 16:03:13 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:24.428 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=5562368, buflen=4096 00:19:24.428 fio: pid=2435828, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:24.428 16:03:14 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:24.428 16:03:14 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:24.428 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=425984, buflen=4096 00:19:24.428 fio: pid=2435827, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:24.687 16:03:14 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:24.687 16:03:14 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:24.687 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=52940800, buflen=4096 00:19:24.687 fio: pid=2435825, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:24.946 16:03:14 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:24.946 16:03:14 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:24.946 fio: io_u error on file /dev/nvme0n2: Input/output error: read offset=372736, buflen=4096 00:19:24.946 fio: pid=2435826, err=5/file:io_u.c:1889, func=io_u error, error=Input/output error 00:19:24.946 00:19:24.946 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2435825: Wed Oct 30 16:03:14 2024 00:19:24.946 read: IOPS=3740, BW=14.6MiB/s (15.3MB/s)(50.5MiB/3456msec) 00:19:24.946 slat (usec): min=4, max=11725, avg=11.73, stdev=134.24 00:19:24.946 clat (usec): min=160, max=42365, avg=250.82, stdev=1021.45 00:19:24.946 lat (usec): min=165, max=42371, avg=262.55, stdev=1030.48 00:19:24.946 clat percentiles (usec): 00:19:24.946 | 1.00th=[ 174], 5.00th=[ 182], 10.00th=[ 186], 20.00th=[ 194], 00:19:24.946 | 30.00th=[ 202], 40.00th=[ 208], 50.00th=[ 221], 60.00th=[ 235], 00:19:24.946 | 70.00th=[ 243], 80.00th=[ 251], 90.00th=[ 260], 95.00th=[ 273], 00:19:24.946 | 99.00th=[ 392], 99.50th=[ 416], 99.90th=[ 506], 99.95th=[41157], 00:19:24.946 | 99.99th=[41681] 00:19:24.946 bw ( KiB/s): min=11920, max=19560, per=100.00%, avg=16008.00, stdev=2454.01, samples=6 00:19:24.946 iops : min= 2980, max= 4890, avg=4002.00, stdev=613.50, samples=6 00:19:24.946 lat (usec) : 250=80.21%, 500=19.67%, 750=0.05% 00:19:24.946 lat (msec) : 50=0.06% 00:19:24.946 cpu : usr=2.05%, sys=5.88%, ctx=12929, majf=0, minf=1 00:19:24.946 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:24.946 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.946 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.946 issued rwts: total=12926,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:24.946 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:24.946 job1: (groupid=0, jobs=1): err= 5 (file:io_u.c:1889, func=io_u error, error=Input/output error): pid=2435826: Wed Oct 30 16:03:14 2024 00:19:24.946 read: IOPS=24, BW=98.0KiB/s (100kB/s)(364KiB/3715msec) 00:19:24.946 slat (usec): min=7, max=16922, avg=382.49, stdev=2055.34 00:19:24.946 clat (usec): min=232, max=42121, avg=40423.07, stdev=7464.47 00:19:24.946 lat (usec): min=245, max=59018, avg=40735.86, stdev=7767.88 00:19:24.946 clat percentiles (usec): 00:19:24.946 | 1.00th=[ 233], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:24.946 | 30.00th=[41681], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:19:24.946 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:24.946 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:24.946 | 99.99th=[42206] 00:19:24.946 bw ( KiB/s): min= 92, max= 104, per=0.62%, avg=97.71, stdev= 4.54, samples=7 00:19:24.946 iops : min= 23, max= 26, avg=24.43, stdev= 1.13, samples=7 00:19:24.946 lat (usec) : 250=1.09%, 500=2.17% 00:19:24.946 lat (msec) : 50=95.65% 00:19:24.946 cpu : usr=0.00%, sys=0.27%, ctx=94, majf=0, minf=2 00:19:24.946 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:24.946 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.946 complete : 0=1.1%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.946 issued rwts: total=92,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:24.946 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:24.946 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2435827: Wed Oct 30 16:03:14 2024 00:19:24.946 read: IOPS=33, BW=132KiB/s (135kB/s)(416KiB/3151msec) 00:19:24.946 slat (nsec): min=8021, max=45437, avg=17489.55, stdev=8668.07 00:19:24.946 clat (usec): min=268, max=42122, avg=30050.02, stdev=18595.56 00:19:24.946 lat (usec): min=276, max=42135, avg=30067.55, stdev=18599.58 00:19:24.946 clat percentiles (usec): 00:19:24.946 | 1.00th=[ 269], 5.00th=[ 273], 10.00th=[ 285], 20.00th=[ 302], 00:19:24.946 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:19:24.946 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:24.946 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:24.946 | 99.99th=[42206] 00:19:24.946 bw ( KiB/s): min= 96, max= 312, per=0.85%, avg=133.33, stdev=87.59, samples=6 00:19:24.946 iops : min= 24, max= 78, avg=33.33, stdev=21.90, samples=6 00:19:24.946 lat (usec) : 500=27.62% 00:19:24.946 lat (msec) : 50=71.43% 00:19:24.946 cpu : usr=0.10%, sys=0.00%, ctx=105, majf=0, minf=2 00:19:24.946 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:24.946 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.946 complete : 0=0.9%, 4=99.1%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.946 issued rwts: total=105,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:24.946 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:24.946 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2435828: Wed Oct 30 16:03:14 2024 00:19:24.946 read: IOPS=469, BW=1877KiB/s (1922kB/s)(5432KiB/2894msec) 00:19:24.946 slat (nsec): min=8118, max=53244, avg=15511.58, stdev=5505.14 00:19:24.946 clat (usec): min=189, max=42069, avg=2094.48, stdev=8544.07 00:19:24.946 lat (usec): min=198, max=42088, avg=2109.98, stdev=8545.01 00:19:24.946 clat percentiles (usec): 00:19:24.946 | 1.00th=[ 200], 5.00th=[ 208], 10.00th=[ 215], 20.00th=[ 223], 00:19:24.946 | 30.00th=[ 233], 40.00th=[ 237], 50.00th=[ 241], 60.00th=[ 245], 00:19:24.946 | 70.00th=[ 251], 80.00th=[ 258], 90.00th=[ 277], 95.00th=[ 383], 00:19:24.946 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:24.946 | 99.99th=[42206] 00:19:24.946 bw ( KiB/s): min= 96, max=10216, per=13.83%, avg=2156.80, stdev=4505.55, samples=5 00:19:24.946 iops : min= 24, max= 2554, avg=539.20, stdev=1126.39, samples=5 00:19:24.946 lat (usec) : 250=68.21%, 500=26.86%, 750=0.29%, 1000=0.07% 00:19:24.946 lat (msec) : 50=4.49% 00:19:24.946 cpu : usr=0.45%, sys=1.11%, ctx=1360, majf=0, minf=1 00:19:24.946 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:24.946 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.946 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:24.946 issued rwts: total=1359,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:24.946 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:24.946 00:19:24.946 Run status group 0 (all jobs): 00:19:24.946 READ: bw=15.2MiB/s (16.0MB/s), 98.0KiB/s-14.6MiB/s (100kB/s-15.3MB/s), io=56.6MiB (59.3MB), run=2894-3715msec 00:19:24.946 00:19:24.946 Disk stats (read/write): 00:19:24.946 nvme0n1: ios=12923/0, merge=0/0, ticks=3024/0, in_queue=3024, util=95.51% 00:19:24.946 nvme0n2: ios=88/0, merge=0/0, ticks=3556/0, in_queue=3556, util=96.20% 00:19:24.946 nvme0n3: ios=103/0, merge=0/0, ticks=3086/0, in_queue=3086, util=96.82% 00:19:24.946 nvme0n4: ios=1407/0, merge=0/0, ticks=2980/0, in_queue=2980, util=99.66% 00:19:25.206 16:03:14 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:25.206 16:03:14 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:25.464 16:03:15 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:25.464 16:03:15 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:25.723 16:03:15 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:25.723 16:03:15 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:25.981 16:03:15 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:25.981 16:03:15 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:26.240 16:03:15 -- target/fio.sh@69 -- # fio_status=0 00:19:26.240 16:03:15 -- target/fio.sh@70 -- # wait 2435737 00:19:26.240 16:03:15 -- target/fio.sh@70 -- # fio_status=4 00:19:26.240 16:03:15 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:26.240 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:26.240 16:03:16 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:26.240 16:03:16 -- common/autotest_common.sh@1198 -- # local i=0 00:19:26.240 16:03:16 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:26.240 16:03:16 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:26.240 16:03:16 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:26.240 16:03:16 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:26.499 16:03:16 -- common/autotest_common.sh@1210 -- # return 0 00:19:26.499 16:03:16 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:26.499 16:03:16 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:26.499 nvmf hotplug test: fio failed as expected 00:19:26.499 16:03:16 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:26.499 16:03:16 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:26.499 16:03:16 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:26.758 16:03:16 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:26.758 16:03:16 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:26.758 16:03:16 -- target/fio.sh@91 -- # nvmftestfini 00:19:26.758 16:03:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:26.758 16:03:16 -- nvmf/common.sh@116 -- # sync 00:19:26.758 16:03:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:26.758 16:03:16 -- nvmf/common.sh@119 -- # set +e 00:19:26.758 16:03:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:26.758 16:03:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:26.758 rmmod nvme_tcp 00:19:26.758 rmmod nvme_fabrics 00:19:26.758 rmmod nvme_keyring 00:19:26.758 16:03:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:26.758 16:03:16 -- nvmf/common.sh@123 -- # set -e 00:19:26.758 16:03:16 -- nvmf/common.sh@124 -- # return 0 00:19:26.758 16:03:16 -- nvmf/common.sh@477 -- # '[' -n 2433031 ']' 00:19:26.758 16:03:16 -- nvmf/common.sh@478 -- # killprocess 2433031 00:19:26.758 16:03:16 -- common/autotest_common.sh@926 -- # '[' -z 2433031 ']' 00:19:26.758 16:03:16 -- common/autotest_common.sh@930 -- # kill -0 2433031 00:19:26.758 16:03:16 -- common/autotest_common.sh@931 -- # uname 00:19:26.758 16:03:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:26.759 16:03:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2433031 00:19:26.759 16:03:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:19:26.759 16:03:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:19:26.759 16:03:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2433031' 00:19:26.759 killing process with pid 2433031 00:19:26.759 16:03:16 -- common/autotest_common.sh@945 -- # kill 2433031 00:19:26.759 16:03:16 -- common/autotest_common.sh@950 -- # wait 2433031 00:19:27.017 16:03:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:27.017 16:03:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:27.017 16:03:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:27.017 16:03:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:27.017 16:03:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:27.017 16:03:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:27.017 16:03:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:27.017 16:03:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:28.921 16:03:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:28.921 00:19:28.921 real 0m24.369s 00:19:28.921 user 1m26.570s 00:19:28.921 sys 0m6.315s 00:19:28.921 16:03:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:28.921 16:03:18 -- common/autotest_common.sh@10 -- # set +x 00:19:28.921 ************************************ 00:19:28.921 END TEST nvmf_fio_target 00:19:28.921 ************************************ 00:19:28.921 16:03:18 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:28.921 16:03:18 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:28.921 16:03:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:28.921 16:03:18 -- common/autotest_common.sh@10 -- # set +x 00:19:28.921 ************************************ 00:19:28.921 START TEST nvmf_bdevio 00:19:28.921 ************************************ 00:19:28.921 16:03:18 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:29.180 * Looking for test storage... 00:19:29.180 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:29.180 16:03:18 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:29.180 16:03:18 -- nvmf/common.sh@7 -- # uname -s 00:19:29.180 16:03:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:29.180 16:03:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:29.180 16:03:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:29.180 16:03:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:29.180 16:03:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:29.180 16:03:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:29.180 16:03:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:29.180 16:03:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:29.180 16:03:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:29.180 16:03:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:29.180 16:03:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:29.180 16:03:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:29.180 16:03:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:29.180 16:03:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:29.180 16:03:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:29.180 16:03:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:29.180 16:03:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:29.180 16:03:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:29.180 16:03:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:29.180 16:03:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:29.180 16:03:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:29.180 16:03:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:29.180 16:03:18 -- paths/export.sh@5 -- # export PATH 00:19:29.180 16:03:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:29.180 16:03:18 -- nvmf/common.sh@46 -- # : 0 00:19:29.180 16:03:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:29.180 16:03:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:29.180 16:03:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:29.180 16:03:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:29.180 16:03:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:29.180 16:03:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:29.180 16:03:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:29.180 16:03:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:29.180 16:03:18 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:29.180 16:03:18 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:29.180 16:03:18 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:29.180 16:03:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:29.180 16:03:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:29.180 16:03:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:29.180 16:03:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:29.180 16:03:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:29.180 16:03:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:29.180 16:03:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:29.180 16:03:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:29.180 16:03:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:29.180 16:03:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:29.180 16:03:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:29.180 16:03:18 -- common/autotest_common.sh@10 -- # set +x 00:19:31.081 16:03:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:31.081 16:03:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:31.081 16:03:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:31.081 16:03:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:31.081 16:03:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:31.081 16:03:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:31.081 16:03:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:31.081 16:03:20 -- nvmf/common.sh@294 -- # net_devs=() 00:19:31.081 16:03:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:31.081 16:03:20 -- nvmf/common.sh@295 -- # e810=() 00:19:31.081 16:03:20 -- nvmf/common.sh@295 -- # local -ga e810 00:19:31.081 16:03:20 -- nvmf/common.sh@296 -- # x722=() 00:19:31.081 16:03:20 -- nvmf/common.sh@296 -- # local -ga x722 00:19:31.081 16:03:20 -- nvmf/common.sh@297 -- # mlx=() 00:19:31.081 16:03:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:31.081 16:03:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:31.081 16:03:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:31.081 16:03:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:31.081 16:03:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:31.081 16:03:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:31.081 16:03:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:31.081 16:03:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:31.081 16:03:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:31.081 16:03:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:31.081 16:03:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:31.081 16:03:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:31.081 16:03:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:31.081 16:03:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:31.081 16:03:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:31.081 16:03:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:31.081 16:03:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:31.081 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:31.081 16:03:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:31.081 16:03:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:31.081 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:31.081 16:03:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:31.081 16:03:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:31.081 16:03:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:31.081 16:03:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:31.081 16:03:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:31.081 16:03:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:31.081 16:03:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:31.081 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:31.081 16:03:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:31.081 16:03:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:31.081 16:03:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:31.081 16:03:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:31.081 16:03:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:31.081 16:03:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:31.081 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:31.081 16:03:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:31.081 16:03:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:31.081 16:03:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:31.082 16:03:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:31.082 16:03:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:31.082 16:03:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:31.082 16:03:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:31.082 16:03:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:31.082 16:03:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:31.082 16:03:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:31.082 16:03:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:31.082 16:03:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:31.082 16:03:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:31.082 16:03:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:31.082 16:03:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:31.082 16:03:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:31.082 16:03:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:31.082 16:03:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:31.082 16:03:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:31.082 16:03:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:31.082 16:03:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:31.082 16:03:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:31.082 16:03:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:31.341 16:03:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:31.341 16:03:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:31.341 16:03:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:31.341 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:31.341 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.372 ms 00:19:31.341 00:19:31.341 --- 10.0.0.2 ping statistics --- 00:19:31.341 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:31.341 rtt min/avg/max/mdev = 0.372/0.372/0.372/0.000 ms 00:19:31.341 16:03:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:31.341 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:31.341 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:19:31.341 00:19:31.341 --- 10.0.0.1 ping statistics --- 00:19:31.341 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:31.341 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:19:31.341 16:03:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:31.341 16:03:21 -- nvmf/common.sh@410 -- # return 0 00:19:31.341 16:03:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:31.341 16:03:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:31.341 16:03:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:31.341 16:03:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:31.341 16:03:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:31.341 16:03:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:31.341 16:03:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:31.341 16:03:21 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:31.341 16:03:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:31.341 16:03:21 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:31.341 16:03:21 -- common/autotest_common.sh@10 -- # set +x 00:19:31.341 16:03:21 -- nvmf/common.sh@469 -- # nvmfpid=2438487 00:19:31.341 16:03:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:31.341 16:03:21 -- nvmf/common.sh@470 -- # waitforlisten 2438487 00:19:31.341 16:03:21 -- common/autotest_common.sh@819 -- # '[' -z 2438487 ']' 00:19:31.341 16:03:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:31.341 16:03:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:31.341 16:03:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:31.341 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:31.341 16:03:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:31.341 16:03:21 -- common/autotest_common.sh@10 -- # set +x 00:19:31.341 [2024-10-30 16:03:21.078485] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:19:31.341 [2024-10-30 16:03:21.078580] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:31.341 EAL: No free 2048 kB hugepages reported on node 1 00:19:31.341 [2024-10-30 16:03:21.144187] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:31.601 [2024-10-30 16:03:21.234646] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:31.601 [2024-10-30 16:03:21.234802] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:31.601 [2024-10-30 16:03:21.234820] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:31.601 [2024-10-30 16:03:21.234833] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:31.601 [2024-10-30 16:03:21.234917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:31.601 [2024-10-30 16:03:21.234982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:31.601 [2024-10-30 16:03:21.235034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:31.601 [2024-10-30 16:03:21.235036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:32.538 16:03:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:32.538 16:03:22 -- common/autotest_common.sh@852 -- # return 0 00:19:32.538 16:03:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:32.538 16:03:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:32.538 16:03:22 -- common/autotest_common.sh@10 -- # set +x 00:19:32.538 16:03:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:32.538 16:03:22 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:32.538 16:03:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.538 16:03:22 -- common/autotest_common.sh@10 -- # set +x 00:19:32.538 [2024-10-30 16:03:22.082933] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:32.538 16:03:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.538 16:03:22 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:32.538 16:03:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.538 16:03:22 -- common/autotest_common.sh@10 -- # set +x 00:19:32.538 Malloc0 00:19:32.538 16:03:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.538 16:03:22 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:32.538 16:03:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.538 16:03:22 -- common/autotest_common.sh@10 -- # set +x 00:19:32.538 16:03:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.538 16:03:22 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:32.538 16:03:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.538 16:03:22 -- common/autotest_common.sh@10 -- # set +x 00:19:32.538 16:03:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.538 16:03:22 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:32.538 16:03:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:32.538 16:03:22 -- common/autotest_common.sh@10 -- # set +x 00:19:32.538 [2024-10-30 16:03:22.133916] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:32.538 16:03:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:32.538 16:03:22 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:32.538 16:03:22 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:32.538 16:03:22 -- nvmf/common.sh@520 -- # config=() 00:19:32.538 16:03:22 -- nvmf/common.sh@520 -- # local subsystem config 00:19:32.538 16:03:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:32.538 16:03:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:32.538 { 00:19:32.538 "params": { 00:19:32.538 "name": "Nvme$subsystem", 00:19:32.538 "trtype": "$TEST_TRANSPORT", 00:19:32.538 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:32.538 "adrfam": "ipv4", 00:19:32.538 "trsvcid": "$NVMF_PORT", 00:19:32.538 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:32.538 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:32.538 "hdgst": ${hdgst:-false}, 00:19:32.538 "ddgst": ${ddgst:-false} 00:19:32.538 }, 00:19:32.538 "method": "bdev_nvme_attach_controller" 00:19:32.538 } 00:19:32.538 EOF 00:19:32.538 )") 00:19:32.538 16:03:22 -- nvmf/common.sh@542 -- # cat 00:19:32.538 16:03:22 -- nvmf/common.sh@544 -- # jq . 00:19:32.538 16:03:22 -- nvmf/common.sh@545 -- # IFS=, 00:19:32.538 16:03:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:32.538 "params": { 00:19:32.538 "name": "Nvme1", 00:19:32.538 "trtype": "tcp", 00:19:32.538 "traddr": "10.0.0.2", 00:19:32.538 "adrfam": "ipv4", 00:19:32.538 "trsvcid": "4420", 00:19:32.538 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:32.538 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:32.538 "hdgst": false, 00:19:32.538 "ddgst": false 00:19:32.538 }, 00:19:32.538 "method": "bdev_nvme_attach_controller" 00:19:32.538 }' 00:19:32.538 [2024-10-30 16:03:22.174900] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:19:32.538 [2024-10-30 16:03:22.174985] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2438648 ] 00:19:32.538 EAL: No free 2048 kB hugepages reported on node 1 00:19:32.538 [2024-10-30 16:03:22.236764] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:32.538 [2024-10-30 16:03:22.323291] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:32.538 [2024-10-30 16:03:22.323320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:32.538 [2024-10-30 16:03:22.323323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:32.798 [2024-10-30 16:03:22.495111] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:32.798 [2024-10-30 16:03:22.495168] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:32.798 I/O targets: 00:19:32.798 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:32.798 00:19:32.798 00:19:32.798 CUnit - A unit testing framework for C - Version 2.1-3 00:19:32.798 http://cunit.sourceforge.net/ 00:19:32.798 00:19:32.798 00:19:32.798 Suite: bdevio tests on: Nvme1n1 00:19:32.798 Test: blockdev write read block ...passed 00:19:32.798 Test: blockdev write zeroes read block ...passed 00:19:32.798 Test: blockdev write zeroes read no split ...passed 00:19:32.798 Test: blockdev write zeroes read split ...passed 00:19:32.798 Test: blockdev write zeroes read split partial ...passed 00:19:32.798 Test: blockdev reset ...[2024-10-30 16:03:22.650999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:32.798 [2024-10-30 16:03:22.651108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x159e670 (9): Bad file descriptor 00:19:32.798 [2024-10-30 16:03:22.665524] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:32.798 passed 00:19:32.798 Test: blockdev write read 8 blocks ...passed 00:19:32.798 Test: blockdev write read size > 128k ...passed 00:19:32.798 Test: blockdev write read invalid size ...passed 00:19:33.059 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:33.059 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:33.059 Test: blockdev write read max offset ...passed 00:19:33.059 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:33.059 Test: blockdev writev readv 8 blocks ...passed 00:19:33.059 Test: blockdev writev readv 30 x 1block ...passed 00:19:33.059 Test: blockdev writev readv block ...passed 00:19:33.059 Test: blockdev writev readv size > 128k ...passed 00:19:33.059 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:33.059 Test: blockdev comparev and writev ...[2024-10-30 16:03:22.836365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:33.059 [2024-10-30 16:03:22.836403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:33.059 [2024-10-30 16:03:22.836428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:33.059 [2024-10-30 16:03:22.836445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:33.059 [2024-10-30 16:03:22.836776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:33.059 [2024-10-30 16:03:22.836802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:33.059 [2024-10-30 16:03:22.836824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:33.059 [2024-10-30 16:03:22.836849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:33.059 [2024-10-30 16:03:22.837173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:33.059 [2024-10-30 16:03:22.837198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:33.059 [2024-10-30 16:03:22.837219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:33.059 [2024-10-30 16:03:22.837235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:33.059 [2024-10-30 16:03:22.837585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:33.059 [2024-10-30 16:03:22.837611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:33.059 [2024-10-30 16:03:22.837632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:33.059 [2024-10-30 16:03:22.837647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:33.059 passed 00:19:33.059 Test: blockdev nvme passthru rw ...passed 00:19:33.059 Test: blockdev nvme passthru vendor specific ...[2024-10-30 16:03:22.921506] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:33.059 [2024-10-30 16:03:22.921535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:33.059 [2024-10-30 16:03:22.921672] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:33.059 [2024-10-30 16:03:22.921695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:33.059 [2024-10-30 16:03:22.921837] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:33.059 [2024-10-30 16:03:22.921860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:33.059 [2024-10-30 16:03:22.921994] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:33.059 [2024-10-30 16:03:22.922017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:33.059 passed 00:19:33.318 Test: blockdev nvme admin passthru ...passed 00:19:33.318 Test: blockdev copy ...passed 00:19:33.318 00:19:33.318 Run Summary: Type Total Ran Passed Failed Inactive 00:19:33.318 suites 1 1 n/a 0 0 00:19:33.318 tests 23 23 23 0 0 00:19:33.318 asserts 152 152 152 0 n/a 00:19:33.318 00:19:33.318 Elapsed time = 0.977 seconds 00:19:33.318 16:03:23 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:33.318 16:03:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:33.318 16:03:23 -- common/autotest_common.sh@10 -- # set +x 00:19:33.318 16:03:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:33.318 16:03:23 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:33.318 16:03:23 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:33.318 16:03:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:33.318 16:03:23 -- nvmf/common.sh@116 -- # sync 00:19:33.318 16:03:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:33.318 16:03:23 -- nvmf/common.sh@119 -- # set +e 00:19:33.318 16:03:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:33.318 16:03:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:33.318 rmmod nvme_tcp 00:19:33.576 rmmod nvme_fabrics 00:19:33.576 rmmod nvme_keyring 00:19:33.576 16:03:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:33.576 16:03:23 -- nvmf/common.sh@123 -- # set -e 00:19:33.576 16:03:23 -- nvmf/common.sh@124 -- # return 0 00:19:33.576 16:03:23 -- nvmf/common.sh@477 -- # '[' -n 2438487 ']' 00:19:33.576 16:03:23 -- nvmf/common.sh@478 -- # killprocess 2438487 00:19:33.576 16:03:23 -- common/autotest_common.sh@926 -- # '[' -z 2438487 ']' 00:19:33.577 16:03:23 -- common/autotest_common.sh@930 -- # kill -0 2438487 00:19:33.577 16:03:23 -- common/autotest_common.sh@931 -- # uname 00:19:33.577 16:03:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:33.577 16:03:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2438487 00:19:33.577 16:03:23 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:19:33.577 16:03:23 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:19:33.577 16:03:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2438487' 00:19:33.577 killing process with pid 2438487 00:19:33.577 16:03:23 -- common/autotest_common.sh@945 -- # kill 2438487 00:19:33.577 16:03:23 -- common/autotest_common.sh@950 -- # wait 2438487 00:19:33.835 16:03:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:33.835 16:03:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:33.835 16:03:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:33.835 16:03:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:33.835 16:03:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:33.835 16:03:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:33.835 16:03:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:33.835 16:03:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:35.746 16:03:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:35.746 00:19:35.746 real 0m6.786s 00:19:35.746 user 0m11.959s 00:19:35.746 sys 0m2.061s 00:19:35.746 16:03:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:35.746 16:03:25 -- common/autotest_common.sh@10 -- # set +x 00:19:35.746 ************************************ 00:19:35.746 END TEST nvmf_bdevio 00:19:35.746 ************************************ 00:19:35.746 16:03:25 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:19:35.746 16:03:25 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:35.746 16:03:25 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:19:35.746 16:03:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:35.746 16:03:25 -- common/autotest_common.sh@10 -- # set +x 00:19:35.746 ************************************ 00:19:35.746 START TEST nvmf_bdevio_no_huge 00:19:35.746 ************************************ 00:19:35.746 16:03:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:36.010 * Looking for test storage... 00:19:36.010 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:36.010 16:03:25 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:36.010 16:03:25 -- nvmf/common.sh@7 -- # uname -s 00:19:36.010 16:03:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:36.010 16:03:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:36.010 16:03:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:36.010 16:03:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:36.010 16:03:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:36.010 16:03:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:36.010 16:03:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:36.010 16:03:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:36.010 16:03:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:36.010 16:03:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:36.010 16:03:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:36.010 16:03:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:36.010 16:03:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:36.010 16:03:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:36.010 16:03:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:36.010 16:03:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:36.010 16:03:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:36.010 16:03:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:36.010 16:03:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:36.010 16:03:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:36.010 16:03:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:36.010 16:03:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:36.010 16:03:25 -- paths/export.sh@5 -- # export PATH 00:19:36.011 16:03:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:36.011 16:03:25 -- nvmf/common.sh@46 -- # : 0 00:19:36.011 16:03:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:36.011 16:03:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:36.011 16:03:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:36.011 16:03:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:36.011 16:03:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:36.011 16:03:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:36.011 16:03:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:36.011 16:03:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:36.011 16:03:25 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:36.011 16:03:25 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:36.011 16:03:25 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:36.011 16:03:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:36.011 16:03:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:36.011 16:03:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:36.011 16:03:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:36.011 16:03:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:36.011 16:03:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:36.011 16:03:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:36.011 16:03:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:36.011 16:03:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:36.011 16:03:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:36.011 16:03:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:36.011 16:03:25 -- common/autotest_common.sh@10 -- # set +x 00:19:38.010 16:03:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:38.010 16:03:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:38.010 16:03:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:38.010 16:03:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:38.010 16:03:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:38.010 16:03:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:38.010 16:03:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:38.010 16:03:27 -- nvmf/common.sh@294 -- # net_devs=() 00:19:38.010 16:03:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:38.010 16:03:27 -- nvmf/common.sh@295 -- # e810=() 00:19:38.010 16:03:27 -- nvmf/common.sh@295 -- # local -ga e810 00:19:38.010 16:03:27 -- nvmf/common.sh@296 -- # x722=() 00:19:38.010 16:03:27 -- nvmf/common.sh@296 -- # local -ga x722 00:19:38.010 16:03:27 -- nvmf/common.sh@297 -- # mlx=() 00:19:38.010 16:03:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:38.010 16:03:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:38.010 16:03:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:38.010 16:03:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:38.010 16:03:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:38.010 16:03:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:38.010 16:03:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:38.010 16:03:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:38.010 16:03:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:38.010 16:03:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:38.010 16:03:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:38.010 16:03:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:38.010 16:03:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:38.010 16:03:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:38.010 16:03:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:38.010 16:03:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:38.010 16:03:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:38.010 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:38.010 16:03:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:38.010 16:03:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:38.010 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:38.010 16:03:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:38.010 16:03:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:38.010 16:03:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:38.010 16:03:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:38.010 16:03:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:38.010 16:03:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:38.010 16:03:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:38.010 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:38.010 16:03:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:38.010 16:03:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:38.010 16:03:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:38.011 16:03:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:38.011 16:03:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:38.011 16:03:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:38.011 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:38.011 16:03:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:38.011 16:03:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:38.011 16:03:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:38.011 16:03:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:38.011 16:03:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:38.011 16:03:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:38.011 16:03:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:38.011 16:03:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:38.011 16:03:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:38.011 16:03:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:38.011 16:03:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:38.011 16:03:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:38.011 16:03:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:38.011 16:03:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:38.011 16:03:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:38.011 16:03:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:38.011 16:03:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:38.011 16:03:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:38.011 16:03:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:38.011 16:03:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:38.011 16:03:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:38.011 16:03:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:38.011 16:03:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:38.011 16:03:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:38.011 16:03:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:38.011 16:03:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:38.011 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:38.011 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.335 ms 00:19:38.011 00:19:38.011 --- 10.0.0.2 ping statistics --- 00:19:38.011 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:38.011 rtt min/avg/max/mdev = 0.335/0.335/0.335/0.000 ms 00:19:38.011 16:03:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:38.011 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:38.011 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.145 ms 00:19:38.011 00:19:38.011 --- 10.0.0.1 ping statistics --- 00:19:38.011 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:38.011 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:19:38.011 16:03:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:38.011 16:03:27 -- nvmf/common.sh@410 -- # return 0 00:19:38.011 16:03:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:38.011 16:03:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:38.011 16:03:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:38.011 16:03:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:38.011 16:03:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:38.011 16:03:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:38.011 16:03:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:38.011 16:03:27 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:38.011 16:03:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:38.011 16:03:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:38.011 16:03:27 -- common/autotest_common.sh@10 -- # set +x 00:19:38.011 16:03:27 -- nvmf/common.sh@469 -- # nvmfpid=2440728 00:19:38.011 16:03:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:38.011 16:03:27 -- nvmf/common.sh@470 -- # waitforlisten 2440728 00:19:38.011 16:03:27 -- common/autotest_common.sh@819 -- # '[' -z 2440728 ']' 00:19:38.011 16:03:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:38.011 16:03:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:38.011 16:03:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:38.011 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:38.011 16:03:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:38.011 16:03:27 -- common/autotest_common.sh@10 -- # set +x 00:19:38.011 [2024-10-30 16:03:27.847229] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:19:38.011 [2024-10-30 16:03:27.847337] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:38.269 [2024-10-30 16:03:27.920741] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:38.269 [2024-10-30 16:03:28.002989] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:38.269 [2024-10-30 16:03:28.003143] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:38.269 [2024-10-30 16:03:28.003166] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:38.269 [2024-10-30 16:03:28.003179] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:38.269 [2024-10-30 16:03:28.003274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:38.269 [2024-10-30 16:03:28.003374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:38.269 [2024-10-30 16:03:28.003310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:38.269 [2024-10-30 16:03:28.003371] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:39.206 16:03:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:39.206 16:03:28 -- common/autotest_common.sh@852 -- # return 0 00:19:39.206 16:03:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:39.206 16:03:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:39.206 16:03:28 -- common/autotest_common.sh@10 -- # set +x 00:19:39.206 16:03:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:39.206 16:03:28 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:39.206 16:03:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:39.207 16:03:28 -- common/autotest_common.sh@10 -- # set +x 00:19:39.207 [2024-10-30 16:03:28.849701] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:39.207 16:03:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:39.207 16:03:28 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:39.207 16:03:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:39.207 16:03:28 -- common/autotest_common.sh@10 -- # set +x 00:19:39.207 Malloc0 00:19:39.207 16:03:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:39.207 16:03:28 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:39.207 16:03:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:39.207 16:03:28 -- common/autotest_common.sh@10 -- # set +x 00:19:39.207 16:03:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:39.207 16:03:28 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:39.207 16:03:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:39.207 16:03:28 -- common/autotest_common.sh@10 -- # set +x 00:19:39.207 16:03:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:39.207 16:03:28 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:39.207 16:03:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:39.207 16:03:28 -- common/autotest_common.sh@10 -- # set +x 00:19:39.207 [2024-10-30 16:03:28.888013] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:39.207 16:03:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:39.207 16:03:28 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:39.207 16:03:28 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:39.207 16:03:28 -- nvmf/common.sh@520 -- # config=() 00:19:39.207 16:03:28 -- nvmf/common.sh@520 -- # local subsystem config 00:19:39.207 16:03:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:39.207 16:03:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:39.207 { 00:19:39.207 "params": { 00:19:39.207 "name": "Nvme$subsystem", 00:19:39.207 "trtype": "$TEST_TRANSPORT", 00:19:39.207 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:39.207 "adrfam": "ipv4", 00:19:39.207 "trsvcid": "$NVMF_PORT", 00:19:39.207 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:39.207 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:39.207 "hdgst": ${hdgst:-false}, 00:19:39.207 "ddgst": ${ddgst:-false} 00:19:39.207 }, 00:19:39.207 "method": "bdev_nvme_attach_controller" 00:19:39.207 } 00:19:39.207 EOF 00:19:39.207 )") 00:19:39.207 16:03:28 -- nvmf/common.sh@542 -- # cat 00:19:39.207 16:03:28 -- nvmf/common.sh@544 -- # jq . 00:19:39.207 16:03:28 -- nvmf/common.sh@545 -- # IFS=, 00:19:39.207 16:03:28 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:39.207 "params": { 00:19:39.207 "name": "Nvme1", 00:19:39.207 "trtype": "tcp", 00:19:39.207 "traddr": "10.0.0.2", 00:19:39.207 "adrfam": "ipv4", 00:19:39.207 "trsvcid": "4420", 00:19:39.207 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:39.207 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:39.207 "hdgst": false, 00:19:39.207 "ddgst": false 00:19:39.207 }, 00:19:39.207 "method": "bdev_nvme_attach_controller" 00:19:39.207 }' 00:19:39.207 [2024-10-30 16:03:28.931945] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:19:39.207 [2024-10-30 16:03:28.932018] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid2440891 ] 00:19:39.207 [2024-10-30 16:03:28.991813] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:39.207 [2024-10-30 16:03:29.079313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:39.207 [2024-10-30 16:03:29.079363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:39.207 [2024-10-30 16:03:29.079367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:39.468 [2024-10-30 16:03:29.272313] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:39.468 [2024-10-30 16:03:29.272367] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:39.468 I/O targets: 00:19:39.468 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:39.468 00:19:39.468 00:19:39.468 CUnit - A unit testing framework for C - Version 2.1-3 00:19:39.468 http://cunit.sourceforge.net/ 00:19:39.468 00:19:39.468 00:19:39.468 Suite: bdevio tests on: Nvme1n1 00:19:39.468 Test: blockdev write read block ...passed 00:19:39.728 Test: blockdev write zeroes read block ...passed 00:19:39.728 Test: blockdev write zeroes read no split ...passed 00:19:39.728 Test: blockdev write zeroes read split ...passed 00:19:39.728 Test: blockdev write zeroes read split partial ...passed 00:19:39.728 Test: blockdev reset ...[2024-10-30 16:03:29.434538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:39.728 [2024-10-30 16:03:29.434646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6d7150 (9): Bad file descriptor 00:19:39.728 [2024-10-30 16:03:29.451865] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:39.728 passed 00:19:39.728 Test: blockdev write read 8 blocks ...passed 00:19:39.728 Test: blockdev write read size > 128k ...passed 00:19:39.728 Test: blockdev write read invalid size ...passed 00:19:39.728 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:39.728 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:39.728 Test: blockdev write read max offset ...passed 00:19:39.728 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:39.728 Test: blockdev writev readv 8 blocks ...passed 00:19:39.728 Test: blockdev writev readv 30 x 1block ...passed 00:19:39.986 Test: blockdev writev readv block ...passed 00:19:39.986 Test: blockdev writev readv size > 128k ...passed 00:19:39.986 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:39.986 Test: blockdev comparev and writev ...[2024-10-30 16:03:29.622423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.986 [2024-10-30 16:03:29.622460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:39.986 [2024-10-30 16:03:29.622484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.986 [2024-10-30 16:03:29.622501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:39.986 [2024-10-30 16:03:29.622815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.986 [2024-10-30 16:03:29.622842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:39.986 [2024-10-30 16:03:29.622864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.986 [2024-10-30 16:03:29.622881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:39.986 [2024-10-30 16:03:29.623186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.986 [2024-10-30 16:03:29.623211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:39.986 [2024-10-30 16:03:29.623240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.986 [2024-10-30 16:03:29.623263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:39.986 [2024-10-30 16:03:29.623575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.986 [2024-10-30 16:03:29.623600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:39.986 [2024-10-30 16:03:29.623623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.986 [2024-10-30 16:03:29.623638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:39.986 passed 00:19:39.986 Test: blockdev nvme passthru rw ...passed 00:19:39.986 Test: blockdev nvme passthru vendor specific ...[2024-10-30 16:03:29.707511] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:39.986 [2024-10-30 16:03:29.707540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:39.986 [2024-10-30 16:03:29.707686] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:39.986 [2024-10-30 16:03:29.707710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:39.986 [2024-10-30 16:03:29.707859] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:39.986 [2024-10-30 16:03:29.707883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:39.986 [2024-10-30 16:03:29.708026] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:39.986 [2024-10-30 16:03:29.708051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:39.986 passed 00:19:39.986 Test: blockdev nvme admin passthru ...passed 00:19:39.986 Test: blockdev copy ...passed 00:19:39.986 00:19:39.986 Run Summary: Type Total Ran Passed Failed Inactive 00:19:39.986 suites 1 1 n/a 0 0 00:19:39.986 tests 23 23 23 0 0 00:19:39.986 asserts 152 152 152 0 n/a 00:19:39.986 00:19:39.986 Elapsed time = 0.984 seconds 00:19:40.243 16:03:30 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:40.243 16:03:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:40.243 16:03:30 -- common/autotest_common.sh@10 -- # set +x 00:19:40.243 16:03:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:40.243 16:03:30 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:40.243 16:03:30 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:40.243 16:03:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:40.243 16:03:30 -- nvmf/common.sh@116 -- # sync 00:19:40.243 16:03:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:40.243 16:03:30 -- nvmf/common.sh@119 -- # set +e 00:19:40.243 16:03:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:40.243 16:03:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:40.243 rmmod nvme_tcp 00:19:40.243 rmmod nvme_fabrics 00:19:40.243 rmmod nvme_keyring 00:19:40.501 16:03:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:40.501 16:03:30 -- nvmf/common.sh@123 -- # set -e 00:19:40.501 16:03:30 -- nvmf/common.sh@124 -- # return 0 00:19:40.501 16:03:30 -- nvmf/common.sh@477 -- # '[' -n 2440728 ']' 00:19:40.501 16:03:30 -- nvmf/common.sh@478 -- # killprocess 2440728 00:19:40.501 16:03:30 -- common/autotest_common.sh@926 -- # '[' -z 2440728 ']' 00:19:40.501 16:03:30 -- common/autotest_common.sh@930 -- # kill -0 2440728 00:19:40.501 16:03:30 -- common/autotest_common.sh@931 -- # uname 00:19:40.501 16:03:30 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:40.501 16:03:30 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2440728 00:19:40.501 16:03:30 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:19:40.501 16:03:30 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:19:40.501 16:03:30 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2440728' 00:19:40.501 killing process with pid 2440728 00:19:40.501 16:03:30 -- common/autotest_common.sh@945 -- # kill 2440728 00:19:40.501 16:03:30 -- common/autotest_common.sh@950 -- # wait 2440728 00:19:40.759 16:03:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:40.759 16:03:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:40.759 16:03:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:40.759 16:03:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:40.759 16:03:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:40.759 16:03:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:40.759 16:03:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:40.759 16:03:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:43.299 16:03:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:43.299 00:19:43.299 real 0m7.017s 00:19:43.299 user 0m12.777s 00:19:43.299 sys 0m2.473s 00:19:43.299 16:03:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:43.299 16:03:32 -- common/autotest_common.sh@10 -- # set +x 00:19:43.299 ************************************ 00:19:43.299 END TEST nvmf_bdevio_no_huge 00:19:43.299 ************************************ 00:19:43.299 16:03:32 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:43.299 16:03:32 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:43.299 16:03:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:43.299 16:03:32 -- common/autotest_common.sh@10 -- # set +x 00:19:43.299 ************************************ 00:19:43.299 START TEST nvmf_tls 00:19:43.299 ************************************ 00:19:43.299 16:03:32 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:43.299 * Looking for test storage... 00:19:43.299 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:43.299 16:03:32 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:43.299 16:03:32 -- nvmf/common.sh@7 -- # uname -s 00:19:43.300 16:03:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:43.300 16:03:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:43.300 16:03:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:43.300 16:03:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:43.300 16:03:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:43.300 16:03:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:43.300 16:03:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:43.300 16:03:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:43.300 16:03:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:43.300 16:03:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:43.300 16:03:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:43.300 16:03:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:43.300 16:03:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:43.300 16:03:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:43.300 16:03:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:43.300 16:03:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:43.300 16:03:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:43.300 16:03:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:43.300 16:03:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:43.300 16:03:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:43.300 16:03:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:43.300 16:03:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:43.300 16:03:32 -- paths/export.sh@5 -- # export PATH 00:19:43.300 16:03:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:43.300 16:03:32 -- nvmf/common.sh@46 -- # : 0 00:19:43.300 16:03:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:43.300 16:03:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:43.300 16:03:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:43.300 16:03:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:43.300 16:03:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:43.300 16:03:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:43.300 16:03:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:43.300 16:03:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:43.300 16:03:32 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:43.300 16:03:32 -- target/tls.sh@71 -- # nvmftestinit 00:19:43.300 16:03:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:43.300 16:03:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:43.300 16:03:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:43.300 16:03:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:43.300 16:03:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:43.300 16:03:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:43.300 16:03:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:43.300 16:03:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:43.300 16:03:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:43.300 16:03:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:43.300 16:03:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:43.300 16:03:32 -- common/autotest_common.sh@10 -- # set +x 00:19:45.210 16:03:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:45.210 16:03:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:45.210 16:03:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:45.210 16:03:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:45.210 16:03:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:45.210 16:03:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:45.210 16:03:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:45.210 16:03:34 -- nvmf/common.sh@294 -- # net_devs=() 00:19:45.210 16:03:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:45.210 16:03:34 -- nvmf/common.sh@295 -- # e810=() 00:19:45.210 16:03:34 -- nvmf/common.sh@295 -- # local -ga e810 00:19:45.210 16:03:34 -- nvmf/common.sh@296 -- # x722=() 00:19:45.210 16:03:34 -- nvmf/common.sh@296 -- # local -ga x722 00:19:45.210 16:03:34 -- nvmf/common.sh@297 -- # mlx=() 00:19:45.210 16:03:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:45.210 16:03:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:45.210 16:03:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:45.210 16:03:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:45.210 16:03:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:45.210 16:03:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:45.210 16:03:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:45.210 16:03:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:45.210 16:03:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:45.210 16:03:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:45.210 16:03:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:45.210 16:03:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:45.210 16:03:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:45.210 16:03:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:45.210 16:03:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:45.211 16:03:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:45.211 16:03:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:45.211 16:03:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:45.211 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:45.211 16:03:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:45.211 16:03:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:45.211 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:45.211 16:03:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:45.211 16:03:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:45.211 16:03:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:45.211 16:03:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:45.211 16:03:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:45.211 16:03:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:45.211 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:45.211 16:03:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:45.211 16:03:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:45.211 16:03:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:45.211 16:03:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:45.211 16:03:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:45.211 16:03:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:45.211 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:45.211 16:03:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:45.211 16:03:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:45.211 16:03:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:45.211 16:03:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:45.211 16:03:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:45.211 16:03:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:45.211 16:03:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:45.211 16:03:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:45.211 16:03:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:45.211 16:03:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:45.211 16:03:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:45.211 16:03:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:45.211 16:03:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:45.211 16:03:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:45.211 16:03:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:45.211 16:03:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:45.211 16:03:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:45.211 16:03:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:45.211 16:03:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:45.211 16:03:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:45.211 16:03:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:45.211 16:03:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:45.211 16:03:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:45.211 16:03:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:45.211 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:45.211 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:19:45.211 00:19:45.211 --- 10.0.0.2 ping statistics --- 00:19:45.211 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:45.211 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:19:45.211 16:03:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:45.211 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:45.211 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.054 ms 00:19:45.211 00:19:45.211 --- 10.0.0.1 ping statistics --- 00:19:45.211 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:45.211 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:19:45.211 16:03:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:45.211 16:03:34 -- nvmf/common.sh@410 -- # return 0 00:19:45.211 16:03:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:45.211 16:03:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:45.211 16:03:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:45.211 16:03:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:45.211 16:03:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:45.211 16:03:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:45.211 16:03:34 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:19:45.211 16:03:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:45.211 16:03:34 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:45.211 16:03:34 -- common/autotest_common.sh@10 -- # set +x 00:19:45.211 16:03:34 -- nvmf/common.sh@469 -- # nvmfpid=2443091 00:19:45.211 16:03:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:19:45.211 16:03:34 -- nvmf/common.sh@470 -- # waitforlisten 2443091 00:19:45.211 16:03:34 -- common/autotest_common.sh@819 -- # '[' -z 2443091 ']' 00:19:45.211 16:03:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:45.211 16:03:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:45.211 16:03:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:45.211 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:45.211 16:03:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:45.211 16:03:34 -- common/autotest_common.sh@10 -- # set +x 00:19:45.211 [2024-10-30 16:03:35.043169] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:19:45.211 [2024-10-30 16:03:35.043279] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:45.211 EAL: No free 2048 kB hugepages reported on node 1 00:19:45.470 [2024-10-30 16:03:35.113721] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:45.470 [2024-10-30 16:03:35.201304] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:45.470 [2024-10-30 16:03:35.201456] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:45.470 [2024-10-30 16:03:35.201472] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:45.470 [2024-10-30 16:03:35.201483] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:45.470 [2024-10-30 16:03:35.201520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:45.470 16:03:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:45.470 16:03:35 -- common/autotest_common.sh@852 -- # return 0 00:19:45.470 16:03:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:45.470 16:03:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:45.470 16:03:35 -- common/autotest_common.sh@10 -- # set +x 00:19:45.470 16:03:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:45.470 16:03:35 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:19:45.470 16:03:35 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:19:45.729 true 00:19:45.729 16:03:35 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:45.729 16:03:35 -- target/tls.sh@82 -- # jq -r .tls_version 00:19:45.989 16:03:35 -- target/tls.sh@82 -- # version=0 00:19:45.989 16:03:35 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:19:45.989 16:03:35 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:46.248 16:03:36 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:46.248 16:03:36 -- target/tls.sh@90 -- # jq -r .tls_version 00:19:46.507 16:03:36 -- target/tls.sh@90 -- # version=13 00:19:46.507 16:03:36 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:19:46.507 16:03:36 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:19:46.765 16:03:36 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:46.765 16:03:36 -- target/tls.sh@98 -- # jq -r .tls_version 00:19:47.023 16:03:36 -- target/tls.sh@98 -- # version=7 00:19:47.023 16:03:36 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:19:47.023 16:03:36 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:47.023 16:03:36 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:19:47.282 16:03:37 -- target/tls.sh@105 -- # ktls=false 00:19:47.282 16:03:37 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:19:47.282 16:03:37 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:19:47.541 16:03:37 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:47.541 16:03:37 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:19:47.800 16:03:37 -- target/tls.sh@113 -- # ktls=true 00:19:47.800 16:03:37 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:19:47.800 16:03:37 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:19:48.059 16:03:37 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:48.059 16:03:37 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:19:48.318 16:03:38 -- target/tls.sh@121 -- # ktls=false 00:19:48.318 16:03:38 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:19:48.318 16:03:38 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:19:48.318 16:03:38 -- target/tls.sh@49 -- # local key hash crc 00:19:48.318 16:03:38 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:19:48.318 16:03:38 -- target/tls.sh@51 -- # hash=01 00:19:48.318 16:03:38 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:19:48.318 16:03:38 -- target/tls.sh@52 -- # gzip -1 -c 00:19:48.318 16:03:38 -- target/tls.sh@52 -- # tail -c8 00:19:48.318 16:03:38 -- target/tls.sh@52 -- # head -c 4 00:19:48.318 16:03:38 -- target/tls.sh@52 -- # crc='p$H�' 00:19:48.318 16:03:38 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:48.318 16:03:38 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:19:48.318 16:03:38 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:48.318 16:03:38 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:48.318 16:03:38 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:19:48.318 16:03:38 -- target/tls.sh@49 -- # local key hash crc 00:19:48.318 16:03:38 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:19:48.318 16:03:38 -- target/tls.sh@51 -- # hash=01 00:19:48.318 16:03:38 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:19:48.318 16:03:38 -- target/tls.sh@52 -- # gzip -1 -c 00:19:48.318 16:03:38 -- target/tls.sh@52 -- # tail -c8 00:19:48.318 16:03:38 -- target/tls.sh@52 -- # head -c 4 00:19:48.318 16:03:38 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:19:48.318 16:03:38 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:48.318 16:03:38 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:19:48.318 16:03:38 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:48.318 16:03:38 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:48.318 16:03:38 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:48.318 16:03:38 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:48.318 16:03:38 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:48.318 16:03:38 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:48.318 16:03:38 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:48.318 16:03:38 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:48.318 16:03:38 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:48.578 16:03:38 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:19:49.145 16:03:38 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:49.145 16:03:38 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:49.145 16:03:38 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:49.404 [2024-10-30 16:03:39.086814] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:49.404 16:03:39 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:49.662 16:03:39 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:49.925 [2024-10-30 16:03:39.588164] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:49.925 [2024-10-30 16:03:39.588426] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:49.925 16:03:39 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:50.184 malloc0 00:19:50.184 16:03:39 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:50.441 16:03:40 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:50.697 16:03:40 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:50.697 EAL: No free 2048 kB hugepages reported on node 1 00:20:00.781 Initializing NVMe Controllers 00:20:00.781 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:20:00.781 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:00.781 Initialization complete. Launching workers. 00:20:00.781 ======================================================== 00:20:00.781 Latency(us) 00:20:00.781 Device Information : IOPS MiB/s Average min max 00:20:00.781 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7761.28 30.32 8248.76 1339.88 9074.31 00:20:00.781 ======================================================== 00:20:00.781 Total : 7761.28 30.32 8248.76 1339.88 9074.31 00:20:00.781 00:20:00.781 16:03:50 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:00.781 16:03:50 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:00.781 16:03:50 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:00.781 16:03:50 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:00.781 16:03:50 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:00.781 16:03:50 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:00.781 16:03:50 -- target/tls.sh@28 -- # bdevperf_pid=2444939 00:20:00.781 16:03:50 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:00.781 16:03:50 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:00.781 16:03:50 -- target/tls.sh@31 -- # waitforlisten 2444939 /var/tmp/bdevperf.sock 00:20:00.781 16:03:50 -- common/autotest_common.sh@819 -- # '[' -z 2444939 ']' 00:20:00.781 16:03:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:00.781 16:03:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:00.781 16:03:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:00.781 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:00.781 16:03:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:00.781 16:03:50 -- common/autotest_common.sh@10 -- # set +x 00:20:00.781 [2024-10-30 16:03:50.535119] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:20:00.781 [2024-10-30 16:03:50.535194] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2444939 ] 00:20:00.781 EAL: No free 2048 kB hugepages reported on node 1 00:20:00.781 [2024-10-30 16:03:50.596972] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:01.039 [2024-10-30 16:03:50.682795] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:01.977 16:03:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:01.977 16:03:51 -- common/autotest_common.sh@852 -- # return 0 00:20:01.977 16:03:51 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:01.977 [2024-10-30 16:03:51.780133] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:01.977 TLSTESTn1 00:20:02.237 16:03:51 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:02.237 Running I/O for 10 seconds... 00:20:12.223 00:20:12.223 Latency(us) 00:20:12.223 [2024-10-30T15:04:02.099Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:12.223 [2024-10-30T15:04:02.099Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:12.223 Verification LBA range: start 0x0 length 0x2000 00:20:12.223 TLSTESTn1 : 10.01 4540.97 17.74 0.00 0.00 28157.54 3956.43 44855.75 00:20:12.223 [2024-10-30T15:04:02.099Z] =================================================================================================================== 00:20:12.223 [2024-10-30T15:04:02.099Z] Total : 4540.97 17.74 0.00 0.00 28157.54 3956.43 44855.75 00:20:12.223 0 00:20:12.223 16:04:02 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:12.223 16:04:02 -- target/tls.sh@45 -- # killprocess 2444939 00:20:12.223 16:04:02 -- common/autotest_common.sh@926 -- # '[' -z 2444939 ']' 00:20:12.223 16:04:02 -- common/autotest_common.sh@930 -- # kill -0 2444939 00:20:12.223 16:04:02 -- common/autotest_common.sh@931 -- # uname 00:20:12.223 16:04:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:12.223 16:04:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2444939 00:20:12.223 16:04:02 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:12.223 16:04:02 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:12.223 16:04:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2444939' 00:20:12.223 killing process with pid 2444939 00:20:12.223 16:04:02 -- common/autotest_common.sh@945 -- # kill 2444939 00:20:12.223 Received shutdown signal, test time was about 10.000000 seconds 00:20:12.223 00:20:12.223 Latency(us) 00:20:12.223 [2024-10-30T15:04:02.099Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:12.223 [2024-10-30T15:04:02.099Z] =================================================================================================================== 00:20:12.223 [2024-10-30T15:04:02.099Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:12.223 16:04:02 -- common/autotest_common.sh@950 -- # wait 2444939 00:20:12.483 16:04:02 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:12.483 16:04:02 -- common/autotest_common.sh@640 -- # local es=0 00:20:12.483 16:04:02 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:12.483 16:04:02 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:12.483 16:04:02 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:12.483 16:04:02 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:12.483 16:04:02 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:12.483 16:04:02 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:12.483 16:04:02 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:12.483 16:04:02 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:12.483 16:04:02 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:12.483 16:04:02 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:12.483 16:04:02 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:12.483 16:04:02 -- target/tls.sh@28 -- # bdevperf_pid=2446379 00:20:12.483 16:04:02 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:12.483 16:04:02 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:12.483 16:04:02 -- target/tls.sh@31 -- # waitforlisten 2446379 /var/tmp/bdevperf.sock 00:20:12.483 16:04:02 -- common/autotest_common.sh@819 -- # '[' -z 2446379 ']' 00:20:12.483 16:04:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:12.483 16:04:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:12.483 16:04:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:12.483 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:12.483 16:04:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:12.483 16:04:02 -- common/autotest_common.sh@10 -- # set +x 00:20:12.483 [2024-10-30 16:04:02.350036] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:20:12.483 [2024-10-30 16:04:02.350131] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2446379 ] 00:20:12.743 EAL: No free 2048 kB hugepages reported on node 1 00:20:12.743 [2024-10-30 16:04:02.410379] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:12.743 [2024-10-30 16:04:02.490605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:13.679 16:04:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:13.679 16:04:03 -- common/autotest_common.sh@852 -- # return 0 00:20:13.679 16:04:03 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:13.679 [2024-10-30 16:04:03.542727] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:13.679 [2024-10-30 16:04:03.547852] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:13.679 [2024-10-30 16:04:03.548400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c43cf0 (107): Transport endpoint is not connected 00:20:13.679 [2024-10-30 16:04:03.549387] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c43cf0 (9): Bad file descriptor 00:20:13.679 [2024-10-30 16:04:03.550386] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:13.679 [2024-10-30 16:04:03.550407] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:13.679 [2024-10-30 16:04:03.550421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:13.679 request: 00:20:13.679 { 00:20:13.679 "name": "TLSTEST", 00:20:13.679 "trtype": "tcp", 00:20:13.679 "traddr": "10.0.0.2", 00:20:13.679 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:13.679 "adrfam": "ipv4", 00:20:13.679 "trsvcid": "4420", 00:20:13.679 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:13.679 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:13.679 "method": "bdev_nvme_attach_controller", 00:20:13.679 "req_id": 1 00:20:13.679 } 00:20:13.679 Got JSON-RPC error response 00:20:13.679 response: 00:20:13.679 { 00:20:13.679 "code": -32602, 00:20:13.679 "message": "Invalid parameters" 00:20:13.679 } 00:20:13.940 16:04:03 -- target/tls.sh@36 -- # killprocess 2446379 00:20:13.940 16:04:03 -- common/autotest_common.sh@926 -- # '[' -z 2446379 ']' 00:20:13.940 16:04:03 -- common/autotest_common.sh@930 -- # kill -0 2446379 00:20:13.940 16:04:03 -- common/autotest_common.sh@931 -- # uname 00:20:13.940 16:04:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:13.940 16:04:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2446379 00:20:13.940 16:04:03 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:13.940 16:04:03 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:13.940 16:04:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2446379' 00:20:13.940 killing process with pid 2446379 00:20:13.940 16:04:03 -- common/autotest_common.sh@945 -- # kill 2446379 00:20:13.940 Received shutdown signal, test time was about 10.000000 seconds 00:20:13.940 00:20:13.940 Latency(us) 00:20:13.940 [2024-10-30T15:04:03.816Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:13.940 [2024-10-30T15:04:03.816Z] =================================================================================================================== 00:20:13.940 [2024-10-30T15:04:03.816Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:13.940 16:04:03 -- common/autotest_common.sh@950 -- # wait 2446379 00:20:14.199 16:04:03 -- target/tls.sh@37 -- # return 1 00:20:14.199 16:04:03 -- common/autotest_common.sh@643 -- # es=1 00:20:14.199 16:04:03 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:14.199 16:04:03 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:14.199 16:04:03 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:14.199 16:04:03 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:14.199 16:04:03 -- common/autotest_common.sh@640 -- # local es=0 00:20:14.199 16:04:03 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:14.199 16:04:03 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:14.199 16:04:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:14.199 16:04:03 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:14.199 16:04:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:14.199 16:04:03 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:14.199 16:04:03 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:14.199 16:04:03 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:14.199 16:04:03 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:14.199 16:04:03 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:14.199 16:04:03 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:14.199 16:04:03 -- target/tls.sh@28 -- # bdevperf_pid=2446576 00:20:14.199 16:04:03 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:14.199 16:04:03 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:14.199 16:04:03 -- target/tls.sh@31 -- # waitforlisten 2446576 /var/tmp/bdevperf.sock 00:20:14.199 16:04:03 -- common/autotest_common.sh@819 -- # '[' -z 2446576 ']' 00:20:14.199 16:04:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:14.199 16:04:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:14.199 16:04:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:14.199 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:14.199 16:04:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:14.199 16:04:03 -- common/autotest_common.sh@10 -- # set +x 00:20:14.199 [2024-10-30 16:04:03.871958] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:20:14.199 [2024-10-30 16:04:03.872052] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2446576 ] 00:20:14.199 EAL: No free 2048 kB hugepages reported on node 1 00:20:14.199 [2024-10-30 16:04:03.931355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:14.199 [2024-10-30 16:04:04.010786] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:15.135 16:04:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:15.135 16:04:04 -- common/autotest_common.sh@852 -- # return 0 00:20:15.136 16:04:04 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:15.395 [2024-10-30 16:04:05.059421] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:15.395 [2024-10-30 16:04:05.069420] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:15.395 [2024-10-30 16:04:05.069467] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:15.395 [2024-10-30 16:04:05.069519] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:15.395 [2024-10-30 16:04:05.070149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x72dcf0 (107): Transport endpoint is not connected 00:20:15.395 [2024-10-30 16:04:05.071126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x72dcf0 (9): Bad file descriptor 00:20:15.395 [2024-10-30 16:04:05.072124] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:15.395 [2024-10-30 16:04:05.072147] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:15.395 [2024-10-30 16:04:05.072167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:15.395 request: 00:20:15.395 { 00:20:15.395 "name": "TLSTEST", 00:20:15.395 "trtype": "tcp", 00:20:15.395 "traddr": "10.0.0.2", 00:20:15.395 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:15.395 "adrfam": "ipv4", 00:20:15.395 "trsvcid": "4420", 00:20:15.395 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:15.395 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:15.395 "method": "bdev_nvme_attach_controller", 00:20:15.395 "req_id": 1 00:20:15.395 } 00:20:15.395 Got JSON-RPC error response 00:20:15.395 response: 00:20:15.395 { 00:20:15.395 "code": -32602, 00:20:15.395 "message": "Invalid parameters" 00:20:15.395 } 00:20:15.395 16:04:05 -- target/tls.sh@36 -- # killprocess 2446576 00:20:15.395 16:04:05 -- common/autotest_common.sh@926 -- # '[' -z 2446576 ']' 00:20:15.395 16:04:05 -- common/autotest_common.sh@930 -- # kill -0 2446576 00:20:15.395 16:04:05 -- common/autotest_common.sh@931 -- # uname 00:20:15.395 16:04:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:15.395 16:04:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2446576 00:20:15.395 16:04:05 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:15.395 16:04:05 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:15.395 16:04:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2446576' 00:20:15.395 killing process with pid 2446576 00:20:15.395 16:04:05 -- common/autotest_common.sh@945 -- # kill 2446576 00:20:15.395 Received shutdown signal, test time was about 10.000000 seconds 00:20:15.395 00:20:15.395 Latency(us) 00:20:15.395 [2024-10-30T15:04:05.271Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:15.395 [2024-10-30T15:04:05.271Z] =================================================================================================================== 00:20:15.395 [2024-10-30T15:04:05.271Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:15.395 16:04:05 -- common/autotest_common.sh@950 -- # wait 2446576 00:20:15.654 16:04:05 -- target/tls.sh@37 -- # return 1 00:20:15.654 16:04:05 -- common/autotest_common.sh@643 -- # es=1 00:20:15.654 16:04:05 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:15.654 16:04:05 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:15.654 16:04:05 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:15.654 16:04:05 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:15.654 16:04:05 -- common/autotest_common.sh@640 -- # local es=0 00:20:15.654 16:04:05 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:15.654 16:04:05 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:15.654 16:04:05 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:15.654 16:04:05 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:15.654 16:04:05 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:15.654 16:04:05 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:15.654 16:04:05 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:15.654 16:04:05 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:15.654 16:04:05 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:15.654 16:04:05 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:15.654 16:04:05 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:15.654 16:04:05 -- target/tls.sh@28 -- # bdevperf_pid=2446729 00:20:15.654 16:04:05 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:15.654 16:04:05 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:15.654 16:04:05 -- target/tls.sh@31 -- # waitforlisten 2446729 /var/tmp/bdevperf.sock 00:20:15.654 16:04:05 -- common/autotest_common.sh@819 -- # '[' -z 2446729 ']' 00:20:15.654 16:04:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:15.654 16:04:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:15.654 16:04:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:15.654 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:15.654 16:04:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:15.654 16:04:05 -- common/autotest_common.sh@10 -- # set +x 00:20:15.654 [2024-10-30 16:04:05.382415] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:20:15.654 [2024-10-30 16:04:05.382508] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2446729 ] 00:20:15.654 EAL: No free 2048 kB hugepages reported on node 1 00:20:15.654 [2024-10-30 16:04:05.441299] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:15.654 [2024-10-30 16:04:05.520103] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:16.591 16:04:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:16.591 16:04:06 -- common/autotest_common.sh@852 -- # return 0 00:20:16.591 16:04:06 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:16.850 [2024-10-30 16:04:06.563902] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:16.850 [2024-10-30 16:04:06.573334] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:16.850 [2024-10-30 16:04:06.573364] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:16.850 [2024-10-30 16:04:06.573416] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:16.850 [2024-10-30 16:04:06.573714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6a2cf0 (107): Transport endpoint is not connected 00:20:16.850 [2024-10-30 16:04:06.574704] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6a2cf0 (9): Bad file descriptor 00:20:16.850 [2024-10-30 16:04:06.575703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:16.850 [2024-10-30 16:04:06.575725] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:16.850 [2024-10-30 16:04:06.575738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:16.850 request: 00:20:16.850 { 00:20:16.850 "name": "TLSTEST", 00:20:16.850 "trtype": "tcp", 00:20:16.850 "traddr": "10.0.0.2", 00:20:16.850 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:16.850 "adrfam": "ipv4", 00:20:16.850 "trsvcid": "4420", 00:20:16.850 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:16.850 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:16.850 "method": "bdev_nvme_attach_controller", 00:20:16.850 "req_id": 1 00:20:16.850 } 00:20:16.850 Got JSON-RPC error response 00:20:16.850 response: 00:20:16.850 { 00:20:16.850 "code": -32602, 00:20:16.850 "message": "Invalid parameters" 00:20:16.850 } 00:20:16.850 16:04:06 -- target/tls.sh@36 -- # killprocess 2446729 00:20:16.850 16:04:06 -- common/autotest_common.sh@926 -- # '[' -z 2446729 ']' 00:20:16.850 16:04:06 -- common/autotest_common.sh@930 -- # kill -0 2446729 00:20:16.850 16:04:06 -- common/autotest_common.sh@931 -- # uname 00:20:16.850 16:04:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:16.850 16:04:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2446729 00:20:16.850 16:04:06 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:16.850 16:04:06 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:16.850 16:04:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2446729' 00:20:16.850 killing process with pid 2446729 00:20:16.850 16:04:06 -- common/autotest_common.sh@945 -- # kill 2446729 00:20:16.850 Received shutdown signal, test time was about 10.000000 seconds 00:20:16.850 00:20:16.850 Latency(us) 00:20:16.850 [2024-10-30T15:04:06.726Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:16.850 [2024-10-30T15:04:06.726Z] =================================================================================================================== 00:20:16.850 [2024-10-30T15:04:06.726Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:16.850 16:04:06 -- common/autotest_common.sh@950 -- # wait 2446729 00:20:17.109 16:04:06 -- target/tls.sh@37 -- # return 1 00:20:17.109 16:04:06 -- common/autotest_common.sh@643 -- # es=1 00:20:17.109 16:04:06 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:17.109 16:04:06 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:17.109 16:04:06 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:17.109 16:04:06 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:17.109 16:04:06 -- common/autotest_common.sh@640 -- # local es=0 00:20:17.109 16:04:06 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:17.109 16:04:06 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:17.109 16:04:06 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:17.109 16:04:06 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:17.109 16:04:06 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:17.109 16:04:06 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:17.109 16:04:06 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:17.109 16:04:06 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:17.109 16:04:06 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:17.109 16:04:06 -- target/tls.sh@23 -- # psk= 00:20:17.109 16:04:06 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:17.109 16:04:06 -- target/tls.sh@28 -- # bdevperf_pid=2446972 00:20:17.109 16:04:06 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:17.109 16:04:06 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:17.109 16:04:06 -- target/tls.sh@31 -- # waitforlisten 2446972 /var/tmp/bdevperf.sock 00:20:17.109 16:04:06 -- common/autotest_common.sh@819 -- # '[' -z 2446972 ']' 00:20:17.109 16:04:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:17.109 16:04:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:17.109 16:04:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:17.109 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:17.109 16:04:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:17.109 16:04:06 -- common/autotest_common.sh@10 -- # set +x 00:20:17.109 [2024-10-30 16:04:06.890133] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:20:17.109 [2024-10-30 16:04:06.890225] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2446972 ] 00:20:17.109 EAL: No free 2048 kB hugepages reported on node 1 00:20:17.109 [2024-10-30 16:04:06.949873] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:17.368 [2024-10-30 16:04:07.030511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:18.304 16:04:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:18.304 16:04:07 -- common/autotest_common.sh@852 -- # return 0 00:20:18.304 16:04:07 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:18.304 [2024-10-30 16:04:08.097326] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:18.304 [2024-10-30 16:04:08.099187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9c4720 (9): Bad file descriptor 00:20:18.304 [2024-10-30 16:04:08.100184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:18.304 [2024-10-30 16:04:08.100214] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:18.305 [2024-10-30 16:04:08.100229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:18.305 request: 00:20:18.305 { 00:20:18.305 "name": "TLSTEST", 00:20:18.305 "trtype": "tcp", 00:20:18.305 "traddr": "10.0.0.2", 00:20:18.305 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:18.305 "adrfam": "ipv4", 00:20:18.305 "trsvcid": "4420", 00:20:18.305 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:18.305 "method": "bdev_nvme_attach_controller", 00:20:18.305 "req_id": 1 00:20:18.305 } 00:20:18.305 Got JSON-RPC error response 00:20:18.305 response: 00:20:18.305 { 00:20:18.305 "code": -32602, 00:20:18.305 "message": "Invalid parameters" 00:20:18.305 } 00:20:18.305 16:04:08 -- target/tls.sh@36 -- # killprocess 2446972 00:20:18.305 16:04:08 -- common/autotest_common.sh@926 -- # '[' -z 2446972 ']' 00:20:18.305 16:04:08 -- common/autotest_common.sh@930 -- # kill -0 2446972 00:20:18.305 16:04:08 -- common/autotest_common.sh@931 -- # uname 00:20:18.305 16:04:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:18.305 16:04:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2446972 00:20:18.305 16:04:08 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:18.305 16:04:08 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:18.305 16:04:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2446972' 00:20:18.305 killing process with pid 2446972 00:20:18.305 16:04:08 -- common/autotest_common.sh@945 -- # kill 2446972 00:20:18.305 Received shutdown signal, test time was about 10.000000 seconds 00:20:18.305 00:20:18.305 Latency(us) 00:20:18.305 [2024-10-30T15:04:08.181Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:18.305 [2024-10-30T15:04:08.181Z] =================================================================================================================== 00:20:18.305 [2024-10-30T15:04:08.181Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:18.305 16:04:08 -- common/autotest_common.sh@950 -- # wait 2446972 00:20:18.564 16:04:08 -- target/tls.sh@37 -- # return 1 00:20:18.564 16:04:08 -- common/autotest_common.sh@643 -- # es=1 00:20:18.564 16:04:08 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:18.564 16:04:08 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:18.564 16:04:08 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:18.564 16:04:08 -- target/tls.sh@167 -- # killprocess 2443091 00:20:18.564 16:04:08 -- common/autotest_common.sh@926 -- # '[' -z 2443091 ']' 00:20:18.564 16:04:08 -- common/autotest_common.sh@930 -- # kill -0 2443091 00:20:18.564 16:04:08 -- common/autotest_common.sh@931 -- # uname 00:20:18.564 16:04:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:18.564 16:04:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2443091 00:20:18.564 16:04:08 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:18.564 16:04:08 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:18.564 16:04:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2443091' 00:20:18.564 killing process with pid 2443091 00:20:18.564 16:04:08 -- common/autotest_common.sh@945 -- # kill 2443091 00:20:18.564 16:04:08 -- common/autotest_common.sh@950 -- # wait 2443091 00:20:18.824 16:04:08 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:18.824 16:04:08 -- target/tls.sh@49 -- # local key hash crc 00:20:18.824 16:04:08 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:18.824 16:04:08 -- target/tls.sh@51 -- # hash=02 00:20:18.824 16:04:08 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:18.824 16:04:08 -- target/tls.sh@52 -- # tail -c8 00:20:18.824 16:04:08 -- target/tls.sh@52 -- # gzip -1 -c 00:20:18.824 16:04:08 -- target/tls.sh@52 -- # head -c 4 00:20:18.824 16:04:08 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:18.824 16:04:08 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:18.824 16:04:08 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:18.824 16:04:08 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:18.824 16:04:08 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:18.824 16:04:08 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:18.824 16:04:08 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:18.824 16:04:08 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:18.824 16:04:08 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:18.824 16:04:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:18.824 16:04:08 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:18.824 16:04:08 -- common/autotest_common.sh@10 -- # set +x 00:20:18.824 16:04:08 -- nvmf/common.sh@469 -- # nvmfpid=2447174 00:20:18.824 16:04:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:18.824 16:04:08 -- nvmf/common.sh@470 -- # waitforlisten 2447174 00:20:18.824 16:04:08 -- common/autotest_common.sh@819 -- # '[' -z 2447174 ']' 00:20:18.824 16:04:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:18.824 16:04:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:18.824 16:04:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:18.824 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:18.824 16:04:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:18.824 16:04:08 -- common/autotest_common.sh@10 -- # set +x 00:20:19.084 [2024-10-30 16:04:08.723729] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:20:19.084 [2024-10-30 16:04:08.723813] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:19.084 EAL: No free 2048 kB hugepages reported on node 1 00:20:19.084 [2024-10-30 16:04:08.788037] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:19.084 [2024-10-30 16:04:08.876229] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:19.084 [2024-10-30 16:04:08.876399] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:19.084 [2024-10-30 16:04:08.876418] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:19.084 [2024-10-30 16:04:08.876430] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:19.084 [2024-10-30 16:04:08.876464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:20.018 16:04:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:20.018 16:04:09 -- common/autotest_common.sh@852 -- # return 0 00:20:20.018 16:04:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:20.018 16:04:09 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:20.018 16:04:09 -- common/autotest_common.sh@10 -- # set +x 00:20:20.018 16:04:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:20.018 16:04:09 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:20.018 16:04:09 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:20.018 16:04:09 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:20.275 [2024-10-30 16:04:09.945049] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:20.275 16:04:09 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:20.534 16:04:10 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:20.792 [2024-10-30 16:04:10.510601] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:20.792 [2024-10-30 16:04:10.510863] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:20.792 16:04:10 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:21.051 malloc0 00:20:21.051 16:04:10 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:21.310 16:04:11 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:21.568 16:04:11 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:21.568 16:04:11 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:21.568 16:04:11 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:21.568 16:04:11 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:21.568 16:04:11 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:21.568 16:04:11 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:21.568 16:04:11 -- target/tls.sh@28 -- # bdevperf_pid=2447571 00:20:21.568 16:04:11 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:21.568 16:04:11 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:21.568 16:04:11 -- target/tls.sh@31 -- # waitforlisten 2447571 /var/tmp/bdevperf.sock 00:20:21.568 16:04:11 -- common/autotest_common.sh@819 -- # '[' -z 2447571 ']' 00:20:21.568 16:04:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:21.568 16:04:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:21.568 16:04:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:21.568 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:21.568 16:04:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:21.568 16:04:11 -- common/autotest_common.sh@10 -- # set +x 00:20:21.568 [2024-10-30 16:04:11.419148] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:20:21.568 [2024-10-30 16:04:11.419237] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2447571 ] 00:20:21.827 EAL: No free 2048 kB hugepages reported on node 1 00:20:21.827 [2024-10-30 16:04:11.478463] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:21.827 [2024-10-30 16:04:11.559539] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:22.764 16:04:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:22.764 16:04:12 -- common/autotest_common.sh@852 -- # return 0 00:20:22.764 16:04:12 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:23.023 [2024-10-30 16:04:12.643333] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:23.023 TLSTESTn1 00:20:23.023 16:04:12 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:23.023 Running I/O for 10 seconds... 00:20:35.242 00:20:35.242 Latency(us) 00:20:35.242 [2024-10-30T15:04:25.118Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:35.242 [2024-10-30T15:04:25.118Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:35.242 Verification LBA range: start 0x0 length 0x2000 00:20:35.242 TLSTESTn1 : 10.02 3647.37 14.25 0.00 0.00 35038.79 6213.78 78449.02 00:20:35.242 [2024-10-30T15:04:25.118Z] =================================================================================================================== 00:20:35.242 [2024-10-30T15:04:25.118Z] Total : 3647.37 14.25 0.00 0.00 35038.79 6213.78 78449.02 00:20:35.242 0 00:20:35.242 16:04:22 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:35.242 16:04:22 -- target/tls.sh@45 -- # killprocess 2447571 00:20:35.242 16:04:22 -- common/autotest_common.sh@926 -- # '[' -z 2447571 ']' 00:20:35.242 16:04:22 -- common/autotest_common.sh@930 -- # kill -0 2447571 00:20:35.242 16:04:22 -- common/autotest_common.sh@931 -- # uname 00:20:35.242 16:04:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:35.242 16:04:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2447571 00:20:35.242 16:04:22 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:35.242 16:04:22 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:35.242 16:04:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2447571' 00:20:35.242 killing process with pid 2447571 00:20:35.242 16:04:22 -- common/autotest_common.sh@945 -- # kill 2447571 00:20:35.243 Received shutdown signal, test time was about 10.000000 seconds 00:20:35.243 00:20:35.243 Latency(us) 00:20:35.243 [2024-10-30T15:04:25.119Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:35.243 [2024-10-30T15:04:25.119Z] =================================================================================================================== 00:20:35.243 [2024-10-30T15:04:25.119Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:35.243 16:04:22 -- common/autotest_common.sh@950 -- # wait 2447571 00:20:35.243 16:04:23 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:35.243 16:04:23 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:35.243 16:04:23 -- common/autotest_common.sh@640 -- # local es=0 00:20:35.243 16:04:23 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:35.243 16:04:23 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:20:35.243 16:04:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:35.243 16:04:23 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:20:35.243 16:04:23 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:35.243 16:04:23 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:35.243 16:04:23 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:35.243 16:04:23 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:35.243 16:04:23 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:35.243 16:04:23 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:35.243 16:04:23 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:35.243 16:04:23 -- target/tls.sh@28 -- # bdevperf_pid=2448962 00:20:35.243 16:04:23 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:35.243 16:04:23 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:35.243 16:04:23 -- target/tls.sh@31 -- # waitforlisten 2448962 /var/tmp/bdevperf.sock 00:20:35.243 16:04:23 -- common/autotest_common.sh@819 -- # '[' -z 2448962 ']' 00:20:35.243 16:04:23 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:35.243 16:04:23 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:35.243 16:04:23 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:35.243 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:35.243 16:04:23 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:35.243 16:04:23 -- common/autotest_common.sh@10 -- # set +x 00:20:35.243 [2024-10-30 16:04:23.235308] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:20:35.243 [2024-10-30 16:04:23.235404] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2448962 ] 00:20:35.243 EAL: No free 2048 kB hugepages reported on node 1 00:20:35.243 [2024-10-30 16:04:23.293756] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:35.243 [2024-10-30 16:04:23.372383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:35.243 16:04:24 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:35.243 16:04:24 -- common/autotest_common.sh@852 -- # return 0 00:20:35.243 16:04:24 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:35.243 [2024-10-30 16:04:24.515912] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:35.243 [2024-10-30 16:04:24.515967] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:35.243 request: 00:20:35.243 { 00:20:35.243 "name": "TLSTEST", 00:20:35.243 "trtype": "tcp", 00:20:35.243 "traddr": "10.0.0.2", 00:20:35.243 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:35.243 "adrfam": "ipv4", 00:20:35.243 "trsvcid": "4420", 00:20:35.243 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.243 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:35.243 "method": "bdev_nvme_attach_controller", 00:20:35.243 "req_id": 1 00:20:35.243 } 00:20:35.243 Got JSON-RPC error response 00:20:35.243 response: 00:20:35.243 { 00:20:35.243 "code": -22, 00:20:35.243 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:35.243 } 00:20:35.243 16:04:24 -- target/tls.sh@36 -- # killprocess 2448962 00:20:35.243 16:04:24 -- common/autotest_common.sh@926 -- # '[' -z 2448962 ']' 00:20:35.243 16:04:24 -- common/autotest_common.sh@930 -- # kill -0 2448962 00:20:35.243 16:04:24 -- common/autotest_common.sh@931 -- # uname 00:20:35.243 16:04:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:35.243 16:04:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2448962 00:20:35.243 16:04:24 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:35.243 16:04:24 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:35.243 16:04:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2448962' 00:20:35.243 killing process with pid 2448962 00:20:35.243 16:04:24 -- common/autotest_common.sh@945 -- # kill 2448962 00:20:35.243 Received shutdown signal, test time was about 10.000000 seconds 00:20:35.243 00:20:35.243 Latency(us) 00:20:35.243 [2024-10-30T15:04:25.119Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:35.243 [2024-10-30T15:04:25.119Z] =================================================================================================================== 00:20:35.243 [2024-10-30T15:04:25.119Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:35.243 16:04:24 -- common/autotest_common.sh@950 -- # wait 2448962 00:20:35.243 16:04:24 -- target/tls.sh@37 -- # return 1 00:20:35.243 16:04:24 -- common/autotest_common.sh@643 -- # es=1 00:20:35.243 16:04:24 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:35.243 16:04:24 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:35.243 16:04:24 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:35.243 16:04:24 -- target/tls.sh@183 -- # killprocess 2447174 00:20:35.243 16:04:24 -- common/autotest_common.sh@926 -- # '[' -z 2447174 ']' 00:20:35.243 16:04:24 -- common/autotest_common.sh@930 -- # kill -0 2447174 00:20:35.243 16:04:24 -- common/autotest_common.sh@931 -- # uname 00:20:35.243 16:04:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:35.243 16:04:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2447174 00:20:35.243 16:04:24 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:35.243 16:04:24 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:35.243 16:04:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2447174' 00:20:35.243 killing process with pid 2447174 00:20:35.243 16:04:24 -- common/autotest_common.sh@945 -- # kill 2447174 00:20:35.243 16:04:24 -- common/autotest_common.sh@950 -- # wait 2447174 00:20:35.243 16:04:25 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:35.243 16:04:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:35.243 16:04:25 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:35.243 16:04:25 -- common/autotest_common.sh@10 -- # set +x 00:20:35.243 16:04:25 -- nvmf/common.sh@469 -- # nvmfpid=2449244 00:20:35.243 16:04:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:35.243 16:04:25 -- nvmf/common.sh@470 -- # waitforlisten 2449244 00:20:35.243 16:04:25 -- common/autotest_common.sh@819 -- # '[' -z 2449244 ']' 00:20:35.243 16:04:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:35.243 16:04:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:35.243 16:04:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:35.243 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:35.243 16:04:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:35.243 16:04:25 -- common/autotest_common.sh@10 -- # set +x 00:20:35.503 [2024-10-30 16:04:25.122525] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:20:35.503 [2024-10-30 16:04:25.122616] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:35.503 EAL: No free 2048 kB hugepages reported on node 1 00:20:35.503 [2024-10-30 16:04:25.187589] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:35.503 [2024-10-30 16:04:25.269882] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:35.503 [2024-10-30 16:04:25.270028] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:35.503 [2024-10-30 16:04:25.270047] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:35.503 [2024-10-30 16:04:25.270059] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:35.503 [2024-10-30 16:04:25.270085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:36.440 16:04:26 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:36.440 16:04:26 -- common/autotest_common.sh@852 -- # return 0 00:20:36.440 16:04:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:36.440 16:04:26 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:36.440 16:04:26 -- common/autotest_common.sh@10 -- # set +x 00:20:36.440 16:04:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:36.440 16:04:26 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:36.440 16:04:26 -- common/autotest_common.sh@640 -- # local es=0 00:20:36.440 16:04:26 -- common/autotest_common.sh@642 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:36.440 16:04:26 -- common/autotest_common.sh@628 -- # local arg=setup_nvmf_tgt 00:20:36.440 16:04:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:36.440 16:04:26 -- common/autotest_common.sh@632 -- # type -t setup_nvmf_tgt 00:20:36.440 16:04:26 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:36.440 16:04:26 -- common/autotest_common.sh@643 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:36.440 16:04:26 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:36.440 16:04:26 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:36.699 [2024-10-30 16:04:26.329060] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:36.699 16:04:26 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:36.958 16:04:26 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:36.958 [2024-10-30 16:04:26.818376] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:36.958 [2024-10-30 16:04:26.818637] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:36.958 16:04:26 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:37.216 malloc0 00:20:37.475 16:04:27 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:37.475 16:04:27 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:37.733 [2024-10-30 16:04:27.568147] tcp.c:3549:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:37.733 [2024-10-30 16:04:27.568192] tcp.c:3618:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:37.733 [2024-10-30 16:04:27.568231] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:37.733 request: 00:20:37.733 { 00:20:37.733 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:37.733 "host": "nqn.2016-06.io.spdk:host1", 00:20:37.733 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:37.733 "method": "nvmf_subsystem_add_host", 00:20:37.733 "req_id": 1 00:20:37.733 } 00:20:37.733 Got JSON-RPC error response 00:20:37.733 response: 00:20:37.733 { 00:20:37.733 "code": -32603, 00:20:37.733 "message": "Internal error" 00:20:37.733 } 00:20:37.733 16:04:27 -- common/autotest_common.sh@643 -- # es=1 00:20:37.733 16:04:27 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:37.733 16:04:27 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:37.733 16:04:27 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:37.733 16:04:27 -- target/tls.sh@189 -- # killprocess 2449244 00:20:37.733 16:04:27 -- common/autotest_common.sh@926 -- # '[' -z 2449244 ']' 00:20:37.733 16:04:27 -- common/autotest_common.sh@930 -- # kill -0 2449244 00:20:37.733 16:04:27 -- common/autotest_common.sh@931 -- # uname 00:20:37.733 16:04:27 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:37.733 16:04:27 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2449244 00:20:37.992 16:04:27 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:37.992 16:04:27 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:37.992 16:04:27 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2449244' 00:20:37.992 killing process with pid 2449244 00:20:37.992 16:04:27 -- common/autotest_common.sh@945 -- # kill 2449244 00:20:37.992 16:04:27 -- common/autotest_common.sh@950 -- # wait 2449244 00:20:38.251 16:04:27 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:38.251 16:04:27 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:20:38.251 16:04:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:38.251 16:04:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:38.251 16:04:27 -- common/autotest_common.sh@10 -- # set +x 00:20:38.251 16:04:27 -- nvmf/common.sh@469 -- # nvmfpid=2449551 00:20:38.251 16:04:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:38.251 16:04:27 -- nvmf/common.sh@470 -- # waitforlisten 2449551 00:20:38.251 16:04:27 -- common/autotest_common.sh@819 -- # '[' -z 2449551 ']' 00:20:38.251 16:04:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:38.251 16:04:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:38.251 16:04:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:38.251 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:38.251 16:04:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:38.251 16:04:27 -- common/autotest_common.sh@10 -- # set +x 00:20:38.251 [2024-10-30 16:04:27.933469] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:20:38.251 [2024-10-30 16:04:27.933547] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:38.251 EAL: No free 2048 kB hugepages reported on node 1 00:20:38.251 [2024-10-30 16:04:28.003901] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:38.251 [2024-10-30 16:04:28.094917] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:38.251 [2024-10-30 16:04:28.095078] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:38.251 [2024-10-30 16:04:28.095098] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:38.251 [2024-10-30 16:04:28.095111] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:38.251 [2024-10-30 16:04:28.095137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:39.185 16:04:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:39.185 16:04:28 -- common/autotest_common.sh@852 -- # return 0 00:20:39.185 16:04:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:39.185 16:04:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:39.185 16:04:28 -- common/autotest_common.sh@10 -- # set +x 00:20:39.185 16:04:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:39.185 16:04:28 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:39.185 16:04:28 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:39.185 16:04:28 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:39.443 [2024-10-30 16:04:29.129492] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:39.443 16:04:29 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:39.701 16:04:29 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:39.968 [2024-10-30 16:04:29.642873] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:39.969 [2024-10-30 16:04:29.643136] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:39.969 16:04:29 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:40.228 malloc0 00:20:40.228 16:04:29 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:40.485 16:04:30 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:40.743 16:04:30 -- target/tls.sh@197 -- # bdevperf_pid=2449858 00:20:40.743 16:04:30 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:40.743 16:04:30 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:40.743 16:04:30 -- target/tls.sh@200 -- # waitforlisten 2449858 /var/tmp/bdevperf.sock 00:20:40.743 16:04:30 -- common/autotest_common.sh@819 -- # '[' -z 2449858 ']' 00:20:40.743 16:04:30 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:40.743 16:04:30 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:40.743 16:04:30 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:40.743 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:40.743 16:04:30 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:40.743 16:04:30 -- common/autotest_common.sh@10 -- # set +x 00:20:40.743 [2024-10-30 16:04:30.467891] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:20:40.743 [2024-10-30 16:04:30.467967] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2449858 ] 00:20:40.743 EAL: No free 2048 kB hugepages reported on node 1 00:20:40.743 [2024-10-30 16:04:30.528218] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:40.743 [2024-10-30 16:04:30.615594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:41.683 16:04:31 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:41.683 16:04:31 -- common/autotest_common.sh@852 -- # return 0 00:20:41.683 16:04:31 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:41.942 [2024-10-30 16:04:31.684052] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:41.942 TLSTESTn1 00:20:41.942 16:04:31 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:20:42.511 16:04:32 -- target/tls.sh@205 -- # tgtconf='{ 00:20:42.511 "subsystems": [ 00:20:42.511 { 00:20:42.511 "subsystem": "iobuf", 00:20:42.511 "config": [ 00:20:42.511 { 00:20:42.511 "method": "iobuf_set_options", 00:20:42.511 "params": { 00:20:42.511 "small_pool_count": 8192, 00:20:42.511 "large_pool_count": 1024, 00:20:42.511 "small_bufsize": 8192, 00:20:42.511 "large_bufsize": 135168 00:20:42.511 } 00:20:42.511 } 00:20:42.511 ] 00:20:42.511 }, 00:20:42.511 { 00:20:42.511 "subsystem": "sock", 00:20:42.511 "config": [ 00:20:42.511 { 00:20:42.511 "method": "sock_impl_set_options", 00:20:42.511 "params": { 00:20:42.511 "impl_name": "posix", 00:20:42.511 "recv_buf_size": 2097152, 00:20:42.511 "send_buf_size": 2097152, 00:20:42.511 "enable_recv_pipe": true, 00:20:42.511 "enable_quickack": false, 00:20:42.511 "enable_placement_id": 0, 00:20:42.511 "enable_zerocopy_send_server": true, 00:20:42.511 "enable_zerocopy_send_client": false, 00:20:42.511 "zerocopy_threshold": 0, 00:20:42.511 "tls_version": 0, 00:20:42.511 "enable_ktls": false 00:20:42.511 } 00:20:42.511 }, 00:20:42.511 { 00:20:42.511 "method": "sock_impl_set_options", 00:20:42.511 "params": { 00:20:42.511 "impl_name": "ssl", 00:20:42.511 "recv_buf_size": 4096, 00:20:42.511 "send_buf_size": 4096, 00:20:42.511 "enable_recv_pipe": true, 00:20:42.511 "enable_quickack": false, 00:20:42.511 "enable_placement_id": 0, 00:20:42.511 "enable_zerocopy_send_server": true, 00:20:42.511 "enable_zerocopy_send_client": false, 00:20:42.511 "zerocopy_threshold": 0, 00:20:42.511 "tls_version": 0, 00:20:42.511 "enable_ktls": false 00:20:42.511 } 00:20:42.511 } 00:20:42.511 ] 00:20:42.511 }, 00:20:42.511 { 00:20:42.511 "subsystem": "vmd", 00:20:42.511 "config": [] 00:20:42.511 }, 00:20:42.511 { 00:20:42.511 "subsystem": "accel", 00:20:42.511 "config": [ 00:20:42.511 { 00:20:42.511 "method": "accel_set_options", 00:20:42.512 "params": { 00:20:42.512 "small_cache_size": 128, 00:20:42.512 "large_cache_size": 16, 00:20:42.512 "task_count": 2048, 00:20:42.512 "sequence_count": 2048, 00:20:42.512 "buf_count": 2048 00:20:42.512 } 00:20:42.512 } 00:20:42.512 ] 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "subsystem": "bdev", 00:20:42.512 "config": [ 00:20:42.512 { 00:20:42.512 "method": "bdev_set_options", 00:20:42.512 "params": { 00:20:42.512 "bdev_io_pool_size": 65535, 00:20:42.512 "bdev_io_cache_size": 256, 00:20:42.512 "bdev_auto_examine": true, 00:20:42.512 "iobuf_small_cache_size": 128, 00:20:42.512 "iobuf_large_cache_size": 16 00:20:42.512 } 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "method": "bdev_raid_set_options", 00:20:42.512 "params": { 00:20:42.512 "process_window_size_kb": 1024 00:20:42.512 } 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "method": "bdev_iscsi_set_options", 00:20:42.512 "params": { 00:20:42.512 "timeout_sec": 30 00:20:42.512 } 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "method": "bdev_nvme_set_options", 00:20:42.512 "params": { 00:20:42.512 "action_on_timeout": "none", 00:20:42.512 "timeout_us": 0, 00:20:42.512 "timeout_admin_us": 0, 00:20:42.512 "keep_alive_timeout_ms": 10000, 00:20:42.512 "transport_retry_count": 4, 00:20:42.512 "arbitration_burst": 0, 00:20:42.512 "low_priority_weight": 0, 00:20:42.512 "medium_priority_weight": 0, 00:20:42.512 "high_priority_weight": 0, 00:20:42.512 "nvme_adminq_poll_period_us": 10000, 00:20:42.512 "nvme_ioq_poll_period_us": 0, 00:20:42.512 "io_queue_requests": 0, 00:20:42.512 "delay_cmd_submit": true, 00:20:42.512 "bdev_retry_count": 3, 00:20:42.512 "transport_ack_timeout": 0, 00:20:42.512 "ctrlr_loss_timeout_sec": 0, 00:20:42.512 "reconnect_delay_sec": 0, 00:20:42.512 "fast_io_fail_timeout_sec": 0, 00:20:42.512 "generate_uuids": false, 00:20:42.512 "transport_tos": 0, 00:20:42.512 "io_path_stat": false, 00:20:42.512 "allow_accel_sequence": false 00:20:42.512 } 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "method": "bdev_nvme_set_hotplug", 00:20:42.512 "params": { 00:20:42.512 "period_us": 100000, 00:20:42.512 "enable": false 00:20:42.512 } 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "method": "bdev_malloc_create", 00:20:42.512 "params": { 00:20:42.512 "name": "malloc0", 00:20:42.512 "num_blocks": 8192, 00:20:42.512 "block_size": 4096, 00:20:42.512 "physical_block_size": 4096, 00:20:42.512 "uuid": "20377044-4e30-4855-a71e-fe4a08dc54ae", 00:20:42.512 "optimal_io_boundary": 0 00:20:42.512 } 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "method": "bdev_wait_for_examine" 00:20:42.512 } 00:20:42.512 ] 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "subsystem": "nbd", 00:20:42.512 "config": [] 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "subsystem": "scheduler", 00:20:42.512 "config": [ 00:20:42.512 { 00:20:42.512 "method": "framework_set_scheduler", 00:20:42.512 "params": { 00:20:42.512 "name": "static" 00:20:42.512 } 00:20:42.512 } 00:20:42.512 ] 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "subsystem": "nvmf", 00:20:42.512 "config": [ 00:20:42.512 { 00:20:42.512 "method": "nvmf_set_config", 00:20:42.512 "params": { 00:20:42.512 "discovery_filter": "match_any", 00:20:42.512 "admin_cmd_passthru": { 00:20:42.512 "identify_ctrlr": false 00:20:42.512 } 00:20:42.512 } 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "method": "nvmf_set_max_subsystems", 00:20:42.512 "params": { 00:20:42.512 "max_subsystems": 1024 00:20:42.512 } 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "method": "nvmf_set_crdt", 00:20:42.512 "params": { 00:20:42.512 "crdt1": 0, 00:20:42.512 "crdt2": 0, 00:20:42.512 "crdt3": 0 00:20:42.512 } 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "method": "nvmf_create_transport", 00:20:42.512 "params": { 00:20:42.512 "trtype": "TCP", 00:20:42.512 "max_queue_depth": 128, 00:20:42.512 "max_io_qpairs_per_ctrlr": 127, 00:20:42.512 "in_capsule_data_size": 4096, 00:20:42.512 "max_io_size": 131072, 00:20:42.512 "io_unit_size": 131072, 00:20:42.512 "max_aq_depth": 128, 00:20:42.512 "num_shared_buffers": 511, 00:20:42.512 "buf_cache_size": 4294967295, 00:20:42.512 "dif_insert_or_strip": false, 00:20:42.512 "zcopy": false, 00:20:42.512 "c2h_success": false, 00:20:42.512 "sock_priority": 0, 00:20:42.512 "abort_timeout_sec": 1 00:20:42.512 } 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "method": "nvmf_create_subsystem", 00:20:42.512 "params": { 00:20:42.512 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:42.512 "allow_any_host": false, 00:20:42.512 "serial_number": "SPDK00000000000001", 00:20:42.512 "model_number": "SPDK bdev Controller", 00:20:42.512 "max_namespaces": 10, 00:20:42.512 "min_cntlid": 1, 00:20:42.512 "max_cntlid": 65519, 00:20:42.512 "ana_reporting": false 00:20:42.512 } 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "method": "nvmf_subsystem_add_host", 00:20:42.512 "params": { 00:20:42.512 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:42.512 "host": "nqn.2016-06.io.spdk:host1", 00:20:42.512 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:42.512 } 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "method": "nvmf_subsystem_add_ns", 00:20:42.512 "params": { 00:20:42.512 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:42.512 "namespace": { 00:20:42.512 "nsid": 1, 00:20:42.512 "bdev_name": "malloc0", 00:20:42.512 "nguid": "203770444E304855A71EFE4A08DC54AE", 00:20:42.512 "uuid": "20377044-4e30-4855-a71e-fe4a08dc54ae" 00:20:42.512 } 00:20:42.512 } 00:20:42.512 }, 00:20:42.512 { 00:20:42.512 "method": "nvmf_subsystem_add_listener", 00:20:42.513 "params": { 00:20:42.513 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:42.513 "listen_address": { 00:20:42.513 "trtype": "TCP", 00:20:42.513 "adrfam": "IPv4", 00:20:42.513 "traddr": "10.0.0.2", 00:20:42.513 "trsvcid": "4420" 00:20:42.513 }, 00:20:42.513 "secure_channel": true 00:20:42.513 } 00:20:42.513 } 00:20:42.513 ] 00:20:42.513 } 00:20:42.513 ] 00:20:42.513 }' 00:20:42.513 16:04:32 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:42.513 16:04:32 -- target/tls.sh@206 -- # bdevperfconf='{ 00:20:42.513 "subsystems": [ 00:20:42.513 { 00:20:42.513 "subsystem": "iobuf", 00:20:42.513 "config": [ 00:20:42.513 { 00:20:42.513 "method": "iobuf_set_options", 00:20:42.513 "params": { 00:20:42.513 "small_pool_count": 8192, 00:20:42.513 "large_pool_count": 1024, 00:20:42.513 "small_bufsize": 8192, 00:20:42.513 "large_bufsize": 135168 00:20:42.513 } 00:20:42.513 } 00:20:42.513 ] 00:20:42.513 }, 00:20:42.513 { 00:20:42.513 "subsystem": "sock", 00:20:42.513 "config": [ 00:20:42.513 { 00:20:42.513 "method": "sock_impl_set_options", 00:20:42.513 "params": { 00:20:42.513 "impl_name": "posix", 00:20:42.513 "recv_buf_size": 2097152, 00:20:42.513 "send_buf_size": 2097152, 00:20:42.513 "enable_recv_pipe": true, 00:20:42.513 "enable_quickack": false, 00:20:42.513 "enable_placement_id": 0, 00:20:42.513 "enable_zerocopy_send_server": true, 00:20:42.513 "enable_zerocopy_send_client": false, 00:20:42.513 "zerocopy_threshold": 0, 00:20:42.513 "tls_version": 0, 00:20:42.513 "enable_ktls": false 00:20:42.513 } 00:20:42.513 }, 00:20:42.513 { 00:20:42.513 "method": "sock_impl_set_options", 00:20:42.513 "params": { 00:20:42.513 "impl_name": "ssl", 00:20:42.513 "recv_buf_size": 4096, 00:20:42.513 "send_buf_size": 4096, 00:20:42.513 "enable_recv_pipe": true, 00:20:42.513 "enable_quickack": false, 00:20:42.513 "enable_placement_id": 0, 00:20:42.513 "enable_zerocopy_send_server": true, 00:20:42.513 "enable_zerocopy_send_client": false, 00:20:42.513 "zerocopy_threshold": 0, 00:20:42.513 "tls_version": 0, 00:20:42.513 "enable_ktls": false 00:20:42.513 } 00:20:42.513 } 00:20:42.513 ] 00:20:42.513 }, 00:20:42.513 { 00:20:42.513 "subsystem": "vmd", 00:20:42.513 "config": [] 00:20:42.513 }, 00:20:42.513 { 00:20:42.513 "subsystem": "accel", 00:20:42.513 "config": [ 00:20:42.513 { 00:20:42.513 "method": "accel_set_options", 00:20:42.513 "params": { 00:20:42.513 "small_cache_size": 128, 00:20:42.513 "large_cache_size": 16, 00:20:42.513 "task_count": 2048, 00:20:42.513 "sequence_count": 2048, 00:20:42.513 "buf_count": 2048 00:20:42.513 } 00:20:42.513 } 00:20:42.513 ] 00:20:42.513 }, 00:20:42.513 { 00:20:42.513 "subsystem": "bdev", 00:20:42.513 "config": [ 00:20:42.513 { 00:20:42.513 "method": "bdev_set_options", 00:20:42.513 "params": { 00:20:42.513 "bdev_io_pool_size": 65535, 00:20:42.513 "bdev_io_cache_size": 256, 00:20:42.513 "bdev_auto_examine": true, 00:20:42.513 "iobuf_small_cache_size": 128, 00:20:42.513 "iobuf_large_cache_size": 16 00:20:42.513 } 00:20:42.513 }, 00:20:42.513 { 00:20:42.513 "method": "bdev_raid_set_options", 00:20:42.513 "params": { 00:20:42.513 "process_window_size_kb": 1024 00:20:42.513 } 00:20:42.513 }, 00:20:42.513 { 00:20:42.513 "method": "bdev_iscsi_set_options", 00:20:42.513 "params": { 00:20:42.513 "timeout_sec": 30 00:20:42.513 } 00:20:42.513 }, 00:20:42.513 { 00:20:42.513 "method": "bdev_nvme_set_options", 00:20:42.513 "params": { 00:20:42.513 "action_on_timeout": "none", 00:20:42.513 "timeout_us": 0, 00:20:42.513 "timeout_admin_us": 0, 00:20:42.513 "keep_alive_timeout_ms": 10000, 00:20:42.513 "transport_retry_count": 4, 00:20:42.513 "arbitration_burst": 0, 00:20:42.513 "low_priority_weight": 0, 00:20:42.513 "medium_priority_weight": 0, 00:20:42.513 "high_priority_weight": 0, 00:20:42.513 "nvme_adminq_poll_period_us": 10000, 00:20:42.513 "nvme_ioq_poll_period_us": 0, 00:20:42.513 "io_queue_requests": 512, 00:20:42.513 "delay_cmd_submit": true, 00:20:42.513 "bdev_retry_count": 3, 00:20:42.513 "transport_ack_timeout": 0, 00:20:42.513 "ctrlr_loss_timeout_sec": 0, 00:20:42.513 "reconnect_delay_sec": 0, 00:20:42.513 "fast_io_fail_timeout_sec": 0, 00:20:42.513 "generate_uuids": false, 00:20:42.513 "transport_tos": 0, 00:20:42.513 "io_path_stat": false, 00:20:42.513 "allow_accel_sequence": false 00:20:42.513 } 00:20:42.513 }, 00:20:42.513 { 00:20:42.513 "method": "bdev_nvme_attach_controller", 00:20:42.513 "params": { 00:20:42.513 "name": "TLSTEST", 00:20:42.513 "trtype": "TCP", 00:20:42.513 "adrfam": "IPv4", 00:20:42.513 "traddr": "10.0.0.2", 00:20:42.513 "trsvcid": "4420", 00:20:42.513 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:42.513 "prchk_reftag": false, 00:20:42.513 "prchk_guard": false, 00:20:42.513 "ctrlr_loss_timeout_sec": 0, 00:20:42.513 "reconnect_delay_sec": 0, 00:20:42.513 "fast_io_fail_timeout_sec": 0, 00:20:42.513 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:42.513 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:42.513 "hdgst": false, 00:20:42.513 "ddgst": false 00:20:42.513 } 00:20:42.513 }, 00:20:42.513 { 00:20:42.513 "method": "bdev_nvme_set_hotplug", 00:20:42.513 "params": { 00:20:42.513 "period_us": 100000, 00:20:42.513 "enable": false 00:20:42.513 } 00:20:42.513 }, 00:20:42.513 { 00:20:42.513 "method": "bdev_wait_for_examine" 00:20:42.513 } 00:20:42.513 ] 00:20:42.513 }, 00:20:42.513 { 00:20:42.513 "subsystem": "nbd", 00:20:42.513 "config": [] 00:20:42.513 } 00:20:42.513 ] 00:20:42.513 }' 00:20:42.513 16:04:32 -- target/tls.sh@208 -- # killprocess 2449858 00:20:42.513 16:04:32 -- common/autotest_common.sh@926 -- # '[' -z 2449858 ']' 00:20:42.513 16:04:32 -- common/autotest_common.sh@930 -- # kill -0 2449858 00:20:42.772 16:04:32 -- common/autotest_common.sh@931 -- # uname 00:20:42.772 16:04:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:42.772 16:04:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2449858 00:20:42.772 16:04:32 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:42.772 16:04:32 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:42.772 16:04:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2449858' 00:20:42.772 killing process with pid 2449858 00:20:42.772 16:04:32 -- common/autotest_common.sh@945 -- # kill 2449858 00:20:42.772 Received shutdown signal, test time was about 10.000000 seconds 00:20:42.772 00:20:42.772 Latency(us) 00:20:42.772 [2024-10-30T15:04:32.648Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:42.772 [2024-10-30T15:04:32.648Z] =================================================================================================================== 00:20:42.772 [2024-10-30T15:04:32.648Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:42.772 16:04:32 -- common/autotest_common.sh@950 -- # wait 2449858 00:20:43.031 16:04:32 -- target/tls.sh@209 -- # killprocess 2449551 00:20:43.031 16:04:32 -- common/autotest_common.sh@926 -- # '[' -z 2449551 ']' 00:20:43.031 16:04:32 -- common/autotest_common.sh@930 -- # kill -0 2449551 00:20:43.031 16:04:32 -- common/autotest_common.sh@931 -- # uname 00:20:43.031 16:04:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:43.031 16:04:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2449551 00:20:43.031 16:04:32 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:43.031 16:04:32 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:43.031 16:04:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2449551' 00:20:43.031 killing process with pid 2449551 00:20:43.031 16:04:32 -- common/autotest_common.sh@945 -- # kill 2449551 00:20:43.031 16:04:32 -- common/autotest_common.sh@950 -- # wait 2449551 00:20:43.289 16:04:32 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:20:43.289 16:04:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:43.289 16:04:32 -- target/tls.sh@212 -- # echo '{ 00:20:43.289 "subsystems": [ 00:20:43.289 { 00:20:43.289 "subsystem": "iobuf", 00:20:43.289 "config": [ 00:20:43.289 { 00:20:43.289 "method": "iobuf_set_options", 00:20:43.289 "params": { 00:20:43.289 "small_pool_count": 8192, 00:20:43.289 "large_pool_count": 1024, 00:20:43.289 "small_bufsize": 8192, 00:20:43.289 "large_bufsize": 135168 00:20:43.289 } 00:20:43.289 } 00:20:43.289 ] 00:20:43.289 }, 00:20:43.289 { 00:20:43.289 "subsystem": "sock", 00:20:43.289 "config": [ 00:20:43.289 { 00:20:43.289 "method": "sock_impl_set_options", 00:20:43.289 "params": { 00:20:43.289 "impl_name": "posix", 00:20:43.289 "recv_buf_size": 2097152, 00:20:43.289 "send_buf_size": 2097152, 00:20:43.289 "enable_recv_pipe": true, 00:20:43.289 "enable_quickack": false, 00:20:43.289 "enable_placement_id": 0, 00:20:43.289 "enable_zerocopy_send_server": true, 00:20:43.289 "enable_zerocopy_send_client": false, 00:20:43.289 "zerocopy_threshold": 0, 00:20:43.289 "tls_version": 0, 00:20:43.289 "enable_ktls": false 00:20:43.289 } 00:20:43.289 }, 00:20:43.289 { 00:20:43.289 "method": "sock_impl_set_options", 00:20:43.289 "params": { 00:20:43.290 "impl_name": "ssl", 00:20:43.290 "recv_buf_size": 4096, 00:20:43.290 "send_buf_size": 4096, 00:20:43.290 "enable_recv_pipe": true, 00:20:43.290 "enable_quickack": false, 00:20:43.290 "enable_placement_id": 0, 00:20:43.290 "enable_zerocopy_send_server": true, 00:20:43.290 "enable_zerocopy_send_client": false, 00:20:43.290 "zerocopy_threshold": 0, 00:20:43.290 "tls_version": 0, 00:20:43.290 "enable_ktls": false 00:20:43.290 } 00:20:43.290 } 00:20:43.290 ] 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "subsystem": "vmd", 00:20:43.290 "config": [] 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "subsystem": "accel", 00:20:43.290 "config": [ 00:20:43.290 { 00:20:43.290 "method": "accel_set_options", 00:20:43.290 "params": { 00:20:43.290 "small_cache_size": 128, 00:20:43.290 "large_cache_size": 16, 00:20:43.290 "task_count": 2048, 00:20:43.290 "sequence_count": 2048, 00:20:43.290 "buf_count": 2048 00:20:43.290 } 00:20:43.290 } 00:20:43.290 ] 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "subsystem": "bdev", 00:20:43.290 "config": [ 00:20:43.290 { 00:20:43.290 "method": "bdev_set_options", 00:20:43.290 "params": { 00:20:43.290 "bdev_io_pool_size": 65535, 00:20:43.290 "bdev_io_cache_size": 256, 00:20:43.290 "bdev_auto_examine": true, 00:20:43.290 "iobuf_small_cache_size": 128, 00:20:43.290 "iobuf_large_cache_size": 16 00:20:43.290 } 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "method": "bdev_raid_set_options", 00:20:43.290 "params": { 00:20:43.290 "process_window_size_kb": 1024 00:20:43.290 } 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "method": "bdev_iscsi_set_options", 00:20:43.290 "params": { 00:20:43.290 "timeout_sec": 30 00:20:43.290 } 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "method": "bdev_nvme_set_options", 00:20:43.290 "params": { 00:20:43.290 "action_on_timeout": "none", 00:20:43.290 "timeout_us": 0, 00:20:43.290 "timeout_admin_us": 0, 00:20:43.290 "keep_alive_timeout_ms": 10000, 00:20:43.290 "transport_retry_count": 4, 00:20:43.290 "arbitration_burst": 0, 00:20:43.290 "low_priority_weight": 0, 00:20:43.290 "medium_priority_weight": 0, 00:20:43.290 "high_priority_weight": 0, 00:20:43.290 "nvme_adminq_poll_period_us": 10000, 00:20:43.290 "nvme_ioq_poll_period_us": 0, 00:20:43.290 "io_queue_requests": 0, 00:20:43.290 "delay_cmd_submit": true, 00:20:43.290 "bdev_retry_count": 3, 00:20:43.290 "transport_ack_timeout": 0, 00:20:43.290 "ctrlr_loss_timeout_sec": 0, 00:20:43.290 "reconnect_delay_sec": 0, 00:20:43.290 "fast_io_fail_timeout_sec": 0, 00:20:43.290 "generate_uuids": false, 00:20:43.290 "transport_tos": 0, 00:20:43.290 "io_path_stat": false, 00:20:43.290 "allow_accel_sequence": false 00:20:43.290 } 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "method": "bdev_nvme_set_hotplug", 00:20:43.290 "params": { 00:20:43.290 "period_us": 100000, 00:20:43.290 "enable": false 00:20:43.290 } 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "method": "bdev_malloc_create", 00:20:43.290 "params": { 00:20:43.290 "name": "malloc0", 00:20:43.290 "num_blocks": 8192, 00:20:43.290 "block_size": 4096, 00:20:43.290 "physical_block_size": 4096, 00:20:43.290 "uuid": "20377044-4e30-4855-a71e-fe4a08dc54ae", 00:20:43.290 "optimal_io_boundary": 0 00:20:43.290 } 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "method": "bdev_wait_for_examine" 00:20:43.290 } 00:20:43.290 ] 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "subsystem": "nbd", 00:20:43.290 "config": [] 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "subsystem": "scheduler", 00:20:43.290 "config": [ 00:20:43.290 { 00:20:43.290 "method": "framework_set_scheduler", 00:20:43.290 "params": { 00:20:43.290 "name": "static" 00:20:43.290 } 00:20:43.290 } 00:20:43.290 ] 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "subsystem": "nvmf", 00:20:43.290 "config": [ 00:20:43.290 { 00:20:43.290 "method": "nvmf_set_config", 00:20:43.290 "params": { 00:20:43.290 "discovery_filter": "match_any", 00:20:43.290 "admin_cmd_passthru": { 00:20:43.290 "identify_ctrlr": false 00:20:43.290 } 00:20:43.290 } 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "method": "nvmf_set_max_subsystems", 00:20:43.290 "params": { 00:20:43.290 "max_subsystems": 1024 00:20:43.290 } 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "method": "nvmf_set_crdt", 00:20:43.290 "params": { 00:20:43.290 "crdt1": 0, 00:20:43.290 "crdt2": 0, 00:20:43.290 "crdt3": 0 00:20:43.290 } 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "method": "nvmf_create_transport", 00:20:43.290 "params": { 00:20:43.290 "trtype": "TCP", 00:20:43.290 "max_queue_depth": 128, 00:20:43.290 "max_io_qpairs_per_ctrlr": 127, 00:20:43.290 "in_capsule_data_size": 4096, 00:20:43.290 "max_io_size": 131072, 00:20:43.290 "io_unit_size": 131072, 00:20:43.290 "max_aq_depth": 128, 00:20:43.290 "num_shared_buffers": 511, 00:20:43.290 "buf_cache_size": 4294967295, 00:20:43.290 "dif_insert_or_strip": false, 00:20:43.290 "zcopy": false, 00:20:43.290 "c2h_success": false, 00:20:43.290 "sock_priority": 0, 00:20:43.290 "abort_timeout_sec": 1 00:20:43.290 } 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "method": "nvmf_create_subsystem", 00:20:43.290 "params": { 00:20:43.290 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:43.290 "allow_any_host": false, 00:20:43.290 "serial_number": "SPDK00000000000001", 00:20:43.290 "model_number": "SPDK bdev Controller", 00:20:43.290 "max_namespaces": 10, 00:20:43.290 "min_cntlid": 1, 00:20:43.290 "max_cntlid": 65519, 00:20:43.290 "ana_reporting": false 00:20:43.290 } 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "method": "nvmf_subsystem_add_host", 00:20:43.290 "params": { 00:20:43.290 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:43.290 "host": "nqn.2016-06.io.spdk:host1", 00:20:43.290 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:43.290 } 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "method": "nvmf_subsystem_add_ns", 00:20:43.290 "params": { 00:20:43.290 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:43.290 "namespace": { 00:20:43.290 "nsid": 1, 00:20:43.290 "bdev_name": "malloc0", 00:20:43.290 "nguid": "203770444E304855A71EFE4A08DC54AE", 00:20:43.290 "uuid": "20377044-4e30-4855-a71e-fe4a08dc54ae" 00:20:43.290 } 00:20:43.290 } 00:20:43.290 }, 00:20:43.290 { 00:20:43.290 "method": "nvmf_subsystem_add_listener", 00:20:43.290 "params": { 00:20:43.290 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:43.290 "listen_address": { 00:20:43.290 "trtype": "TCP", 00:20:43.290 "adrfam": "IPv4", 00:20:43.290 "traddr": "10.0.0.2", 00:20:43.290 "trsvcid": "4420" 00:20:43.290 }, 00:20:43.290 "secure_channel": true 00:20:43.290 } 00:20:43.290 } 00:20:43.290 ] 00:20:43.290 } 00:20:43.290 ] 00:20:43.290 }' 00:20:43.290 16:04:32 -- common/autotest_common.sh@712 -- # xtrace_disable 00:20:43.290 16:04:32 -- common/autotest_common.sh@10 -- # set +x 00:20:43.290 16:04:32 -- nvmf/common.sh@469 -- # nvmfpid=2450268 00:20:43.290 16:04:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:20:43.290 16:04:32 -- nvmf/common.sh@470 -- # waitforlisten 2450268 00:20:43.290 16:04:32 -- common/autotest_common.sh@819 -- # '[' -z 2450268 ']' 00:20:43.290 16:04:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:43.290 16:04:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:43.290 16:04:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:43.290 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:43.290 16:04:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:43.290 16:04:32 -- common/autotest_common.sh@10 -- # set +x 00:20:43.290 [2024-10-30 16:04:32.986010] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:20:43.290 [2024-10-30 16:04:32.986094] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:43.290 EAL: No free 2048 kB hugepages reported on node 1 00:20:43.291 [2024-10-30 16:04:33.052074] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:43.291 [2024-10-30 16:04:33.139348] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:43.291 [2024-10-30 16:04:33.139492] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:43.291 [2024-10-30 16:04:33.139509] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:43.291 [2024-10-30 16:04:33.139521] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:43.291 [2024-10-30 16:04:33.139548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:43.548 [2024-10-30 16:04:33.359576] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:43.548 [2024-10-30 16:04:33.391600] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:43.548 [2024-10-30 16:04:33.391871] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:44.117 16:04:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:44.117 16:04:33 -- common/autotest_common.sh@852 -- # return 0 00:20:44.117 16:04:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:44.117 16:04:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:20:44.117 16:04:33 -- common/autotest_common.sh@10 -- # set +x 00:20:44.117 16:04:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:44.117 16:04:33 -- target/tls.sh@216 -- # bdevperf_pid=2450345 00:20:44.117 16:04:33 -- target/tls.sh@217 -- # waitforlisten 2450345 /var/tmp/bdevperf.sock 00:20:44.117 16:04:33 -- common/autotest_common.sh@819 -- # '[' -z 2450345 ']' 00:20:44.117 16:04:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:44.117 16:04:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:20:44.117 16:04:33 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:20:44.117 16:04:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:44.117 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:44.117 16:04:33 -- target/tls.sh@213 -- # echo '{ 00:20:44.117 "subsystems": [ 00:20:44.117 { 00:20:44.117 "subsystem": "iobuf", 00:20:44.117 "config": [ 00:20:44.117 { 00:20:44.117 "method": "iobuf_set_options", 00:20:44.117 "params": { 00:20:44.117 "small_pool_count": 8192, 00:20:44.117 "large_pool_count": 1024, 00:20:44.117 "small_bufsize": 8192, 00:20:44.117 "large_bufsize": 135168 00:20:44.117 } 00:20:44.117 } 00:20:44.117 ] 00:20:44.117 }, 00:20:44.117 { 00:20:44.117 "subsystem": "sock", 00:20:44.117 "config": [ 00:20:44.117 { 00:20:44.117 "method": "sock_impl_set_options", 00:20:44.117 "params": { 00:20:44.117 "impl_name": "posix", 00:20:44.117 "recv_buf_size": 2097152, 00:20:44.117 "send_buf_size": 2097152, 00:20:44.117 "enable_recv_pipe": true, 00:20:44.117 "enable_quickack": false, 00:20:44.117 "enable_placement_id": 0, 00:20:44.117 "enable_zerocopy_send_server": true, 00:20:44.117 "enable_zerocopy_send_client": false, 00:20:44.117 "zerocopy_threshold": 0, 00:20:44.117 "tls_version": 0, 00:20:44.117 "enable_ktls": false 00:20:44.117 } 00:20:44.117 }, 00:20:44.117 { 00:20:44.117 "method": "sock_impl_set_options", 00:20:44.117 "params": { 00:20:44.117 "impl_name": "ssl", 00:20:44.117 "recv_buf_size": 4096, 00:20:44.117 "send_buf_size": 4096, 00:20:44.117 "enable_recv_pipe": true, 00:20:44.117 "enable_quickack": false, 00:20:44.117 "enable_placement_id": 0, 00:20:44.117 "enable_zerocopy_send_server": true, 00:20:44.117 "enable_zerocopy_send_client": false, 00:20:44.117 "zerocopy_threshold": 0, 00:20:44.117 "tls_version": 0, 00:20:44.117 "enable_ktls": false 00:20:44.117 } 00:20:44.117 } 00:20:44.117 ] 00:20:44.117 }, 00:20:44.117 { 00:20:44.117 "subsystem": "vmd", 00:20:44.117 "config": [] 00:20:44.117 }, 00:20:44.117 { 00:20:44.117 "subsystem": "accel", 00:20:44.117 "config": [ 00:20:44.117 { 00:20:44.117 "method": "accel_set_options", 00:20:44.117 "params": { 00:20:44.117 "small_cache_size": 128, 00:20:44.117 "large_cache_size": 16, 00:20:44.117 "task_count": 2048, 00:20:44.117 "sequence_count": 2048, 00:20:44.117 "buf_count": 2048 00:20:44.117 } 00:20:44.117 } 00:20:44.117 ] 00:20:44.117 }, 00:20:44.117 { 00:20:44.117 "subsystem": "bdev", 00:20:44.117 "config": [ 00:20:44.117 { 00:20:44.117 "method": "bdev_set_options", 00:20:44.117 "params": { 00:20:44.117 "bdev_io_pool_size": 65535, 00:20:44.117 "bdev_io_cache_size": 256, 00:20:44.117 "bdev_auto_examine": true, 00:20:44.117 "iobuf_small_cache_size": 128, 00:20:44.117 "iobuf_large_cache_size": 16 00:20:44.117 } 00:20:44.117 }, 00:20:44.117 { 00:20:44.117 "method": "bdev_raid_set_options", 00:20:44.117 "params": { 00:20:44.117 "process_window_size_kb": 1024 00:20:44.117 } 00:20:44.117 }, 00:20:44.117 { 00:20:44.117 "method": "bdev_iscsi_set_options", 00:20:44.117 "params": { 00:20:44.117 "timeout_sec": 30 00:20:44.117 } 00:20:44.117 }, 00:20:44.117 { 00:20:44.117 "method": "bdev_nvme_set_options", 00:20:44.117 "params": { 00:20:44.117 "action_on_timeout": "none", 00:20:44.117 "timeout_us": 0, 00:20:44.117 "timeout_admin_us": 0, 00:20:44.117 "keep_alive_timeout_ms": 10000, 00:20:44.117 "transport_retry_count": 4, 00:20:44.117 "arbitration_burst": 0, 00:20:44.117 "low_priority_weight": 0, 00:20:44.117 "medium_priority_weight": 0, 00:20:44.117 "high_priority_weight": 0, 00:20:44.117 "nvme_adminq_poll_period_us": 10000, 00:20:44.117 "nvme_ioq_poll_period_us": 0, 00:20:44.117 "io_queue_requests": 512, 00:20:44.117 "delay_cmd_submit": true, 00:20:44.117 "bdev_retry_count": 3, 00:20:44.117 "transport_ack_timeout": 0, 00:20:44.117 "ctrlr_loss_timeout_sec": 0, 00:20:44.117 "reconnect_delay_sec": 0, 00:20:44.117 "fast_io_fail_timeout_sec": 0, 00:20:44.117 "generate_uuids": false, 00:20:44.117 "transport_tos": 0, 00:20:44.117 "io_path_stat": false, 00:20:44.117 "allow_accel_sequence": false 00:20:44.117 } 00:20:44.117 }, 00:20:44.117 { 00:20:44.117 "method": "bdev_nvme_attach_controller", 00:20:44.117 "params": { 00:20:44.117 "name": "TLSTEST", 00:20:44.117 "trtype": "TCP", 00:20:44.117 "adrfam": "IPv4", 00:20:44.117 "traddr": "10.0.0.2", 00:20:44.117 "trsvcid": "4420", 00:20:44.117 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:44.117 "prchk_reftag": false, 00:20:44.117 "prchk_guard": false, 00:20:44.117 "ctrlr_loss_timeout_sec": 0, 00:20:44.117 "reconnect_delay_sec": 0, 00:20:44.117 "fast_io_fail_timeout_sec": 0, 00:20:44.117 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:44.117 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:44.117 "hdgst": false, 00:20:44.117 "ddgst": false 00:20:44.117 } 00:20:44.117 }, 00:20:44.117 { 00:20:44.117 "method": "bdev_nvme_set_hotplug", 00:20:44.117 "params": { 00:20:44.117 "period_us": 100000, 00:20:44.117 "enable": false 00:20:44.117 } 00:20:44.117 }, 00:20:44.117 { 00:20:44.117 "method": "bdev_wait_for_examine" 00:20:44.117 } 00:20:44.117 ] 00:20:44.117 }, 00:20:44.117 { 00:20:44.117 "subsystem": "nbd", 00:20:44.117 "config": [] 00:20:44.117 } 00:20:44.117 ] 00:20:44.117 }' 00:20:44.117 16:04:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:20:44.117 16:04:33 -- common/autotest_common.sh@10 -- # set +x 00:20:44.378 [2024-10-30 16:04:34.014264] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:20:44.378 [2024-10-30 16:04:34.014342] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2450345 ] 00:20:44.378 EAL: No free 2048 kB hugepages reported on node 1 00:20:44.378 [2024-10-30 16:04:34.073170] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:44.378 [2024-10-30 16:04:34.154541] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:44.639 [2024-10-30 16:04:34.314180] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:45.207 16:04:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:20:45.207 16:04:34 -- common/autotest_common.sh@852 -- # return 0 00:20:45.207 16:04:34 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:45.207 Running I/O for 10 seconds... 00:20:57.430 00:20:57.430 Latency(us) 00:20:57.430 [2024-10-30T15:04:47.306Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:57.430 [2024-10-30T15:04:47.306Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:57.430 Verification LBA range: start 0x0 length 0x2000 00:20:57.430 TLSTESTn1 : 10.02 4599.76 17.97 0.00 0.00 27786.63 7815.77 75342.13 00:20:57.430 [2024-10-30T15:04:47.306Z] =================================================================================================================== 00:20:57.430 [2024-10-30T15:04:47.306Z] Total : 4599.76 17.97 0.00 0.00 27786.63 7815.77 75342.13 00:20:57.430 0 00:20:57.430 16:04:45 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:57.430 16:04:45 -- target/tls.sh@223 -- # killprocess 2450345 00:20:57.430 16:04:45 -- common/autotest_common.sh@926 -- # '[' -z 2450345 ']' 00:20:57.430 16:04:45 -- common/autotest_common.sh@930 -- # kill -0 2450345 00:20:57.430 16:04:45 -- common/autotest_common.sh@931 -- # uname 00:20:57.430 16:04:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:57.430 16:04:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2450345 00:20:57.430 16:04:45 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:20:57.430 16:04:45 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:20:57.430 16:04:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2450345' 00:20:57.430 killing process with pid 2450345 00:20:57.430 16:04:45 -- common/autotest_common.sh@945 -- # kill 2450345 00:20:57.430 Received shutdown signal, test time was about 10.000000 seconds 00:20:57.430 00:20:57.430 Latency(us) 00:20:57.430 [2024-10-30T15:04:47.306Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:57.430 [2024-10-30T15:04:47.306Z] =================================================================================================================== 00:20:57.430 [2024-10-30T15:04:47.306Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:57.430 16:04:45 -- common/autotest_common.sh@950 -- # wait 2450345 00:20:57.430 16:04:45 -- target/tls.sh@224 -- # killprocess 2450268 00:20:57.430 16:04:45 -- common/autotest_common.sh@926 -- # '[' -z 2450268 ']' 00:20:57.430 16:04:45 -- common/autotest_common.sh@930 -- # kill -0 2450268 00:20:57.430 16:04:45 -- common/autotest_common.sh@931 -- # uname 00:20:57.430 16:04:45 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:20:57.430 16:04:45 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2450268 00:20:57.430 16:04:45 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:20:57.430 16:04:45 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:20:57.430 16:04:45 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2450268' 00:20:57.430 killing process with pid 2450268 00:20:57.430 16:04:45 -- common/autotest_common.sh@945 -- # kill 2450268 00:20:57.430 16:04:45 -- common/autotest_common.sh@950 -- # wait 2450268 00:20:57.430 16:04:45 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:20:57.430 16:04:45 -- target/tls.sh@227 -- # cleanup 00:20:57.430 16:04:45 -- target/tls.sh@15 -- # process_shm --id 0 00:20:57.430 16:04:45 -- common/autotest_common.sh@796 -- # type=--id 00:20:57.430 16:04:45 -- common/autotest_common.sh@797 -- # id=0 00:20:57.430 16:04:45 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:20:57.430 16:04:45 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:20:57.430 16:04:45 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:20:57.430 16:04:45 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:20:57.430 16:04:45 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:20:57.430 16:04:45 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:20:57.430 nvmf_trace.0 00:20:57.430 16:04:45 -- common/autotest_common.sh@811 -- # return 0 00:20:57.430 16:04:45 -- target/tls.sh@16 -- # killprocess 2450345 00:20:57.430 16:04:45 -- common/autotest_common.sh@926 -- # '[' -z 2450345 ']' 00:20:57.430 16:04:45 -- common/autotest_common.sh@930 -- # kill -0 2450345 00:20:57.430 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2450345) - No such process 00:20:57.430 16:04:45 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2450345 is not found' 00:20:57.430 Process with pid 2450345 is not found 00:20:57.430 16:04:45 -- target/tls.sh@17 -- # nvmftestfini 00:20:57.430 16:04:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:57.430 16:04:45 -- nvmf/common.sh@116 -- # sync 00:20:57.430 16:04:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:57.430 16:04:45 -- nvmf/common.sh@119 -- # set +e 00:20:57.430 16:04:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:57.430 16:04:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:57.430 rmmod nvme_tcp 00:20:57.430 rmmod nvme_fabrics 00:20:57.430 rmmod nvme_keyring 00:20:57.430 16:04:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:57.430 16:04:45 -- nvmf/common.sh@123 -- # set -e 00:20:57.430 16:04:45 -- nvmf/common.sh@124 -- # return 0 00:20:57.430 16:04:45 -- nvmf/common.sh@477 -- # '[' -n 2450268 ']' 00:20:57.430 16:04:45 -- nvmf/common.sh@478 -- # killprocess 2450268 00:20:57.430 16:04:45 -- common/autotest_common.sh@926 -- # '[' -z 2450268 ']' 00:20:57.430 16:04:45 -- common/autotest_common.sh@930 -- # kill -0 2450268 00:20:57.430 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2450268) - No such process 00:20:57.430 16:04:45 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2450268 is not found' 00:20:57.430 Process with pid 2450268 is not found 00:20:57.430 16:04:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:57.430 16:04:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:57.430 16:04:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:57.430 16:04:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:57.430 16:04:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:57.430 16:04:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:57.430 16:04:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:57.430 16:04:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:58.001 16:04:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:58.001 16:04:47 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:58.001 00:20:58.001 real 1m15.176s 00:20:58.001 user 2m0.276s 00:20:58.001 sys 0m23.276s 00:20:58.001 16:04:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:20:58.001 16:04:47 -- common/autotest_common.sh@10 -- # set +x 00:20:58.001 ************************************ 00:20:58.001 END TEST nvmf_tls 00:20:58.001 ************************************ 00:20:58.001 16:04:47 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:20:58.001 16:04:47 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:20:58.001 16:04:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:20:58.001 16:04:47 -- common/autotest_common.sh@10 -- # set +x 00:20:58.001 ************************************ 00:20:58.001 START TEST nvmf_fips 00:20:58.001 ************************************ 00:20:58.001 16:04:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:20:58.261 * Looking for test storage... 00:20:58.261 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:20:58.261 16:04:47 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:58.261 16:04:47 -- nvmf/common.sh@7 -- # uname -s 00:20:58.261 16:04:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:58.261 16:04:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:58.261 16:04:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:58.261 16:04:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:58.261 16:04:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:58.261 16:04:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:58.261 16:04:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:58.261 16:04:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:58.261 16:04:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:58.261 16:04:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:58.261 16:04:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:58.261 16:04:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:58.261 16:04:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:58.261 16:04:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:58.261 16:04:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:58.261 16:04:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:58.261 16:04:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:58.261 16:04:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:58.261 16:04:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:58.261 16:04:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:58.261 16:04:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:58.261 16:04:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:58.261 16:04:47 -- paths/export.sh@5 -- # export PATH 00:20:58.261 16:04:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:58.261 16:04:47 -- nvmf/common.sh@46 -- # : 0 00:20:58.261 16:04:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:58.261 16:04:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:58.261 16:04:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:58.261 16:04:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:58.261 16:04:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:58.261 16:04:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:58.261 16:04:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:58.261 16:04:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:58.262 16:04:47 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:58.262 16:04:47 -- fips/fips.sh@89 -- # check_openssl_version 00:20:58.262 16:04:47 -- fips/fips.sh@83 -- # local target=3.0.0 00:20:58.262 16:04:47 -- fips/fips.sh@85 -- # openssl version 00:20:58.262 16:04:47 -- fips/fips.sh@85 -- # awk '{print $2}' 00:20:58.262 16:04:47 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:20:58.262 16:04:47 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:20:58.262 16:04:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:58.262 16:04:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:58.262 16:04:47 -- scripts/common.sh@335 -- # IFS=.-: 00:20:58.262 16:04:47 -- scripts/common.sh@335 -- # read -ra ver1 00:20:58.262 16:04:47 -- scripts/common.sh@336 -- # IFS=.-: 00:20:58.262 16:04:47 -- scripts/common.sh@336 -- # read -ra ver2 00:20:58.262 16:04:47 -- scripts/common.sh@337 -- # local 'op=>=' 00:20:58.262 16:04:47 -- scripts/common.sh@339 -- # ver1_l=3 00:20:58.262 16:04:47 -- scripts/common.sh@340 -- # ver2_l=3 00:20:58.262 16:04:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:58.262 16:04:47 -- scripts/common.sh@343 -- # case "$op" in 00:20:58.262 16:04:47 -- scripts/common.sh@347 -- # : 1 00:20:58.262 16:04:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:58.262 16:04:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:58.262 16:04:47 -- scripts/common.sh@364 -- # decimal 3 00:20:58.262 16:04:47 -- scripts/common.sh@352 -- # local d=3 00:20:58.262 16:04:47 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:20:58.262 16:04:47 -- scripts/common.sh@354 -- # echo 3 00:20:58.262 16:04:47 -- scripts/common.sh@364 -- # ver1[v]=3 00:20:58.262 16:04:47 -- scripts/common.sh@365 -- # decimal 3 00:20:58.262 16:04:47 -- scripts/common.sh@352 -- # local d=3 00:20:58.262 16:04:47 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:20:58.262 16:04:47 -- scripts/common.sh@354 -- # echo 3 00:20:58.262 16:04:47 -- scripts/common.sh@365 -- # ver2[v]=3 00:20:58.262 16:04:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:58.262 16:04:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:58.262 16:04:47 -- scripts/common.sh@363 -- # (( v++ )) 00:20:58.262 16:04:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:58.262 16:04:47 -- scripts/common.sh@364 -- # decimal 1 00:20:58.262 16:04:47 -- scripts/common.sh@352 -- # local d=1 00:20:58.262 16:04:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:58.262 16:04:47 -- scripts/common.sh@354 -- # echo 1 00:20:58.262 16:04:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:58.262 16:04:47 -- scripts/common.sh@365 -- # decimal 0 00:20:58.262 16:04:47 -- scripts/common.sh@352 -- # local d=0 00:20:58.262 16:04:47 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:20:58.262 16:04:47 -- scripts/common.sh@354 -- # echo 0 00:20:58.262 16:04:47 -- scripts/common.sh@365 -- # ver2[v]=0 00:20:58.262 16:04:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:58.262 16:04:47 -- scripts/common.sh@366 -- # return 0 00:20:58.262 16:04:47 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:20:58.262 16:04:47 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:20:58.262 16:04:47 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:20:58.262 16:04:47 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:20:58.262 16:04:47 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:20:58.262 16:04:47 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:20:58.262 16:04:47 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:20:58.262 16:04:47 -- fips/fips.sh@113 -- # build_openssl_config 00:20:58.262 16:04:47 -- fips/fips.sh@37 -- # cat 00:20:58.262 16:04:47 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:20:58.262 16:04:47 -- fips/fips.sh@58 -- # cat - 00:20:58.262 16:04:47 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:20:58.262 16:04:47 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:20:58.262 16:04:47 -- fips/fips.sh@116 -- # mapfile -t providers 00:20:58.262 16:04:47 -- fips/fips.sh@116 -- # openssl list -providers 00:20:58.262 16:04:47 -- fips/fips.sh@116 -- # grep name 00:20:58.262 16:04:47 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:20:58.262 16:04:47 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:20:58.262 16:04:47 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:20:58.262 16:04:47 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:20:58.262 16:04:47 -- fips/fips.sh@127 -- # : 00:20:58.262 16:04:47 -- common/autotest_common.sh@640 -- # local es=0 00:20:58.262 16:04:47 -- common/autotest_common.sh@642 -- # valid_exec_arg openssl md5 /dev/fd/62 00:20:58.262 16:04:47 -- common/autotest_common.sh@628 -- # local arg=openssl 00:20:58.262 16:04:47 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:58.262 16:04:47 -- common/autotest_common.sh@632 -- # type -t openssl 00:20:58.262 16:04:47 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:58.262 16:04:47 -- common/autotest_common.sh@634 -- # type -P openssl 00:20:58.262 16:04:47 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:20:58.262 16:04:47 -- common/autotest_common.sh@634 -- # arg=/usr/bin/openssl 00:20:58.262 16:04:47 -- common/autotest_common.sh@634 -- # [[ -x /usr/bin/openssl ]] 00:20:58.262 16:04:47 -- common/autotest_common.sh@643 -- # openssl md5 /dev/fd/62 00:20:58.262 Error setting digest 00:20:58.262 40F206E5297F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:20:58.262 40F206E5297F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:20:58.262 16:04:48 -- common/autotest_common.sh@643 -- # es=1 00:20:58.262 16:04:48 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:20:58.262 16:04:48 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:20:58.262 16:04:48 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:20:58.262 16:04:48 -- fips/fips.sh@130 -- # nvmftestinit 00:20:58.262 16:04:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:58.262 16:04:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:58.262 16:04:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:58.262 16:04:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:58.262 16:04:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:58.262 16:04:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:58.262 16:04:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:58.262 16:04:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:58.262 16:04:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:58.262 16:04:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:58.262 16:04:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:58.262 16:04:48 -- common/autotest_common.sh@10 -- # set +x 00:21:00.173 16:04:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:00.173 16:04:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:00.173 16:04:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:00.173 16:04:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:00.173 16:04:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:00.173 16:04:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:00.173 16:04:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:00.173 16:04:50 -- nvmf/common.sh@294 -- # net_devs=() 00:21:00.173 16:04:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:00.173 16:04:50 -- nvmf/common.sh@295 -- # e810=() 00:21:00.173 16:04:50 -- nvmf/common.sh@295 -- # local -ga e810 00:21:00.173 16:04:50 -- nvmf/common.sh@296 -- # x722=() 00:21:00.173 16:04:50 -- nvmf/common.sh@296 -- # local -ga x722 00:21:00.173 16:04:50 -- nvmf/common.sh@297 -- # mlx=() 00:21:00.173 16:04:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:00.174 16:04:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:00.174 16:04:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:00.174 16:04:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:00.174 16:04:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:00.174 16:04:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:00.174 16:04:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:00.174 16:04:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:00.174 16:04:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:00.174 16:04:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:00.174 16:04:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:00.174 16:04:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:00.174 16:04:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:00.174 16:04:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:00.174 16:04:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:00.174 16:04:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:00.174 16:04:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:00.174 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:00.174 16:04:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:00.174 16:04:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:00.174 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:00.174 16:04:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:00.174 16:04:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:00.174 16:04:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:00.174 16:04:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:00.174 16:04:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:00.174 16:04:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:00.174 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:00.174 16:04:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:00.174 16:04:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:00.174 16:04:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:00.174 16:04:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:00.174 16:04:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:00.174 16:04:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:00.174 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:00.174 16:04:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:00.174 16:04:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:00.174 16:04:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:00.174 16:04:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:00.174 16:04:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:00.174 16:04:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:00.174 16:04:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:00.174 16:04:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:00.174 16:04:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:00.174 16:04:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:00.174 16:04:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:00.174 16:04:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:00.174 16:04:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:00.174 16:04:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:00.174 16:04:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:00.435 16:04:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:00.435 16:04:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:00.435 16:04:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:00.435 16:04:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:00.435 16:04:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:00.435 16:04:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:00.435 16:04:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:00.435 16:04:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:00.435 16:04:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:00.435 16:04:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:00.435 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:00.435 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:21:00.435 00:21:00.435 --- 10.0.0.2 ping statistics --- 00:21:00.435 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:00.435 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:21:00.435 16:04:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:00.435 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:00.435 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.147 ms 00:21:00.435 00:21:00.435 --- 10.0.0.1 ping statistics --- 00:21:00.435 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:00.435 rtt min/avg/max/mdev = 0.147/0.147/0.147/0.000 ms 00:21:00.435 16:04:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:00.435 16:04:50 -- nvmf/common.sh@410 -- # return 0 00:21:00.435 16:04:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:00.435 16:04:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:00.435 16:04:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:00.435 16:04:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:00.435 16:04:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:00.435 16:04:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:00.435 16:04:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:00.435 16:04:50 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:21:00.435 16:04:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:00.435 16:04:50 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:00.435 16:04:50 -- common/autotest_common.sh@10 -- # set +x 00:21:00.435 16:04:50 -- nvmf/common.sh@469 -- # nvmfpid=2453754 00:21:00.435 16:04:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:00.435 16:04:50 -- nvmf/common.sh@470 -- # waitforlisten 2453754 00:21:00.435 16:04:50 -- common/autotest_common.sh@819 -- # '[' -z 2453754 ']' 00:21:00.435 16:04:50 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:00.435 16:04:50 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:00.435 16:04:50 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:00.435 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:00.435 16:04:50 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:00.435 16:04:50 -- common/autotest_common.sh@10 -- # set +x 00:21:00.435 [2024-10-30 16:04:50.283563] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:21:00.435 [2024-10-30 16:04:50.283682] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:00.696 EAL: No free 2048 kB hugepages reported on node 1 00:21:00.696 [2024-10-30 16:04:50.353617] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:00.696 [2024-10-30 16:04:50.441841] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:00.696 [2024-10-30 16:04:50.441984] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:00.696 [2024-10-30 16:04:50.441999] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:00.696 [2024-10-30 16:04:50.442019] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:00.696 [2024-10-30 16:04:50.442059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:01.637 16:04:51 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:01.637 16:04:51 -- common/autotest_common.sh@852 -- # return 0 00:21:01.637 16:04:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:01.637 16:04:51 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:01.637 16:04:51 -- common/autotest_common.sh@10 -- # set +x 00:21:01.637 16:04:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:01.637 16:04:51 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:21:01.637 16:04:51 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:01.637 16:04:51 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:01.637 16:04:51 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:01.637 16:04:51 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:01.637 16:04:51 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:01.637 16:04:51 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:01.637 16:04:51 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:01.897 [2024-10-30 16:04:51.559723] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:01.897 [2024-10-30 16:04:51.575682] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:01.897 [2024-10-30 16:04:51.575897] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:01.897 malloc0 00:21:01.897 16:04:51 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:01.897 16:04:51 -- fips/fips.sh@147 -- # bdevperf_pid=2453919 00:21:01.897 16:04:51 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:01.897 16:04:51 -- fips/fips.sh@148 -- # waitforlisten 2453919 /var/tmp/bdevperf.sock 00:21:01.897 16:04:51 -- common/autotest_common.sh@819 -- # '[' -z 2453919 ']' 00:21:01.897 16:04:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:01.897 16:04:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:01.897 16:04:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:01.897 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:01.897 16:04:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:01.897 16:04:51 -- common/autotest_common.sh@10 -- # set +x 00:21:01.897 [2024-10-30 16:04:51.696312] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:21:01.897 [2024-10-30 16:04:51.696410] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2453919 ] 00:21:01.897 EAL: No free 2048 kB hugepages reported on node 1 00:21:01.897 [2024-10-30 16:04:51.756263] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:02.158 [2024-10-30 16:04:51.838058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:03.096 16:04:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:03.096 16:04:52 -- common/autotest_common.sh@852 -- # return 0 00:21:03.096 16:04:52 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:03.096 [2024-10-30 16:04:52.959080] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:03.356 TLSTESTn1 00:21:03.356 16:04:53 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:03.356 Running I/O for 10 seconds... 00:21:13.358 00:21:13.359 Latency(us) 00:21:13.359 [2024-10-30T15:05:03.235Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:13.359 [2024-10-30T15:05:03.235Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:13.359 Verification LBA range: start 0x0 length 0x2000 00:21:13.359 TLSTESTn1 : 10.02 4588.08 17.92 0.00 0.00 27857.55 5194.33 41166.32 00:21:13.359 [2024-10-30T15:05:03.235Z] =================================================================================================================== 00:21:13.359 [2024-10-30T15:05:03.235Z] Total : 4588.08 17.92 0.00 0.00 27857.55 5194.33 41166.32 00:21:13.359 0 00:21:13.359 16:05:03 -- fips/fips.sh@1 -- # cleanup 00:21:13.359 16:05:03 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:13.359 16:05:03 -- common/autotest_common.sh@796 -- # type=--id 00:21:13.359 16:05:03 -- common/autotest_common.sh@797 -- # id=0 00:21:13.359 16:05:03 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:21:13.359 16:05:03 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:13.359 16:05:03 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:21:13.359 16:05:03 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:21:13.359 16:05:03 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:21:13.359 16:05:03 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:13.644 nvmf_trace.0 00:21:13.644 16:05:03 -- common/autotest_common.sh@811 -- # return 0 00:21:13.644 16:05:03 -- fips/fips.sh@16 -- # killprocess 2453919 00:21:13.644 16:05:03 -- common/autotest_common.sh@926 -- # '[' -z 2453919 ']' 00:21:13.644 16:05:03 -- common/autotest_common.sh@930 -- # kill -0 2453919 00:21:13.644 16:05:03 -- common/autotest_common.sh@931 -- # uname 00:21:13.644 16:05:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:13.644 16:05:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2453919 00:21:13.644 16:05:03 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:21:13.644 16:05:03 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:21:13.644 16:05:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2453919' 00:21:13.644 killing process with pid 2453919 00:21:13.644 16:05:03 -- common/autotest_common.sh@945 -- # kill 2453919 00:21:13.644 Received shutdown signal, test time was about 10.000000 seconds 00:21:13.644 00:21:13.644 Latency(us) 00:21:13.644 [2024-10-30T15:05:03.520Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:13.644 [2024-10-30T15:05:03.520Z] =================================================================================================================== 00:21:13.644 [2024-10-30T15:05:03.520Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:13.644 16:05:03 -- common/autotest_common.sh@950 -- # wait 2453919 00:21:13.920 16:05:03 -- fips/fips.sh@17 -- # nvmftestfini 00:21:13.920 16:05:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:13.920 16:05:03 -- nvmf/common.sh@116 -- # sync 00:21:13.920 16:05:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:13.920 16:05:03 -- nvmf/common.sh@119 -- # set +e 00:21:13.920 16:05:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:13.920 16:05:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:13.920 rmmod nvme_tcp 00:21:13.920 rmmod nvme_fabrics 00:21:13.920 rmmod nvme_keyring 00:21:13.920 16:05:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:13.920 16:05:03 -- nvmf/common.sh@123 -- # set -e 00:21:13.920 16:05:03 -- nvmf/common.sh@124 -- # return 0 00:21:13.920 16:05:03 -- nvmf/common.sh@477 -- # '[' -n 2453754 ']' 00:21:13.920 16:05:03 -- nvmf/common.sh@478 -- # killprocess 2453754 00:21:13.920 16:05:03 -- common/autotest_common.sh@926 -- # '[' -z 2453754 ']' 00:21:13.920 16:05:03 -- common/autotest_common.sh@930 -- # kill -0 2453754 00:21:13.920 16:05:03 -- common/autotest_common.sh@931 -- # uname 00:21:13.920 16:05:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:13.920 16:05:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2453754 00:21:13.920 16:05:03 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:21:13.920 16:05:03 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:21:13.921 16:05:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2453754' 00:21:13.921 killing process with pid 2453754 00:21:13.921 16:05:03 -- common/autotest_common.sh@945 -- # kill 2453754 00:21:13.921 16:05:03 -- common/autotest_common.sh@950 -- # wait 2453754 00:21:14.198 16:05:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:14.198 16:05:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:14.198 16:05:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:14.198 16:05:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:14.198 16:05:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:14.198 16:05:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:14.198 16:05:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:14.198 16:05:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:16.110 16:05:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:16.110 16:05:05 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:16.110 00:21:16.110 real 0m18.104s 00:21:16.110 user 0m24.000s 00:21:16.110 sys 0m5.854s 00:21:16.110 16:05:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:16.110 16:05:05 -- common/autotest_common.sh@10 -- # set +x 00:21:16.110 ************************************ 00:21:16.110 END TEST nvmf_fips 00:21:16.110 ************************************ 00:21:16.110 16:05:05 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:16.110 16:05:05 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:16.110 16:05:05 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:16.110 16:05:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:16.110 16:05:05 -- common/autotest_common.sh@10 -- # set +x 00:21:16.110 ************************************ 00:21:16.110 START TEST nvmf_fuzz 00:21:16.110 ************************************ 00:21:16.110 16:05:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:16.369 * Looking for test storage... 00:21:16.369 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:16.369 16:05:06 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:16.369 16:05:06 -- nvmf/common.sh@7 -- # uname -s 00:21:16.369 16:05:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:16.369 16:05:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:16.369 16:05:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:16.369 16:05:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:16.369 16:05:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:16.369 16:05:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:16.369 16:05:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:16.369 16:05:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:16.369 16:05:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:16.369 16:05:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:16.369 16:05:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:16.369 16:05:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:16.369 16:05:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:16.369 16:05:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:16.369 16:05:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:16.369 16:05:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:16.369 16:05:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:16.369 16:05:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:16.369 16:05:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:16.369 16:05:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.369 16:05:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.370 16:05:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.370 16:05:06 -- paths/export.sh@5 -- # export PATH 00:21:16.370 16:05:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.370 16:05:06 -- nvmf/common.sh@46 -- # : 0 00:21:16.370 16:05:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:16.370 16:05:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:16.370 16:05:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:16.370 16:05:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:16.370 16:05:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:16.370 16:05:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:16.370 16:05:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:16.370 16:05:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:16.370 16:05:06 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:16.370 16:05:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:16.370 16:05:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:16.370 16:05:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:16.370 16:05:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:16.370 16:05:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:16.370 16:05:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:16.370 16:05:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:16.370 16:05:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:16.370 16:05:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:16.370 16:05:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:16.370 16:05:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:16.370 16:05:06 -- common/autotest_common.sh@10 -- # set +x 00:21:18.276 16:05:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:18.276 16:05:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:18.276 16:05:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:18.276 16:05:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:18.276 16:05:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:18.276 16:05:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:18.276 16:05:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:18.276 16:05:08 -- nvmf/common.sh@294 -- # net_devs=() 00:21:18.276 16:05:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:18.276 16:05:08 -- nvmf/common.sh@295 -- # e810=() 00:21:18.276 16:05:08 -- nvmf/common.sh@295 -- # local -ga e810 00:21:18.276 16:05:08 -- nvmf/common.sh@296 -- # x722=() 00:21:18.276 16:05:08 -- nvmf/common.sh@296 -- # local -ga x722 00:21:18.276 16:05:08 -- nvmf/common.sh@297 -- # mlx=() 00:21:18.276 16:05:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:18.276 16:05:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:18.276 16:05:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:18.276 16:05:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:18.276 16:05:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:18.276 16:05:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:18.276 16:05:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:18.276 16:05:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:18.276 16:05:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:18.276 16:05:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:18.276 16:05:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:18.276 16:05:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:18.276 16:05:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:18.276 16:05:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:18.276 16:05:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:18.276 16:05:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:18.276 16:05:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:18.276 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:18.276 16:05:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:18.276 16:05:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:18.276 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:18.276 16:05:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:18.276 16:05:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:18.276 16:05:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:18.276 16:05:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:18.276 16:05:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:18.276 16:05:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:18.276 16:05:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:18.276 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:18.276 16:05:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:18.276 16:05:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:18.276 16:05:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:18.276 16:05:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:18.277 16:05:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:18.277 16:05:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:18.277 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:18.277 16:05:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:18.277 16:05:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:18.277 16:05:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:18.277 16:05:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:18.277 16:05:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:18.277 16:05:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:18.277 16:05:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:18.277 16:05:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:18.277 16:05:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:18.277 16:05:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:18.277 16:05:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:18.277 16:05:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:18.277 16:05:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:18.277 16:05:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:18.277 16:05:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:18.277 16:05:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:18.277 16:05:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:18.277 16:05:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:18.277 16:05:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:18.277 16:05:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:18.277 16:05:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:18.277 16:05:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:18.534 16:05:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:18.534 16:05:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:18.534 16:05:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:18.534 16:05:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:18.534 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:18.534 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.336 ms 00:21:18.534 00:21:18.534 --- 10.0.0.2 ping statistics --- 00:21:18.534 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:18.534 rtt min/avg/max/mdev = 0.336/0.336/0.336/0.000 ms 00:21:18.534 16:05:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:18.534 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:18.534 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:21:18.535 00:21:18.535 --- 10.0.0.1 ping statistics --- 00:21:18.535 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:18.535 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:21:18.535 16:05:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:18.535 16:05:08 -- nvmf/common.sh@410 -- # return 0 00:21:18.535 16:05:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:18.535 16:05:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:18.535 16:05:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:18.535 16:05:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:18.535 16:05:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:18.535 16:05:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:18.535 16:05:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:18.535 16:05:08 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=2457351 00:21:18.535 16:05:08 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:18.535 16:05:08 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:18.535 16:05:08 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 2457351 00:21:18.535 16:05:08 -- common/autotest_common.sh@819 -- # '[' -z 2457351 ']' 00:21:18.535 16:05:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:18.535 16:05:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:18.535 16:05:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:18.535 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:18.535 16:05:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:18.535 16:05:08 -- common/autotest_common.sh@10 -- # set +x 00:21:19.473 16:05:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:19.473 16:05:09 -- common/autotest_common.sh@852 -- # return 0 00:21:19.473 16:05:09 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:19.473 16:05:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:19.473 16:05:09 -- common/autotest_common.sh@10 -- # set +x 00:21:19.473 16:05:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:19.473 16:05:09 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:19.473 16:05:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:19.473 16:05:09 -- common/autotest_common.sh@10 -- # set +x 00:21:19.473 Malloc0 00:21:19.473 16:05:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:19.473 16:05:09 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:19.473 16:05:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:19.473 16:05:09 -- common/autotest_common.sh@10 -- # set +x 00:21:19.473 16:05:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:19.473 16:05:09 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:19.473 16:05:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:19.473 16:05:09 -- common/autotest_common.sh@10 -- # set +x 00:21:19.473 16:05:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:19.473 16:05:09 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:19.473 16:05:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:19.473 16:05:09 -- common/autotest_common.sh@10 -- # set +x 00:21:19.473 16:05:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:19.473 16:05:09 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:19.473 16:05:09 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:21:51.559 Fuzzing completed. Shutting down the fuzz application 00:21:51.559 00:21:51.559 Dumping successful admin opcodes: 00:21:51.559 8, 9, 10, 24, 00:21:51.559 Dumping successful io opcodes: 00:21:51.559 0, 9, 00:21:51.559 NS: 0x200003aeff00 I/O qp, Total commands completed: 451905, total successful commands: 2628, random_seed: 2896738432 00:21:51.559 NS: 0x200003aeff00 admin qp, Total commands completed: 56496, total successful commands: 448, random_seed: 524828864 00:21:51.559 16:05:39 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:21:51.559 Fuzzing completed. Shutting down the fuzz application 00:21:51.559 00:21:51.559 Dumping successful admin opcodes: 00:21:51.559 24, 00:21:51.559 Dumping successful io opcodes: 00:21:51.559 00:21:51.559 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 1364115993 00:21:51.559 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 1364239457 00:21:51.559 16:05:41 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:51.559 16:05:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.559 16:05:41 -- common/autotest_common.sh@10 -- # set +x 00:21:51.559 16:05:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.559 16:05:41 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:21:51.559 16:05:41 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:21:51.559 16:05:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:51.559 16:05:41 -- nvmf/common.sh@116 -- # sync 00:21:51.559 16:05:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:51.559 16:05:41 -- nvmf/common.sh@119 -- # set +e 00:21:51.559 16:05:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:51.559 16:05:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:51.559 rmmod nvme_tcp 00:21:51.559 rmmod nvme_fabrics 00:21:51.559 rmmod nvme_keyring 00:21:51.559 16:05:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:51.559 16:05:41 -- nvmf/common.sh@123 -- # set -e 00:21:51.559 16:05:41 -- nvmf/common.sh@124 -- # return 0 00:21:51.559 16:05:41 -- nvmf/common.sh@477 -- # '[' -n 2457351 ']' 00:21:51.559 16:05:41 -- nvmf/common.sh@478 -- # killprocess 2457351 00:21:51.559 16:05:41 -- common/autotest_common.sh@926 -- # '[' -z 2457351 ']' 00:21:51.559 16:05:41 -- common/autotest_common.sh@930 -- # kill -0 2457351 00:21:51.559 16:05:41 -- common/autotest_common.sh@931 -- # uname 00:21:51.559 16:05:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:51.559 16:05:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2457351 00:21:51.559 16:05:41 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:51.559 16:05:41 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:51.559 16:05:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2457351' 00:21:51.559 killing process with pid 2457351 00:21:51.559 16:05:41 -- common/autotest_common.sh@945 -- # kill 2457351 00:21:51.559 16:05:41 -- common/autotest_common.sh@950 -- # wait 2457351 00:21:51.818 16:05:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:51.818 16:05:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:51.818 16:05:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:51.818 16:05:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:51.818 16:05:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:51.818 16:05:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:51.818 16:05:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:51.818 16:05:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:53.722 16:05:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:53.722 16:05:43 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:21:53.722 00:21:53.722 real 0m37.583s 00:21:53.722 user 0m51.494s 00:21:53.722 sys 0m15.521s 00:21:53.722 16:05:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:53.722 16:05:43 -- common/autotest_common.sh@10 -- # set +x 00:21:53.722 ************************************ 00:21:53.722 END TEST nvmf_fuzz 00:21:53.722 ************************************ 00:21:53.722 16:05:43 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:53.722 16:05:43 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:53.722 16:05:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:53.722 16:05:43 -- common/autotest_common.sh@10 -- # set +x 00:21:53.722 ************************************ 00:21:53.722 START TEST nvmf_multiconnection 00:21:53.722 ************************************ 00:21:53.722 16:05:43 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:53.980 * Looking for test storage... 00:21:53.980 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:53.980 16:05:43 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:53.980 16:05:43 -- nvmf/common.sh@7 -- # uname -s 00:21:53.980 16:05:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:53.980 16:05:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:53.980 16:05:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:53.980 16:05:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:53.980 16:05:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:53.980 16:05:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:53.980 16:05:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:53.980 16:05:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:53.980 16:05:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:53.980 16:05:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:53.980 16:05:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:53.980 16:05:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:53.980 16:05:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:53.980 16:05:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:53.980 16:05:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:53.980 16:05:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:53.980 16:05:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:53.980 16:05:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:53.980 16:05:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:53.980 16:05:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.980 16:05:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.980 16:05:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.980 16:05:43 -- paths/export.sh@5 -- # export PATH 00:21:53.981 16:05:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.981 16:05:43 -- nvmf/common.sh@46 -- # : 0 00:21:53.981 16:05:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:53.981 16:05:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:53.981 16:05:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:53.981 16:05:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:53.981 16:05:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:53.981 16:05:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:53.981 16:05:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:53.981 16:05:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:53.981 16:05:43 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:53.981 16:05:43 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:53.981 16:05:43 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:21:53.981 16:05:43 -- target/multiconnection.sh@16 -- # nvmftestinit 00:21:53.981 16:05:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:53.981 16:05:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:53.981 16:05:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:53.981 16:05:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:53.981 16:05:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:53.981 16:05:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:53.981 16:05:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:53.981 16:05:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:53.981 16:05:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:53.981 16:05:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:53.981 16:05:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:53.981 16:05:43 -- common/autotest_common.sh@10 -- # set +x 00:21:55.884 16:05:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:55.884 16:05:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:55.884 16:05:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:55.884 16:05:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:55.884 16:05:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:55.884 16:05:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:55.884 16:05:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:55.884 16:05:45 -- nvmf/common.sh@294 -- # net_devs=() 00:21:55.884 16:05:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:55.884 16:05:45 -- nvmf/common.sh@295 -- # e810=() 00:21:55.884 16:05:45 -- nvmf/common.sh@295 -- # local -ga e810 00:21:55.884 16:05:45 -- nvmf/common.sh@296 -- # x722=() 00:21:55.884 16:05:45 -- nvmf/common.sh@296 -- # local -ga x722 00:21:55.884 16:05:45 -- nvmf/common.sh@297 -- # mlx=() 00:21:55.884 16:05:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:55.884 16:05:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:55.884 16:05:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:55.884 16:05:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:55.884 16:05:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:55.884 16:05:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:55.884 16:05:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:55.884 16:05:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:55.884 16:05:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:55.884 16:05:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:55.884 16:05:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:55.884 16:05:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:55.884 16:05:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:55.884 16:05:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:55.884 16:05:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:55.884 16:05:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:55.884 16:05:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:55.884 16:05:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:55.884 16:05:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:55.884 16:05:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:55.884 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:55.884 16:05:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:55.884 16:05:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:55.884 16:05:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:55.884 16:05:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:55.884 16:05:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:55.884 16:05:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:55.885 16:05:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:55.885 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:55.885 16:05:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:55.885 16:05:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:55.885 16:05:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:55.885 16:05:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:55.885 16:05:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:55.885 16:05:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:55.885 16:05:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:55.885 16:05:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:55.885 16:05:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:55.885 16:05:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:55.885 16:05:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:55.885 16:05:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:55.885 16:05:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:55.885 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:55.885 16:05:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:55.885 16:05:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:55.885 16:05:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:55.885 16:05:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:55.885 16:05:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:55.885 16:05:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:55.885 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:55.885 16:05:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:55.885 16:05:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:55.885 16:05:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:55.885 16:05:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:55.885 16:05:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:55.885 16:05:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:55.885 16:05:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:55.885 16:05:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:55.885 16:05:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:55.885 16:05:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:55.885 16:05:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:55.885 16:05:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:55.885 16:05:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:55.885 16:05:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:55.885 16:05:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:55.885 16:05:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:55.885 16:05:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:55.885 16:05:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:55.885 16:05:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:55.885 16:05:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:55.885 16:05:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:55.885 16:05:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:55.885 16:05:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:56.143 16:05:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:56.144 16:05:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:56.144 16:05:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:56.144 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:56.144 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.286 ms 00:21:56.144 00:21:56.144 --- 10.0.0.2 ping statistics --- 00:21:56.144 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:56.144 rtt min/avg/max/mdev = 0.286/0.286/0.286/0.000 ms 00:21:56.144 16:05:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:56.144 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:56.144 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:21:56.144 00:21:56.144 --- 10.0.0.1 ping statistics --- 00:21:56.144 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:56.144 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:21:56.144 16:05:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:56.144 16:05:45 -- nvmf/common.sh@410 -- # return 0 00:21:56.144 16:05:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:56.144 16:05:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:56.144 16:05:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:56.144 16:05:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:56.144 16:05:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:56.144 16:05:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:56.144 16:05:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:56.144 16:05:45 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:21:56.144 16:05:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:56.144 16:05:45 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:56.144 16:05:45 -- common/autotest_common.sh@10 -- # set +x 00:21:56.144 16:05:45 -- nvmf/common.sh@469 -- # nvmfpid=2463234 00:21:56.144 16:05:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:56.144 16:05:45 -- nvmf/common.sh@470 -- # waitforlisten 2463234 00:21:56.144 16:05:45 -- common/autotest_common.sh@819 -- # '[' -z 2463234 ']' 00:21:56.144 16:05:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:56.144 16:05:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:56.144 16:05:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:56.144 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:56.144 16:05:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:56.144 16:05:45 -- common/autotest_common.sh@10 -- # set +x 00:21:56.144 [2024-10-30 16:05:46.001476] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:21:56.144 [2024-10-30 16:05:46.001580] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:56.402 EAL: No free 2048 kB hugepages reported on node 1 00:21:56.402 [2024-10-30 16:05:46.066877] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:56.402 [2024-10-30 16:05:46.151695] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:56.402 [2024-10-30 16:05:46.151849] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:56.402 [2024-10-30 16:05:46.151867] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:56.402 [2024-10-30 16:05:46.151879] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:56.402 [2024-10-30 16:05:46.151929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:56.402 [2024-10-30 16:05:46.151991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:56.402 [2024-10-30 16:05:46.152058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:56.402 [2024-10-30 16:05:46.152061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:57.343 16:05:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:57.343 16:05:47 -- common/autotest_common.sh@852 -- # return 0 00:21:57.343 16:05:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:57.343 16:05:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:57.343 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.343 16:05:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:57.343 16:05:47 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:57.343 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.343 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.343 [2024-10-30 16:05:47.050122] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:57.343 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.343 16:05:47 -- target/multiconnection.sh@21 -- # seq 1 11 00:21:57.343 16:05:47 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.343 16:05:47 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:57.343 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.343 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.343 Malloc1 00:21:57.343 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.343 16:05:47 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:21:57.343 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.343 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.343 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.343 16:05:47 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:57.343 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.343 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.343 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.343 16:05:47 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:57.343 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.343 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.343 [2024-10-30 16:05:47.107400] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:57.343 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.343 16:05:47 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.343 16:05:47 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:21:57.343 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.343 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.343 Malloc2 00:21:57.343 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.343 16:05:47 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:21:57.343 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.343 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.343 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.343 16:05:47 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:21:57.343 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.343 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.343 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.343 16:05:47 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:21:57.343 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.343 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.343 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.343 16:05:47 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.343 16:05:47 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:21:57.343 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.343 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.343 Malloc3 00:21:57.343 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.343 16:05:47 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:21:57.343 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.343 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.343 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.343 16:05:47 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:21:57.343 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.343 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.344 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.344 16:05:47 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:21:57.344 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.344 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.344 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.344 16:05:47 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.344 16:05:47 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:21:57.344 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.344 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.603 Malloc4 00:21:57.603 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.603 16:05:47 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:21:57.603 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.603 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.603 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.603 16:05:47 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:21:57.603 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.603 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.603 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.603 16:05:47 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:21:57.603 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.603 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.603 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.603 16:05:47 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.603 16:05:47 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:21:57.603 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.603 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.603 Malloc5 00:21:57.603 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.603 16:05:47 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:21:57.603 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.603 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.603 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.603 16:05:47 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:21:57.603 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.603 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.603 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.603 16:05:47 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:21:57.603 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.603 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.603 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.603 16:05:47 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.603 16:05:47 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:21:57.603 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.603 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.603 Malloc6 00:21:57.603 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.603 16:05:47 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:21:57.603 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.603 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.603 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.603 16:05:47 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:21:57.603 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.603 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.603 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.603 16:05:47 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:21:57.603 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.603 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.603 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.603 16:05:47 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.603 16:05:47 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:21:57.603 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.603 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.603 Malloc7 00:21:57.603 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.603 16:05:47 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:21:57.603 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.603 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.603 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.604 16:05:47 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:21:57.604 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.604 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.604 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.604 16:05:47 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:21:57.604 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.604 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.604 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.604 16:05:47 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.604 16:05:47 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:21:57.604 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.604 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.604 Malloc8 00:21:57.604 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.604 16:05:47 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:21:57.604 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.604 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.604 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.604 16:05:47 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:21:57.604 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.604 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.604 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.604 16:05:47 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:21:57.604 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.604 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.604 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.604 16:05:47 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.604 16:05:47 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:21:57.604 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.604 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.604 Malloc9 00:21:57.863 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.863 16:05:47 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:21:57.863 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.863 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.863 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.863 16:05:47 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:21:57.863 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.863 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.863 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.863 16:05:47 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:21:57.863 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.863 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.863 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.863 16:05:47 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.863 16:05:47 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:21:57.863 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.863 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.863 Malloc10 00:21:57.863 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.863 16:05:47 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:21:57.863 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.863 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.863 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.863 16:05:47 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:21:57.863 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.863 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.863 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.863 16:05:47 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:21:57.863 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.863 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.863 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.863 16:05:47 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.863 16:05:47 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:21:57.863 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.863 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.863 Malloc11 00:21:57.863 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.863 16:05:47 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:21:57.863 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.863 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.863 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.863 16:05:47 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:21:57.863 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.863 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.863 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.863 16:05:47 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:21:57.863 16:05:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:57.863 16:05:47 -- common/autotest_common.sh@10 -- # set +x 00:21:57.863 16:05:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:57.863 16:05:47 -- target/multiconnection.sh@28 -- # seq 1 11 00:21:57.863 16:05:47 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.863 16:05:47 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:21:58.431 16:05:48 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:21:58.431 16:05:48 -- common/autotest_common.sh@1177 -- # local i=0 00:21:58.431 16:05:48 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:21:58.431 16:05:48 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:21:58.431 16:05:48 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:00.966 16:05:50 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:00.966 16:05:50 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:00.966 16:05:50 -- common/autotest_common.sh@1186 -- # grep -c SPDK1 00:22:00.966 16:05:50 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:00.966 16:05:50 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:00.966 16:05:50 -- common/autotest_common.sh@1187 -- # return 0 00:22:00.966 16:05:50 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:00.966 16:05:50 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:01.224 16:05:50 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:01.224 16:05:50 -- common/autotest_common.sh@1177 -- # local i=0 00:22:01.224 16:05:50 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:01.224 16:05:50 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:01.224 16:05:50 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:03.129 16:05:52 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:03.129 16:05:52 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:03.129 16:05:52 -- common/autotest_common.sh@1186 -- # grep -c SPDK2 00:22:03.129 16:05:52 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:03.129 16:05:52 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:03.129 16:05:52 -- common/autotest_common.sh@1187 -- # return 0 00:22:03.129 16:05:52 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:03.129 16:05:52 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:04.071 16:05:53 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:04.071 16:05:53 -- common/autotest_common.sh@1177 -- # local i=0 00:22:04.071 16:05:53 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:04.071 16:05:53 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:04.071 16:05:53 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:05.977 16:05:55 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:05.977 16:05:55 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:05.977 16:05:55 -- common/autotest_common.sh@1186 -- # grep -c SPDK3 00:22:05.977 16:05:55 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:05.977 16:05:55 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:05.977 16:05:55 -- common/autotest_common.sh@1187 -- # return 0 00:22:05.977 16:05:55 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:05.977 16:05:55 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:06.542 16:05:56 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:06.542 16:05:56 -- common/autotest_common.sh@1177 -- # local i=0 00:22:06.542 16:05:56 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:06.542 16:05:56 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:06.542 16:05:56 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:09.076 16:05:58 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:09.076 16:05:58 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:09.076 16:05:58 -- common/autotest_common.sh@1186 -- # grep -c SPDK4 00:22:09.076 16:05:58 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:09.076 16:05:58 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:09.076 16:05:58 -- common/autotest_common.sh@1187 -- # return 0 00:22:09.076 16:05:58 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:09.076 16:05:58 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:09.335 16:05:59 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:09.335 16:05:59 -- common/autotest_common.sh@1177 -- # local i=0 00:22:09.335 16:05:59 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:09.335 16:05:59 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:09.335 16:05:59 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:11.260 16:06:01 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:11.260 16:06:01 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:11.260 16:06:01 -- common/autotest_common.sh@1186 -- # grep -c SPDK5 00:22:11.260 16:06:01 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:11.260 16:06:01 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:11.260 16:06:01 -- common/autotest_common.sh@1187 -- # return 0 00:22:11.260 16:06:01 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:11.260 16:06:01 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:12.197 16:06:01 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:12.197 16:06:01 -- common/autotest_common.sh@1177 -- # local i=0 00:22:12.197 16:06:01 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:12.197 16:06:01 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:12.197 16:06:01 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:14.102 16:06:03 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:14.102 16:06:03 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:14.102 16:06:03 -- common/autotest_common.sh@1186 -- # grep -c SPDK6 00:22:14.102 16:06:03 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:14.102 16:06:03 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:14.102 16:06:03 -- common/autotest_common.sh@1187 -- # return 0 00:22:14.102 16:06:03 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.102 16:06:03 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:15.039 16:06:04 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:15.039 16:06:04 -- common/autotest_common.sh@1177 -- # local i=0 00:22:15.039 16:06:04 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:15.039 16:06:04 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:15.039 16:06:04 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:16.945 16:06:06 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:16.945 16:06:06 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:16.945 16:06:06 -- common/autotest_common.sh@1186 -- # grep -c SPDK7 00:22:16.945 16:06:06 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:16.945 16:06:06 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:16.945 16:06:06 -- common/autotest_common.sh@1187 -- # return 0 00:22:16.945 16:06:06 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:16.945 16:06:06 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:17.512 16:06:07 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:17.512 16:06:07 -- common/autotest_common.sh@1177 -- # local i=0 00:22:17.512 16:06:07 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:17.512 16:06:07 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:17.512 16:06:07 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:20.045 16:06:09 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:20.045 16:06:09 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:20.045 16:06:09 -- common/autotest_common.sh@1186 -- # grep -c SPDK8 00:22:20.045 16:06:09 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:20.045 16:06:09 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:20.045 16:06:09 -- common/autotest_common.sh@1187 -- # return 0 00:22:20.045 16:06:09 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:20.045 16:06:09 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:20.303 16:06:10 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:20.303 16:06:10 -- common/autotest_common.sh@1177 -- # local i=0 00:22:20.303 16:06:10 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:20.303 16:06:10 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:20.303 16:06:10 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:22.844 16:06:12 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:22.844 16:06:12 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:22.844 16:06:12 -- common/autotest_common.sh@1186 -- # grep -c SPDK9 00:22:22.844 16:06:12 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:22.844 16:06:12 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:22.844 16:06:12 -- common/autotest_common.sh@1187 -- # return 0 00:22:22.844 16:06:12 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:22.844 16:06:12 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:23.105 16:06:12 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:23.105 16:06:12 -- common/autotest_common.sh@1177 -- # local i=0 00:22:23.105 16:06:12 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:23.105 16:06:12 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:23.105 16:06:12 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:25.010 16:06:14 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:25.010 16:06:14 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:25.010 16:06:14 -- common/autotest_common.sh@1186 -- # grep -c SPDK10 00:22:25.269 16:06:14 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:25.269 16:06:14 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:25.269 16:06:14 -- common/autotest_common.sh@1187 -- # return 0 00:22:25.269 16:06:14 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.269 16:06:14 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:25.838 16:06:15 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:25.838 16:06:15 -- common/autotest_common.sh@1177 -- # local i=0 00:22:25.838 16:06:15 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:25.838 16:06:15 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:25.838 16:06:15 -- common/autotest_common.sh@1184 -- # sleep 2 00:22:28.371 16:06:17 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:22:28.371 16:06:17 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:22:28.371 16:06:17 -- common/autotest_common.sh@1186 -- # grep -c SPDK11 00:22:28.371 16:06:17 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:22:28.371 16:06:17 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:22:28.371 16:06:17 -- common/autotest_common.sh@1187 -- # return 0 00:22:28.371 16:06:17 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:28.371 [global] 00:22:28.371 thread=1 00:22:28.371 invalidate=1 00:22:28.371 rw=read 00:22:28.371 time_based=1 00:22:28.371 runtime=10 00:22:28.371 ioengine=libaio 00:22:28.371 direct=1 00:22:28.371 bs=262144 00:22:28.371 iodepth=64 00:22:28.371 norandommap=1 00:22:28.371 numjobs=1 00:22:28.371 00:22:28.371 [job0] 00:22:28.372 filename=/dev/nvme0n1 00:22:28.372 [job1] 00:22:28.372 filename=/dev/nvme10n1 00:22:28.372 [job2] 00:22:28.372 filename=/dev/nvme1n1 00:22:28.372 [job3] 00:22:28.372 filename=/dev/nvme2n1 00:22:28.372 [job4] 00:22:28.372 filename=/dev/nvme3n1 00:22:28.372 [job5] 00:22:28.372 filename=/dev/nvme4n1 00:22:28.372 [job6] 00:22:28.372 filename=/dev/nvme5n1 00:22:28.372 [job7] 00:22:28.372 filename=/dev/nvme6n1 00:22:28.372 [job8] 00:22:28.372 filename=/dev/nvme7n1 00:22:28.372 [job9] 00:22:28.372 filename=/dev/nvme8n1 00:22:28.372 [job10] 00:22:28.372 filename=/dev/nvme9n1 00:22:28.372 Could not set queue depth (nvme0n1) 00:22:28.372 Could not set queue depth (nvme10n1) 00:22:28.372 Could not set queue depth (nvme1n1) 00:22:28.372 Could not set queue depth (nvme2n1) 00:22:28.372 Could not set queue depth (nvme3n1) 00:22:28.372 Could not set queue depth (nvme4n1) 00:22:28.372 Could not set queue depth (nvme5n1) 00:22:28.372 Could not set queue depth (nvme6n1) 00:22:28.372 Could not set queue depth (nvme7n1) 00:22:28.372 Could not set queue depth (nvme8n1) 00:22:28.372 Could not set queue depth (nvme9n1) 00:22:28.372 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.372 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.372 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.372 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.372 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.372 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.372 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.372 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.372 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.372 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.372 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.372 fio-3.35 00:22:28.372 Starting 11 threads 00:22:40.581 00:22:40.581 job0: (groupid=0, jobs=1): err= 0: pid=2468224: Wed Oct 30 16:06:28 2024 00:22:40.581 read: IOPS=657, BW=164MiB/s (172MB/s)(1647MiB/10016msec) 00:22:40.581 slat (usec): min=12, max=37677, avg=1455.85, stdev=3967.32 00:22:40.581 clat (msec): min=12, max=181, avg=95.80, stdev=28.62 00:22:40.581 lat (msec): min=16, max=181, avg=97.26, stdev=29.10 00:22:40.581 clat percentiles (msec): 00:22:40.581 | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 58], 20.00th=[ 65], 00:22:40.581 | 30.00th=[ 79], 40.00th=[ 91], 50.00th=[ 99], 60.00th=[ 106], 00:22:40.581 | 70.00th=[ 114], 80.00th=[ 121], 90.00th=[ 133], 95.00th=[ 142], 00:22:40.581 | 99.00th=[ 155], 99.50th=[ 159], 99.90th=[ 169], 99.95th=[ 176], 00:22:40.581 | 99.99th=[ 182] 00:22:40.581 bw ( KiB/s): min=109056, max=267264, per=8.44%, avg=166992.90, stdev=45632.91, samples=20 00:22:40.581 iops : min= 426, max= 1044, avg=652.30, stdev=178.26, samples=20 00:22:40.581 lat (msec) : 20=0.21%, 50=3.81%, 100=47.92%, 250=48.06% 00:22:40.581 cpu : usr=0.36%, sys=2.28%, ctx=1193, majf=0, minf=4097 00:22:40.581 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:22:40.581 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.581 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.581 issued rwts: total=6586,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.581 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.581 job1: (groupid=0, jobs=1): err= 0: pid=2468225: Wed Oct 30 16:06:28 2024 00:22:40.581 read: IOPS=602, BW=151MiB/s (158MB/s)(1518MiB/10083msec) 00:22:40.581 slat (usec): min=10, max=75064, avg=1313.54, stdev=4392.33 00:22:40.581 clat (msec): min=5, max=222, avg=104.92, stdev=34.18 00:22:40.581 lat (msec): min=5, max=226, avg=106.23, stdev=34.87 00:22:40.581 clat percentiles (msec): 00:22:40.581 | 1.00th=[ 18], 5.00th=[ 52], 10.00th=[ 64], 20.00th=[ 78], 00:22:40.581 | 30.00th=[ 89], 40.00th=[ 96], 50.00th=[ 105], 60.00th=[ 112], 00:22:40.581 | 70.00th=[ 121], 80.00th=[ 132], 90.00th=[ 148], 95.00th=[ 167], 00:22:40.581 | 99.00th=[ 184], 99.50th=[ 190], 99.90th=[ 201], 99.95th=[ 205], 00:22:40.581 | 99.99th=[ 222] 00:22:40.581 bw ( KiB/s): min=88064, max=233984, per=7.77%, avg=153757.40, stdev=37837.70, samples=20 00:22:40.581 iops : min= 344, max= 914, avg=600.55, stdev=147.83, samples=20 00:22:40.581 lat (msec) : 10=0.28%, 20=0.99%, 50=3.33%, 100=40.68%, 250=54.73% 00:22:40.581 cpu : usr=0.37%, sys=2.03%, ctx=1180, majf=0, minf=4097 00:22:40.581 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:40.581 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.581 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.581 issued rwts: total=6070,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.581 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.581 job2: (groupid=0, jobs=1): err= 0: pid=2468226: Wed Oct 30 16:06:28 2024 00:22:40.581 read: IOPS=610, BW=153MiB/s (160MB/s)(1539MiB/10080msec) 00:22:40.581 slat (usec): min=9, max=55970, avg=1129.30, stdev=3964.50 00:22:40.581 clat (usec): min=1012, max=211125, avg=103608.44, stdev=36981.18 00:22:40.581 lat (usec): min=1037, max=211181, avg=104737.74, stdev=37592.30 00:22:40.581 clat percentiles (msec): 00:22:40.581 | 1.00th=[ 9], 5.00th=[ 35], 10.00th=[ 54], 20.00th=[ 77], 00:22:40.581 | 30.00th=[ 88], 40.00th=[ 96], 50.00th=[ 105], 60.00th=[ 114], 00:22:40.581 | 70.00th=[ 124], 80.00th=[ 138], 90.00th=[ 150], 95.00th=[ 163], 00:22:40.581 | 99.00th=[ 174], 99.50th=[ 178], 99.90th=[ 184], 99.95th=[ 203], 00:22:40.581 | 99.99th=[ 211] 00:22:40.581 bw ( KiB/s): min=96768, max=253440, per=7.88%, avg=155918.45, stdev=40879.39, samples=20 00:22:40.581 iops : min= 378, max= 990, avg=609.00, stdev=159.67, samples=20 00:22:40.581 lat (msec) : 2=0.02%, 4=0.49%, 10=0.65%, 20=1.58%, 50=6.21% 00:22:40.581 lat (msec) : 100=35.53%, 250=55.53% 00:22:40.581 cpu : usr=0.34%, sys=1.87%, ctx=1388, majf=0, minf=4097 00:22:40.581 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:40.581 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.581 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.581 issued rwts: total=6155,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.581 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.581 job3: (groupid=0, jobs=1): err= 0: pid=2468227: Wed Oct 30 16:06:28 2024 00:22:40.581 read: IOPS=626, BW=157MiB/s (164MB/s)(1580MiB/10081msec) 00:22:40.581 slat (usec): min=8, max=74982, avg=1343.67, stdev=4620.78 00:22:40.581 clat (msec): min=3, max=241, avg=100.68, stdev=39.83 00:22:40.581 lat (msec): min=3, max=250, avg=102.03, stdev=40.51 00:22:40.581 clat percentiles (msec): 00:22:40.581 | 1.00th=[ 13], 5.00th=[ 31], 10.00th=[ 56], 20.00th=[ 68], 00:22:40.581 | 30.00th=[ 78], 40.00th=[ 88], 50.00th=[ 100], 60.00th=[ 111], 00:22:40.581 | 70.00th=[ 125], 80.00th=[ 138], 90.00th=[ 155], 95.00th=[ 167], 00:22:40.581 | 99.00th=[ 184], 99.50th=[ 192], 99.90th=[ 234], 99.95th=[ 236], 00:22:40.581 | 99.99th=[ 243] 00:22:40.581 bw ( KiB/s): min=93696, max=258048, per=8.10%, avg=160156.65, stdev=46048.21, samples=20 00:22:40.581 iops : min= 366, max= 1008, avg=625.55, stdev=179.87, samples=20 00:22:40.581 lat (msec) : 4=0.02%, 10=0.60%, 20=2.61%, 50=4.78%, 100=42.44% 00:22:40.581 lat (msec) : 250=49.55% 00:22:40.581 cpu : usr=0.39%, sys=2.15%, ctx=1223, majf=0, minf=4098 00:22:40.581 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:40.581 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.581 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.581 issued rwts: total=6319,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.581 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.581 job4: (groupid=0, jobs=1): err= 0: pid=2468228: Wed Oct 30 16:06:28 2024 00:22:40.581 read: IOPS=543, BW=136MiB/s (142MB/s)(1374MiB/10119msec) 00:22:40.581 slat (usec): min=13, max=82351, avg=1495.45, stdev=5049.87 00:22:40.581 clat (msec): min=6, max=244, avg=116.22, stdev=30.13 00:22:40.581 lat (msec): min=6, max=250, avg=117.71, stdev=30.85 00:22:40.581 clat percentiles (msec): 00:22:40.581 | 1.00th=[ 29], 5.00th=[ 63], 10.00th=[ 74], 20.00th=[ 96], 00:22:40.581 | 30.00th=[ 105], 40.00th=[ 111], 50.00th=[ 117], 60.00th=[ 125], 00:22:40.581 | 70.00th=[ 132], 80.00th=[ 140], 90.00th=[ 153], 95.00th=[ 165], 00:22:40.581 | 99.00th=[ 176], 99.50th=[ 211], 99.90th=[ 236], 99.95th=[ 241], 00:22:40.582 | 99.99th=[ 245] 00:22:40.582 bw ( KiB/s): min=105472, max=223232, per=7.03%, avg=139079.15, stdev=26851.91, samples=20 00:22:40.582 iops : min= 412, max= 872, avg=543.20, stdev=104.84, samples=20 00:22:40.582 lat (msec) : 10=0.18%, 20=0.40%, 50=1.42%, 100=21.67%, 250=76.33% 00:22:40.582 cpu : usr=0.34%, sys=1.79%, ctx=1124, majf=0, minf=4097 00:22:40.582 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:40.582 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.582 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.582 issued rwts: total=5497,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.582 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.582 job5: (groupid=0, jobs=1): err= 0: pid=2468229: Wed Oct 30 16:06:28 2024 00:22:40.582 read: IOPS=968, BW=242MiB/s (254MB/s)(2441MiB/10083msec) 00:22:40.582 slat (usec): min=8, max=77481, avg=768.47, stdev=2745.64 00:22:40.582 clat (msec): min=2, max=196, avg=65.28, stdev=33.53 00:22:40.582 lat (msec): min=2, max=207, avg=66.05, stdev=33.83 00:22:40.582 clat percentiles (msec): 00:22:40.582 | 1.00th=[ 5], 5.00th=[ 17], 10.00th=[ 29], 20.00th=[ 34], 00:22:40.582 | 30.00th=[ 47], 40.00th=[ 54], 50.00th=[ 60], 60.00th=[ 70], 00:22:40.582 | 70.00th=[ 80], 80.00th=[ 91], 90.00th=[ 112], 95.00th=[ 130], 00:22:40.582 | 99.00th=[ 157], 99.50th=[ 167], 99.90th=[ 190], 99.95th=[ 190], 00:22:40.582 | 99.99th=[ 197] 00:22:40.582 bw ( KiB/s): min=112352, max=502784, per=12.55%, avg=248286.65, stdev=98551.63, samples=20 00:22:40.582 iops : min= 438, max= 1964, avg=969.75, stdev=385.04, samples=20 00:22:40.582 lat (msec) : 4=0.60%, 10=2.96%, 20=1.96%, 50=28.88%, 100=50.18% 00:22:40.582 lat (msec) : 250=15.42% 00:22:40.582 cpu : usr=0.57%, sys=2.85%, ctx=1862, majf=0, minf=4097 00:22:40.582 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:22:40.582 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.582 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.582 issued rwts: total=9763,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.582 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.582 job6: (groupid=0, jobs=1): err= 0: pid=2468230: Wed Oct 30 16:06:28 2024 00:22:40.582 read: IOPS=804, BW=201MiB/s (211MB/s)(2028MiB/10083msec) 00:22:40.582 slat (usec): min=9, max=108261, avg=1111.75, stdev=3925.60 00:22:40.582 clat (usec): min=1308, max=228018, avg=78369.61, stdev=35679.74 00:22:40.582 lat (usec): min=1330, max=255558, avg=79481.36, stdev=36244.42 00:22:40.582 clat percentiles (msec): 00:22:40.582 | 1.00th=[ 9], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 52], 00:22:40.582 | 30.00th=[ 59], 40.00th=[ 65], 50.00th=[ 73], 60.00th=[ 85], 00:22:40.582 | 70.00th=[ 100], 80.00th=[ 112], 90.00th=[ 126], 95.00th=[ 140], 00:22:40.582 | 99.00th=[ 163], 99.50th=[ 171], 99.90th=[ 180], 99.95th=[ 188], 00:22:40.582 | 99.99th=[ 228] 00:22:40.582 bw ( KiB/s): min=102706, max=491008, per=10.42%, avg=206016.30, stdev=86061.45, samples=20 00:22:40.582 iops : min= 401, max= 1918, avg=804.70, stdev=336.15, samples=20 00:22:40.582 lat (msec) : 2=0.01%, 4=0.15%, 10=1.32%, 20=2.51%, 50=15.82% 00:22:40.582 lat (msec) : 100=50.57%, 250=29.62% 00:22:40.582 cpu : usr=0.46%, sys=2.65%, ctx=1515, majf=0, minf=4097 00:22:40.582 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:40.582 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.582 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.582 issued rwts: total=8112,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.582 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.582 job7: (groupid=0, jobs=1): err= 0: pid=2468231: Wed Oct 30 16:06:28 2024 00:22:40.582 read: IOPS=909, BW=227MiB/s (238MB/s)(2292MiB/10081msec) 00:22:40.582 slat (usec): min=9, max=100842, avg=848.68, stdev=3044.36 00:22:40.582 clat (usec): min=1159, max=200635, avg=69489.14, stdev=32122.26 00:22:40.582 lat (usec): min=1190, max=243763, avg=70337.82, stdev=32469.97 00:22:40.582 clat percentiles (msec): 00:22:40.582 | 1.00th=[ 17], 5.00th=[ 30], 10.00th=[ 32], 20.00th=[ 37], 00:22:40.582 | 30.00th=[ 51], 40.00th=[ 59], 50.00th=[ 66], 60.00th=[ 74], 00:22:40.582 | 70.00th=[ 85], 80.00th=[ 96], 90.00th=[ 111], 95.00th=[ 133], 00:22:40.582 | 99.00th=[ 157], 99.50th=[ 171], 99.90th=[ 184], 99.95th=[ 190], 00:22:40.582 | 99.99th=[ 201] 00:22:40.582 bw ( KiB/s): min=126464, max=437248, per=11.78%, avg=233012.50, stdev=80645.77, samples=20 00:22:40.582 iops : min= 494, max= 1708, avg=910.15, stdev=315.04, samples=20 00:22:40.582 lat (msec) : 2=0.04%, 4=0.01%, 10=0.48%, 20=0.82%, 50=28.68% 00:22:40.582 lat (msec) : 100=53.34%, 250=16.63% 00:22:40.582 cpu : usr=0.41%, sys=2.86%, ctx=1735, majf=0, minf=4097 00:22:40.582 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:22:40.582 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.582 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.582 issued rwts: total=9166,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.582 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.582 job8: (groupid=0, jobs=1): err= 0: pid=2468232: Wed Oct 30 16:06:28 2024 00:22:40.582 read: IOPS=561, BW=140MiB/s (147MB/s)(1415MiB/10080msec) 00:22:40.582 slat (usec): min=11, max=68554, avg=1616.71, stdev=4577.26 00:22:40.582 clat (msec): min=14, max=200, avg=112.31, stdev=31.74 00:22:40.582 lat (msec): min=14, max=207, avg=113.93, stdev=32.32 00:22:40.582 clat percentiles (msec): 00:22:40.582 | 1.00th=[ 28], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 83], 00:22:40.582 | 30.00th=[ 95], 40.00th=[ 104], 50.00th=[ 112], 60.00th=[ 122], 00:22:40.582 | 70.00th=[ 131], 80.00th=[ 140], 90.00th=[ 157], 95.00th=[ 165], 00:22:40.582 | 99.00th=[ 178], 99.50th=[ 182], 99.90th=[ 197], 99.95th=[ 201], 00:22:40.582 | 99.99th=[ 201] 00:22:40.582 bw ( KiB/s): min=96768, max=216576, per=7.24%, avg=143215.40, stdev=31541.43, samples=20 00:22:40.582 iops : min= 378, max= 846, avg=559.35, stdev=123.20, samples=20 00:22:40.582 lat (msec) : 20=0.48%, 50=2.00%, 100=33.60%, 250=63.93% 00:22:40.582 cpu : usr=0.42%, sys=1.94%, ctx=1181, majf=0, minf=4097 00:22:40.582 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:40.582 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.582 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.582 issued rwts: total=5658,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.582 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.582 job9: (groupid=0, jobs=1): err= 0: pid=2468233: Wed Oct 30 16:06:28 2024 00:22:40.582 read: IOPS=594, BW=149MiB/s (156MB/s)(1491MiB/10034msec) 00:22:40.582 slat (usec): min=13, max=83554, avg=1579.38, stdev=4472.95 00:22:40.582 clat (msec): min=5, max=195, avg=106.00, stdev=35.33 00:22:40.582 lat (msec): min=5, max=224, avg=107.58, stdev=35.82 00:22:40.582 clat percentiles (msec): 00:22:40.582 | 1.00th=[ 22], 5.00th=[ 39], 10.00th=[ 57], 20.00th=[ 80], 00:22:40.582 | 30.00th=[ 92], 40.00th=[ 100], 50.00th=[ 107], 60.00th=[ 114], 00:22:40.582 | 70.00th=[ 125], 80.00th=[ 138], 90.00th=[ 153], 95.00th=[ 165], 00:22:40.582 | 99.00th=[ 174], 99.50th=[ 178], 99.90th=[ 188], 99.95th=[ 194], 00:22:40.582 | 99.99th=[ 197] 00:22:40.582 bw ( KiB/s): min=98816, max=318976, per=7.64%, avg=151063.10, stdev=51902.35, samples=20 00:22:40.582 iops : min= 386, max= 1246, avg=590.00, stdev=202.77, samples=20 00:22:40.582 lat (msec) : 10=0.49%, 20=0.42%, 50=6.27%, 100=33.58%, 250=59.25% 00:22:40.582 cpu : usr=0.48%, sys=1.98%, ctx=1124, majf=0, minf=4097 00:22:40.582 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:22:40.582 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.582 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.582 issued rwts: total=5965,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.582 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.582 job10: (groupid=0, jobs=1): err= 0: pid=2468234: Wed Oct 30 16:06:28 2024 00:22:40.582 read: IOPS=885, BW=221MiB/s (232MB/s)(2222MiB/10038msec) 00:22:40.582 slat (usec): min=9, max=67045, avg=660.63, stdev=2746.43 00:22:40.582 clat (usec): min=939, max=185307, avg=71547.40, stdev=37485.80 00:22:40.582 lat (usec): min=962, max=185330, avg=72208.03, stdev=37782.00 00:22:40.582 clat percentiles (msec): 00:22:40.582 | 1.00th=[ 5], 5.00th=[ 15], 10.00th=[ 27], 20.00th=[ 36], 00:22:40.582 | 30.00th=[ 44], 40.00th=[ 59], 50.00th=[ 70], 60.00th=[ 81], 00:22:40.582 | 70.00th=[ 93], 80.00th=[ 108], 90.00th=[ 126], 95.00th=[ 138], 00:22:40.582 | 99.00th=[ 157], 99.50th=[ 163], 99.90th=[ 171], 99.95th=[ 178], 00:22:40.582 | 99.99th=[ 186] 00:22:40.582 bw ( KiB/s): min=126211, max=450560, per=11.42%, avg=225913.60, stdev=87419.66, samples=20 00:22:40.582 iops : min= 493, max= 1760, avg=882.45, stdev=341.49, samples=20 00:22:40.582 lat (usec) : 1000=0.03% 00:22:40.582 lat (msec) : 2=0.19%, 4=0.45%, 10=2.65%, 20=3.72%, 50=26.95% 00:22:40.582 lat (msec) : 100=41.16%, 250=24.83% 00:22:40.582 cpu : usr=0.41%, sys=2.58%, ctx=1920, majf=0, minf=3721 00:22:40.582 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:22:40.582 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.582 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.582 issued rwts: total=8889,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.582 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.582 00:22:40.582 Run status group 0 (all jobs): 00:22:40.582 READ: bw=1932MiB/s (2025MB/s), 136MiB/s-242MiB/s (142MB/s-254MB/s), io=19.1GiB (20.5GB), run=10016-10119msec 00:22:40.582 00:22:40.582 Disk stats (read/write): 00:22:40.582 nvme0n1: ios=12923/0, merge=0/0, ticks=1238400/0, in_queue=1238400, util=97.38% 00:22:40.582 nvme10n1: ios=11935/0, merge=0/0, ticks=1241198/0, in_queue=1241198, util=97.60% 00:22:40.582 nvme1n1: ios=12139/0, merge=0/0, ticks=1241638/0, in_queue=1241638, util=97.84% 00:22:40.582 nvme2n1: ios=12446/0, merge=0/0, ticks=1238309/0, in_queue=1238309, util=97.95% 00:22:40.582 nvme3n1: ios=10807/0, merge=0/0, ticks=1233323/0, in_queue=1233323, util=98.04% 00:22:40.582 nvme4n1: ios=19318/0, merge=0/0, ticks=1243120/0, in_queue=1243120, util=98.33% 00:22:40.582 nvme5n1: ios=16020/0, merge=0/0, ticks=1239409/0, in_queue=1239409, util=98.49% 00:22:40.582 nvme6n1: ios=18172/0, merge=0/0, ticks=1241457/0, in_queue=1241457, util=98.57% 00:22:40.582 nvme7n1: ios=11133/0, merge=0/0, ticks=1233193/0, in_queue=1233193, util=98.96% 00:22:40.582 nvme8n1: ios=11739/0, merge=0/0, ticks=1234701/0, in_queue=1234701, util=99.13% 00:22:40.582 nvme9n1: ios=17593/0, merge=0/0, ticks=1247668/0, in_queue=1247668, util=99.24% 00:22:40.582 16:06:28 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:22:40.582 [global] 00:22:40.582 thread=1 00:22:40.582 invalidate=1 00:22:40.582 rw=randwrite 00:22:40.582 time_based=1 00:22:40.582 runtime=10 00:22:40.582 ioengine=libaio 00:22:40.582 direct=1 00:22:40.582 bs=262144 00:22:40.583 iodepth=64 00:22:40.583 norandommap=1 00:22:40.583 numjobs=1 00:22:40.583 00:22:40.583 [job0] 00:22:40.583 filename=/dev/nvme0n1 00:22:40.583 [job1] 00:22:40.583 filename=/dev/nvme10n1 00:22:40.583 [job2] 00:22:40.583 filename=/dev/nvme1n1 00:22:40.583 [job3] 00:22:40.583 filename=/dev/nvme2n1 00:22:40.583 [job4] 00:22:40.583 filename=/dev/nvme3n1 00:22:40.583 [job5] 00:22:40.583 filename=/dev/nvme4n1 00:22:40.583 [job6] 00:22:40.583 filename=/dev/nvme5n1 00:22:40.583 [job7] 00:22:40.583 filename=/dev/nvme6n1 00:22:40.583 [job8] 00:22:40.583 filename=/dev/nvme7n1 00:22:40.583 [job9] 00:22:40.583 filename=/dev/nvme8n1 00:22:40.583 [job10] 00:22:40.583 filename=/dev/nvme9n1 00:22:40.583 Could not set queue depth (nvme0n1) 00:22:40.583 Could not set queue depth (nvme10n1) 00:22:40.583 Could not set queue depth (nvme1n1) 00:22:40.583 Could not set queue depth (nvme2n1) 00:22:40.583 Could not set queue depth (nvme3n1) 00:22:40.583 Could not set queue depth (nvme4n1) 00:22:40.583 Could not set queue depth (nvme5n1) 00:22:40.583 Could not set queue depth (nvme6n1) 00:22:40.583 Could not set queue depth (nvme7n1) 00:22:40.583 Could not set queue depth (nvme8n1) 00:22:40.583 Could not set queue depth (nvme9n1) 00:22:40.583 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.583 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.583 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.583 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.583 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.583 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.583 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.583 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.583 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.583 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.583 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.583 fio-3.35 00:22:40.583 Starting 11 threads 00:22:50.564 00:22:50.564 job0: (groupid=0, jobs=1): err= 0: pid=2469345: Wed Oct 30 16:06:39 2024 00:22:50.564 write: IOPS=450, BW=113MiB/s (118MB/s)(1136MiB/10096msec); 0 zone resets 00:22:50.564 slat (usec): min=17, max=77808, avg=1639.93, stdev=4697.10 00:22:50.564 clat (usec): min=1962, max=315465, avg=140467.92, stdev=71301.93 00:22:50.564 lat (msec): min=2, max=327, avg=142.11, stdev=72.27 00:22:50.564 clat percentiles (msec): 00:22:50.564 | 1.00th=[ 10], 5.00th=[ 28], 10.00th=[ 48], 20.00th=[ 77], 00:22:50.564 | 30.00th=[ 87], 40.00th=[ 114], 50.00th=[ 142], 60.00th=[ 165], 00:22:50.564 | 70.00th=[ 186], 80.00th=[ 201], 90.00th=[ 234], 95.00th=[ 266], 00:22:50.564 | 99.00th=[ 300], 99.50th=[ 305], 99.90th=[ 313], 99.95th=[ 313], 00:22:50.564 | 99.99th=[ 317] 00:22:50.564 bw ( KiB/s): min=59392, max=203264, per=8.20%, avg=114703.65, stdev=39120.36, samples=20 00:22:50.564 iops : min= 232, max= 794, avg=448.05, stdev=152.82, samples=20 00:22:50.564 lat (msec) : 2=0.02%, 4=0.07%, 10=0.95%, 20=2.22%, 50=7.26% 00:22:50.564 lat (msec) : 100=24.60%, 250=57.31%, 500=7.57% 00:22:50.564 cpu : usr=1.44%, sys=1.51%, ctx=2310, majf=0, minf=1 00:22:50.564 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:22:50.564 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.564 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.564 issued rwts: total=0,4544,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.564 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.564 job1: (groupid=0, jobs=1): err= 0: pid=2469383: Wed Oct 30 16:06:39 2024 00:22:50.564 write: IOPS=517, BW=129MiB/s (136MB/s)(1298MiB/10038msec); 0 zone resets 00:22:50.564 slat (usec): min=17, max=109604, avg=1441.25, stdev=4086.10 00:22:50.564 clat (usec): min=1290, max=348080, avg=122221.70, stdev=70310.41 00:22:50.564 lat (usec): min=1636, max=348170, avg=123662.95, stdev=71254.28 00:22:50.564 clat percentiles (msec): 00:22:50.564 | 1.00th=[ 5], 5.00th=[ 19], 10.00th=[ 33], 20.00th=[ 57], 00:22:50.564 | 30.00th=[ 89], 40.00th=[ 103], 50.00th=[ 109], 60.00th=[ 122], 00:22:50.564 | 70.00th=[ 167], 80.00th=[ 184], 90.00th=[ 222], 95.00th=[ 255], 00:22:50.564 | 99.00th=[ 296], 99.50th=[ 309], 99.90th=[ 317], 99.95th=[ 321], 00:22:50.564 | 99.99th=[ 347] 00:22:50.564 bw ( KiB/s): min=54272, max=241152, per=9.38%, avg=131235.70, stdev=55205.40, samples=20 00:22:50.564 iops : min= 212, max= 942, avg=512.60, stdev=215.63, samples=20 00:22:50.564 lat (msec) : 2=0.10%, 4=0.66%, 10=1.52%, 20=3.37%, 50=13.20% 00:22:50.564 lat (msec) : 100=18.82%, 250=56.97%, 500=5.36% 00:22:50.564 cpu : usr=1.64%, sys=1.86%, ctx=2564, majf=0, minf=1 00:22:50.564 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:50.564 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.564 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.564 issued rwts: total=0,5190,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.564 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.564 job2: (groupid=0, jobs=1): err= 0: pid=2469419: Wed Oct 30 16:06:39 2024 00:22:50.564 write: IOPS=460, BW=115MiB/s (121MB/s)(1171MiB/10180msec); 0 zone resets 00:22:50.564 slat (usec): min=15, max=39755, avg=1643.97, stdev=4112.09 00:22:50.564 clat (usec): min=836, max=344238, avg=137348.87, stdev=69492.37 00:22:50.564 lat (usec): min=875, max=347658, avg=138992.84, stdev=70493.80 00:22:50.564 clat percentiles (msec): 00:22:50.564 | 1.00th=[ 3], 5.00th=[ 25], 10.00th=[ 45], 20.00th=[ 81], 00:22:50.564 | 30.00th=[ 90], 40.00th=[ 113], 50.00th=[ 136], 60.00th=[ 163], 00:22:50.564 | 70.00th=[ 178], 80.00th=[ 197], 90.00th=[ 232], 95.00th=[ 253], 00:22:50.564 | 99.00th=[ 296], 99.50th=[ 321], 99.90th=[ 338], 99.95th=[ 342], 00:22:50.564 | 99.99th=[ 347] 00:22:50.564 bw ( KiB/s): min=61440, max=244736, per=8.45%, avg=118286.85, stdev=51958.71, samples=20 00:22:50.564 iops : min= 240, max= 956, avg=462.05, stdev=202.97, samples=20 00:22:50.564 lat (usec) : 1000=0.11% 00:22:50.564 lat (msec) : 2=0.41%, 4=0.88%, 10=0.47%, 20=2.07%, 50=7.49% 00:22:50.564 lat (msec) : 100=24.57%, 250=58.18%, 500=5.83% 00:22:50.564 cpu : usr=1.38%, sys=1.63%, ctx=2365, majf=0, minf=1 00:22:50.564 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:22:50.564 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.564 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.564 issued rwts: total=0,4684,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.564 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.564 job3: (groupid=0, jobs=1): err= 0: pid=2469438: Wed Oct 30 16:06:39 2024 00:22:50.564 write: IOPS=518, BW=130MiB/s (136MB/s)(1320MiB/10176msec); 0 zone resets 00:22:50.564 slat (usec): min=17, max=128217, avg=1643.32, stdev=4023.24 00:22:50.564 clat (usec): min=1506, max=381235, avg=121661.06, stdev=60720.60 00:22:50.564 lat (usec): min=1545, max=381279, avg=123304.37, stdev=61505.84 00:22:50.564 clat percentiles (msec): 00:22:50.564 | 1.00th=[ 12], 5.00th=[ 34], 10.00th=[ 56], 20.00th=[ 81], 00:22:50.564 | 30.00th=[ 84], 40.00th=[ 89], 50.00th=[ 101], 60.00th=[ 136], 00:22:50.564 | 70.00th=[ 157], 80.00th=[ 178], 90.00th=[ 203], 95.00th=[ 224], 00:22:50.564 | 99.00th=[ 313], 99.50th=[ 334], 99.90th=[ 372], 99.95th=[ 372], 00:22:50.564 | 99.99th=[ 380] 00:22:50.564 bw ( KiB/s): min=75264, max=224768, per=9.54%, avg=133516.60, stdev=49161.31, samples=20 00:22:50.564 iops : min= 294, max= 878, avg=521.50, stdev=192.04, samples=20 00:22:50.564 lat (msec) : 2=0.02%, 4=0.21%, 10=0.61%, 20=1.91%, 50=5.95% 00:22:50.564 lat (msec) : 100=41.09%, 250=48.12%, 500=2.10% 00:22:50.564 cpu : usr=1.55%, sys=1.71%, ctx=2097, majf=0, minf=1 00:22:50.564 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:50.564 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.564 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.564 issued rwts: total=0,5279,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.564 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.564 job4: (groupid=0, jobs=1): err= 0: pid=2469445: Wed Oct 30 16:06:39 2024 00:22:50.564 write: IOPS=457, BW=114MiB/s (120MB/s)(1166MiB/10185msec); 0 zone resets 00:22:50.564 slat (usec): min=17, max=56834, avg=1852.86, stdev=4360.98 00:22:50.564 clat (usec): min=1691, max=384983, avg=137739.35, stdev=73179.94 00:22:50.564 lat (usec): min=1730, max=385018, avg=139592.22, stdev=74271.47 00:22:50.564 clat percentiles (msec): 00:22:50.564 | 1.00th=[ 10], 5.00th=[ 26], 10.00th=[ 46], 20.00th=[ 64], 00:22:50.564 | 30.00th=[ 80], 40.00th=[ 127], 50.00th=[ 148], 60.00th=[ 163], 00:22:50.564 | 70.00th=[ 176], 80.00th=[ 188], 90.00th=[ 230], 95.00th=[ 271], 00:22:50.564 | 99.00th=[ 321], 99.50th=[ 334], 99.90th=[ 372], 99.95th=[ 372], 00:22:50.564 | 99.99th=[ 384] 00:22:50.564 bw ( KiB/s): min=49152, max=249344, per=8.41%, avg=117756.55, stdev=54567.36, samples=20 00:22:50.564 iops : min= 192, max= 974, avg=459.90, stdev=213.16, samples=20 00:22:50.564 lat (msec) : 2=0.02%, 4=0.09%, 10=1.01%, 20=2.83%, 50=12.82% 00:22:50.564 lat (msec) : 100=16.60%, 250=59.26%, 500=7.38% 00:22:50.564 cpu : usr=1.43%, sys=1.31%, ctx=1912, majf=0, minf=1 00:22:50.564 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:22:50.564 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.564 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.564 issued rwts: total=0,4664,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.564 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.564 job5: (groupid=0, jobs=1): err= 0: pid=2469449: Wed Oct 30 16:06:39 2024 00:22:50.564 write: IOPS=646, BW=162MiB/s (169MB/s)(1644MiB/10175msec); 0 zone resets 00:22:50.564 slat (usec): min=22, max=30034, avg=1101.01, stdev=2827.97 00:22:50.564 clat (usec): min=1098, max=368130, avg=97857.59, stdev=59846.15 00:22:50.564 lat (usec): min=1175, max=368175, avg=98958.60, stdev=60490.54 00:22:50.564 clat percentiles (msec): 00:22:50.564 | 1.00th=[ 4], 5.00th=[ 18], 10.00th=[ 36], 20.00th=[ 46], 00:22:50.564 | 30.00th=[ 50], 40.00th=[ 79], 50.00th=[ 91], 60.00th=[ 106], 00:22:50.564 | 70.00th=[ 118], 80.00th=[ 146], 90.00th=[ 182], 95.00th=[ 207], 00:22:50.564 | 99.00th=[ 275], 99.50th=[ 305], 99.90th=[ 363], 99.95th=[ 363], 00:22:50.564 | 99.99th=[ 368] 00:22:50.564 bw ( KiB/s): min=85504, max=341504, per=11.92%, avg=166751.80, stdev=70804.69, samples=20 00:22:50.564 iops : min= 334, max= 1334, avg=651.30, stdev=276.62, samples=20 00:22:50.564 lat (msec) : 2=0.20%, 4=0.85%, 10=1.92%, 20=2.86%, 50=24.74% 00:22:50.565 lat (msec) : 100=24.71%, 250=43.04%, 500=1.69% 00:22:50.565 cpu : usr=1.96%, sys=2.10%, ctx=3238, majf=0, minf=1 00:22:50.565 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:22:50.565 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.565 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.565 issued rwts: total=0,6577,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.565 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.565 job6: (groupid=0, jobs=1): err= 0: pid=2469450: Wed Oct 30 16:06:39 2024 00:22:50.565 write: IOPS=523, BW=131MiB/s (137MB/s)(1321MiB/10100msec); 0 zone resets 00:22:50.565 slat (usec): min=20, max=130918, avg=1510.33, stdev=4924.73 00:22:50.565 clat (usec): min=775, max=403251, avg=120373.17, stdev=71710.72 00:22:50.565 lat (usec): min=813, max=403297, avg=121883.50, stdev=72662.73 00:22:50.565 clat percentiles (msec): 00:22:50.565 | 1.00th=[ 4], 5.00th=[ 11], 10.00th=[ 31], 20.00th=[ 57], 00:22:50.565 | 30.00th=[ 79], 40.00th=[ 96], 50.00th=[ 111], 60.00th=[ 129], 00:22:50.565 | 70.00th=[ 163], 80.00th=[ 182], 90.00th=[ 207], 95.00th=[ 253], 00:22:50.565 | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 334], 99.95th=[ 368], 00:22:50.565 | 99.99th=[ 405] 00:22:50.565 bw ( KiB/s): min=55296, max=223232, per=9.55%, avg=133636.75, stdev=45266.10, samples=20 00:22:50.565 iops : min= 216, max= 872, avg=522.00, stdev=176.82, samples=20 00:22:50.565 lat (usec) : 1000=0.06% 00:22:50.565 lat (msec) : 2=0.11%, 4=0.91%, 10=3.75%, 20=3.10%, 50=10.39% 00:22:50.565 lat (msec) : 100=23.32%, 250=53.27%, 500=5.09% 00:22:50.565 cpu : usr=1.59%, sys=1.77%, ctx=2551, majf=0, minf=1 00:22:50.565 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:50.565 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.565 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.565 issued rwts: total=0,5283,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.565 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.565 job7: (groupid=0, jobs=1): err= 0: pid=2469451: Wed Oct 30 16:06:39 2024 00:22:50.565 write: IOPS=441, BW=110MiB/s (116MB/s)(1123MiB/10178msec); 0 zone resets 00:22:50.565 slat (usec): min=23, max=47120, avg=1716.25, stdev=4521.36 00:22:50.565 clat (usec): min=866, max=380053, avg=143165.58, stdev=79734.99 00:22:50.565 lat (usec): min=925, max=380081, avg=144881.84, stdev=80936.91 00:22:50.565 clat percentiles (msec): 00:22:50.565 | 1.00th=[ 4], 5.00th=[ 17], 10.00th=[ 34], 20.00th=[ 71], 00:22:50.565 | 30.00th=[ 99], 40.00th=[ 114], 50.00th=[ 140], 60.00th=[ 163], 00:22:50.565 | 70.00th=[ 188], 80.00th=[ 215], 90.00th=[ 251], 95.00th=[ 284], 00:22:50.565 | 99.00th=[ 326], 99.50th=[ 334], 99.90th=[ 368], 99.95th=[ 368], 00:22:50.565 | 99.99th=[ 380] 00:22:50.565 bw ( KiB/s): min=59392, max=178842, per=8.10%, avg=113348.50, stdev=33751.66, samples=20 00:22:50.565 iops : min= 232, max= 698, avg=442.70, stdev=131.80, samples=20 00:22:50.565 lat (usec) : 1000=0.04% 00:22:50.565 lat (msec) : 2=0.29%, 4=1.16%, 10=1.20%, 20=3.83%, 50=7.59% 00:22:50.565 lat (msec) : 100=17.35%, 250=58.45%, 500=10.09% 00:22:50.565 cpu : usr=1.26%, sys=1.68%, ctx=2427, majf=0, minf=1 00:22:50.565 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:22:50.565 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.565 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.565 issued rwts: total=0,4491,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.565 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.565 job8: (groupid=0, jobs=1): err= 0: pid=2469452: Wed Oct 30 16:06:39 2024 00:22:50.565 write: IOPS=546, BW=137MiB/s (143MB/s)(1375MiB/10055msec); 0 zone resets 00:22:50.565 slat (usec): min=14, max=73559, avg=1291.20, stdev=3578.36 00:22:50.565 clat (usec): min=1195, max=311087, avg=115713.64, stdev=64412.63 00:22:50.565 lat (usec): min=1744, max=311125, avg=117004.84, stdev=65264.26 00:22:50.565 clat percentiles (msec): 00:22:50.565 | 1.00th=[ 4], 5.00th=[ 17], 10.00th=[ 45], 20.00th=[ 64], 00:22:50.565 | 30.00th=[ 79], 40.00th=[ 92], 50.00th=[ 103], 60.00th=[ 122], 00:22:50.565 | 70.00th=[ 144], 80.00th=[ 174], 90.00th=[ 207], 95.00th=[ 243], 00:22:50.565 | 99.00th=[ 284], 99.50th=[ 288], 99.90th=[ 300], 99.95th=[ 305], 00:22:50.565 | 99.99th=[ 313] 00:22:50.565 bw ( KiB/s): min=56832, max=233984, per=9.94%, avg=139118.95, stdev=48235.18, samples=20 00:22:50.565 iops : min= 222, max= 914, avg=543.40, stdev=188.40, samples=20 00:22:50.565 lat (msec) : 2=0.18%, 4=1.00%, 10=2.44%, 20=1.98%, 50=7.80% 00:22:50.565 lat (msec) : 100=34.67%, 250=47.85%, 500=4.07% 00:22:50.565 cpu : usr=1.41%, sys=1.80%, ctx=2968, majf=0, minf=2 00:22:50.565 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:50.565 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.565 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.565 issued rwts: total=0,5498,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.565 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.565 job9: (groupid=0, jobs=1): err= 0: pid=2469453: Wed Oct 30 16:06:39 2024 00:22:50.565 write: IOPS=411, BW=103MiB/s (108MB/s)(1038MiB/10097msec); 0 zone resets 00:22:50.565 slat (usec): min=19, max=58803, avg=1976.81, stdev=4790.83 00:22:50.565 clat (msec): min=2, max=360, avg=153.60, stdev=68.55 00:22:50.565 lat (msec): min=2, max=360, avg=155.58, stdev=69.48 00:22:50.565 clat percentiles (msec): 00:22:50.565 | 1.00th=[ 14], 5.00th=[ 43], 10.00th=[ 66], 20.00th=[ 88], 00:22:50.565 | 30.00th=[ 110], 40.00th=[ 136], 50.00th=[ 159], 60.00th=[ 176], 00:22:50.565 | 70.00th=[ 192], 80.00th=[ 211], 90.00th=[ 241], 95.00th=[ 264], 00:22:50.565 | 99.00th=[ 309], 99.50th=[ 313], 99.90th=[ 342], 99.95th=[ 347], 00:22:50.565 | 99.99th=[ 359] 00:22:50.565 bw ( KiB/s): min=55296, max=178176, per=7.48%, avg=104668.85, stdev=34633.00, samples=20 00:22:50.565 iops : min= 216, max= 696, avg=408.85, stdev=135.29, samples=20 00:22:50.565 lat (msec) : 4=0.14%, 10=0.29%, 20=1.61%, 50=4.60%, 100=18.47% 00:22:50.565 lat (msec) : 250=67.53%, 500=7.35% 00:22:50.565 cpu : usr=1.22%, sys=1.42%, ctx=1770, majf=0, minf=1 00:22:50.565 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:22:50.565 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.565 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.565 issued rwts: total=0,4152,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.565 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.565 job10: (groupid=0, jobs=1): err= 0: pid=2469454: Wed Oct 30 16:06:39 2024 00:22:50.565 write: IOPS=522, BW=131MiB/s (137MB/s)(1329MiB/10176msec); 0 zone resets 00:22:50.565 slat (usec): min=18, max=44050, avg=1836.94, stdev=4047.09 00:22:50.565 clat (usec): min=1441, max=371567, avg=120375.82, stdev=72551.97 00:22:50.565 lat (msec): min=2, max=383, avg=122.21, stdev=73.54 00:22:50.565 clat percentiles (msec): 00:22:50.565 | 1.00th=[ 41], 5.00th=[ 44], 10.00th=[ 45], 20.00th=[ 46], 00:22:50.565 | 30.00th=[ 79], 40.00th=[ 84], 50.00th=[ 90], 60.00th=[ 138], 00:22:50.565 | 70.00th=[ 157], 80.00th=[ 184], 90.00th=[ 218], 95.00th=[ 266], 00:22:50.565 | 99.00th=[ 317], 99.50th=[ 330], 99.90th=[ 359], 99.95th=[ 372], 00:22:50.565 | 99.99th=[ 372] 00:22:50.565 bw ( KiB/s): min=51200, max=363520, per=9.61%, avg=134442.80, stdev=88968.17, samples=20 00:22:50.565 iops : min= 200, max= 1420, avg=525.15, stdev=347.54, samples=20 00:22:50.565 lat (msec) : 2=0.02%, 4=0.06%, 10=0.30%, 20=0.13%, 50=26.45% 00:22:50.565 lat (msec) : 100=27.26%, 250=38.93%, 500=6.85% 00:22:50.565 cpu : usr=1.54%, sys=1.62%, ctx=1420, majf=0, minf=1 00:22:50.565 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:50.565 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.565 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.565 issued rwts: total=0,5315,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.565 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.565 00:22:50.565 Run status group 0 (all jobs): 00:22:50.565 WRITE: bw=1367MiB/s (1433MB/s), 103MiB/s-162MiB/s (108MB/s-169MB/s), io=13.6GiB (14.6GB), run=10038-10185msec 00:22:50.565 00:22:50.565 Disk stats (read/write): 00:22:50.565 nvme0n1: ios=49/8891, merge=0/0, ticks=3836/1210703, in_queue=1214539, util=99.95% 00:22:50.565 nvme10n1: ios=45/10032, merge=0/0, ticks=882/1219972, in_queue=1220854, util=100.00% 00:22:50.565 nvme1n1: ios=54/9194, merge=0/0, ticks=334/1217982, in_queue=1218316, util=100.00% 00:22:50.565 nvme2n1: ios=43/10398, merge=0/0, ticks=678/1208464, in_queue=1209142, util=100.00% 00:22:50.565 nvme3n1: ios=42/9321, merge=0/0, ticks=991/1240620, in_queue=1241611, util=100.00% 00:22:50.565 nvme4n1: ios=0/12994, merge=0/0, ticks=0/1216694, in_queue=1216694, util=98.23% 00:22:50.565 nvme5n1: ios=47/10370, merge=0/0, ticks=3105/1198309, in_queue=1201414, util=100.00% 00:22:50.565 nvme6n1: ios=41/8818, merge=0/0, ticks=1096/1211239, in_queue=1212335, util=100.00% 00:22:50.565 nvme7n1: ios=0/10729, merge=0/0, ticks=0/1225142, in_queue=1225142, util=98.85% 00:22:50.565 nvme8n1: ios=0/8114, merge=0/0, ticks=0/1212284, in_queue=1212284, util=99.01% 00:22:50.565 nvme9n1: ios=47/10463, merge=0/0, ticks=1043/1199684, in_queue=1200727, util=100.00% 00:22:50.565 16:06:39 -- target/multiconnection.sh@36 -- # sync 00:22:50.565 16:06:39 -- target/multiconnection.sh@37 -- # seq 1 11 00:22:50.565 16:06:39 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:50.565 16:06:39 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:22:50.565 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:22:50.565 16:06:39 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:22:50.565 16:06:39 -- common/autotest_common.sh@1198 -- # local i=0 00:22:50.565 16:06:39 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:50.565 16:06:39 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK1 00:22:50.565 16:06:39 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:50.565 16:06:39 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:22:50.565 16:06:39 -- common/autotest_common.sh@1210 -- # return 0 00:22:50.565 16:06:39 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:50.565 16:06:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:50.565 16:06:39 -- common/autotest_common.sh@10 -- # set +x 00:22:50.565 16:06:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:50.565 16:06:39 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:50.565 16:06:39 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:22:50.565 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:22:50.565 16:06:39 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:22:50.565 16:06:39 -- common/autotest_common.sh@1198 -- # local i=0 00:22:50.565 16:06:39 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:50.565 16:06:39 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK2 00:22:50.565 16:06:39 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:50.565 16:06:39 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:22:50.565 16:06:39 -- common/autotest_common.sh@1210 -- # return 0 00:22:50.565 16:06:39 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:50.565 16:06:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:50.566 16:06:39 -- common/autotest_common.sh@10 -- # set +x 00:22:50.566 16:06:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:50.566 16:06:39 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:50.566 16:06:39 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:22:50.566 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:22:50.566 16:06:40 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:22:50.566 16:06:40 -- common/autotest_common.sh@1198 -- # local i=0 00:22:50.566 16:06:40 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:50.566 16:06:40 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK3 00:22:50.566 16:06:40 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:50.566 16:06:40 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:22:50.566 16:06:40 -- common/autotest_common.sh@1210 -- # return 0 00:22:50.566 16:06:40 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:22:50.566 16:06:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:50.566 16:06:40 -- common/autotest_common.sh@10 -- # set +x 00:22:50.566 16:06:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:50.566 16:06:40 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:50.566 16:06:40 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:22:50.824 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:22:50.824 16:06:40 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:22:50.824 16:06:40 -- common/autotest_common.sh@1198 -- # local i=0 00:22:50.824 16:06:40 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:50.824 16:06:40 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK4 00:22:50.824 16:06:40 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:50.824 16:06:40 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:22:50.824 16:06:40 -- common/autotest_common.sh@1210 -- # return 0 00:22:50.824 16:06:40 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:22:50.824 16:06:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:50.824 16:06:40 -- common/autotest_common.sh@10 -- # set +x 00:22:50.824 16:06:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:50.824 16:06:40 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:50.824 16:06:40 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:22:51.082 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:22:51.082 16:06:40 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:22:51.082 16:06:40 -- common/autotest_common.sh@1198 -- # local i=0 00:22:51.082 16:06:40 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:51.082 16:06:40 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK5 00:22:51.082 16:06:40 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:51.082 16:06:40 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:22:51.082 16:06:40 -- common/autotest_common.sh@1210 -- # return 0 00:22:51.082 16:06:40 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:22:51.082 16:06:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:51.082 16:06:40 -- common/autotest_common.sh@10 -- # set +x 00:22:51.082 16:06:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:51.082 16:06:40 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:51.082 16:06:40 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:22:51.082 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:22:51.082 16:06:40 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:22:51.082 16:06:40 -- common/autotest_common.sh@1198 -- # local i=0 00:22:51.082 16:06:40 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:51.082 16:06:40 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK6 00:22:51.082 16:06:40 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:51.082 16:06:40 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:22:51.082 16:06:40 -- common/autotest_common.sh@1210 -- # return 0 00:22:51.082 16:06:40 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:22:51.083 16:06:40 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:51.083 16:06:40 -- common/autotest_common.sh@10 -- # set +x 00:22:51.083 16:06:40 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:51.083 16:06:40 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:51.083 16:06:40 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:22:51.340 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:22:51.340 16:06:41 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:22:51.340 16:06:41 -- common/autotest_common.sh@1198 -- # local i=0 00:22:51.340 16:06:41 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:51.340 16:06:41 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK7 00:22:51.340 16:06:41 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:51.340 16:06:41 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:22:51.340 16:06:41 -- common/autotest_common.sh@1210 -- # return 0 00:22:51.340 16:06:41 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:22:51.340 16:06:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:51.340 16:06:41 -- common/autotest_common.sh@10 -- # set +x 00:22:51.340 16:06:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:51.340 16:06:41 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:51.340 16:06:41 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:22:51.598 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:22:51.598 16:06:41 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:22:51.598 16:06:41 -- common/autotest_common.sh@1198 -- # local i=0 00:22:51.598 16:06:41 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:51.598 16:06:41 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK8 00:22:51.598 16:06:41 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:51.598 16:06:41 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:22:51.598 16:06:41 -- common/autotest_common.sh@1210 -- # return 0 00:22:51.598 16:06:41 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:22:51.598 16:06:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:51.598 16:06:41 -- common/autotest_common.sh@10 -- # set +x 00:22:51.598 16:06:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:51.598 16:06:41 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:51.598 16:06:41 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:22:51.856 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:22:51.856 16:06:41 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:22:51.856 16:06:41 -- common/autotest_common.sh@1198 -- # local i=0 00:22:51.856 16:06:41 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:51.856 16:06:41 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK9 00:22:51.856 16:06:41 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:51.856 16:06:41 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:22:51.856 16:06:41 -- common/autotest_common.sh@1210 -- # return 0 00:22:51.856 16:06:41 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:22:51.856 16:06:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:51.856 16:06:41 -- common/autotest_common.sh@10 -- # set +x 00:22:51.856 16:06:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:51.856 16:06:41 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:51.856 16:06:41 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:22:51.856 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:22:51.856 16:06:41 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:22:51.856 16:06:41 -- common/autotest_common.sh@1198 -- # local i=0 00:22:51.856 16:06:41 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:51.856 16:06:41 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK10 00:22:51.856 16:06:41 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:51.856 16:06:41 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:22:51.856 16:06:41 -- common/autotest_common.sh@1210 -- # return 0 00:22:51.856 16:06:41 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:22:51.856 16:06:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:51.856 16:06:41 -- common/autotest_common.sh@10 -- # set +x 00:22:51.856 16:06:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:51.856 16:06:41 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:51.856 16:06:41 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:22:52.114 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:22:52.114 16:06:41 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:22:52.114 16:06:41 -- common/autotest_common.sh@1198 -- # local i=0 00:22:52.114 16:06:41 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:22:52.114 16:06:41 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK11 00:22:52.114 16:06:41 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:22:52.114 16:06:41 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:22:52.114 16:06:41 -- common/autotest_common.sh@1210 -- # return 0 00:22:52.114 16:06:41 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:22:52.114 16:06:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:52.114 16:06:41 -- common/autotest_common.sh@10 -- # set +x 00:22:52.114 16:06:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:52.114 16:06:41 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:22:52.114 16:06:41 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:22:52.115 16:06:41 -- target/multiconnection.sh@47 -- # nvmftestfini 00:22:52.115 16:06:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:52.115 16:06:41 -- nvmf/common.sh@116 -- # sync 00:22:52.115 16:06:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:52.115 16:06:41 -- nvmf/common.sh@119 -- # set +e 00:22:52.115 16:06:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:52.115 16:06:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:52.115 rmmod nvme_tcp 00:22:52.115 rmmod nvme_fabrics 00:22:52.115 rmmod nvme_keyring 00:22:52.115 16:06:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:52.115 16:06:41 -- nvmf/common.sh@123 -- # set -e 00:22:52.115 16:06:41 -- nvmf/common.sh@124 -- # return 0 00:22:52.115 16:06:41 -- nvmf/common.sh@477 -- # '[' -n 2463234 ']' 00:22:52.115 16:06:41 -- nvmf/common.sh@478 -- # killprocess 2463234 00:22:52.115 16:06:41 -- common/autotest_common.sh@926 -- # '[' -z 2463234 ']' 00:22:52.115 16:06:41 -- common/autotest_common.sh@930 -- # kill -0 2463234 00:22:52.115 16:06:41 -- common/autotest_common.sh@931 -- # uname 00:22:52.115 16:06:41 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:52.115 16:06:41 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2463234 00:22:52.115 16:06:41 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:52.115 16:06:41 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:52.115 16:06:41 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2463234' 00:22:52.115 killing process with pid 2463234 00:22:52.115 16:06:41 -- common/autotest_common.sh@945 -- # kill 2463234 00:22:52.115 16:06:41 -- common/autotest_common.sh@950 -- # wait 2463234 00:22:52.680 16:06:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:52.680 16:06:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:52.680 16:06:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:52.680 16:06:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:52.680 16:06:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:52.680 16:06:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:52.680 16:06:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:52.680 16:06:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:55.215 16:06:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:55.215 00:22:55.215 real 1m0.871s 00:22:55.215 user 3m21.153s 00:22:55.215 sys 0m26.406s 00:22:55.215 16:06:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:55.215 16:06:44 -- common/autotest_common.sh@10 -- # set +x 00:22:55.215 ************************************ 00:22:55.215 END TEST nvmf_multiconnection 00:22:55.215 ************************************ 00:22:55.215 16:06:44 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:55.215 16:06:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:55.215 16:06:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:55.215 16:06:44 -- common/autotest_common.sh@10 -- # set +x 00:22:55.215 ************************************ 00:22:55.215 START TEST nvmf_initiator_timeout 00:22:55.215 ************************************ 00:22:55.215 16:06:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:55.215 * Looking for test storage... 00:22:55.215 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:55.215 16:06:44 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:55.215 16:06:44 -- nvmf/common.sh@7 -- # uname -s 00:22:55.215 16:06:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:55.215 16:06:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:55.215 16:06:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:55.215 16:06:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:55.215 16:06:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:55.215 16:06:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:55.215 16:06:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:55.215 16:06:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:55.215 16:06:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:55.215 16:06:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:55.215 16:06:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:55.215 16:06:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:55.215 16:06:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:55.215 16:06:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:55.215 16:06:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:55.215 16:06:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:55.215 16:06:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:55.215 16:06:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:55.215 16:06:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:55.215 16:06:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.215 16:06:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.215 16:06:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.215 16:06:44 -- paths/export.sh@5 -- # export PATH 00:22:55.215 16:06:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.215 16:06:44 -- nvmf/common.sh@46 -- # : 0 00:22:55.215 16:06:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:55.215 16:06:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:55.215 16:06:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:55.215 16:06:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:55.215 16:06:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:55.215 16:06:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:55.215 16:06:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:55.215 16:06:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:55.215 16:06:44 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:55.215 16:06:44 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:55.215 16:06:44 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:22:55.215 16:06:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:55.215 16:06:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:55.215 16:06:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:55.215 16:06:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:55.216 16:06:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:55.216 16:06:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:55.216 16:06:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:55.216 16:06:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:55.216 16:06:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:55.216 16:06:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:55.216 16:06:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:55.216 16:06:44 -- common/autotest_common.sh@10 -- # set +x 00:22:57.121 16:06:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:57.121 16:06:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:57.121 16:06:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:57.121 16:06:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:57.121 16:06:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:57.121 16:06:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:57.121 16:06:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:57.121 16:06:46 -- nvmf/common.sh@294 -- # net_devs=() 00:22:57.121 16:06:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:57.121 16:06:46 -- nvmf/common.sh@295 -- # e810=() 00:22:57.121 16:06:46 -- nvmf/common.sh@295 -- # local -ga e810 00:22:57.121 16:06:46 -- nvmf/common.sh@296 -- # x722=() 00:22:57.121 16:06:46 -- nvmf/common.sh@296 -- # local -ga x722 00:22:57.121 16:06:46 -- nvmf/common.sh@297 -- # mlx=() 00:22:57.121 16:06:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:57.121 16:06:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:57.121 16:06:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:57.121 16:06:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:57.121 16:06:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:57.121 16:06:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:57.121 16:06:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:57.121 16:06:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:57.121 16:06:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:57.121 16:06:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:57.121 16:06:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:57.121 16:06:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:57.121 16:06:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:57.121 16:06:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:57.121 16:06:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:57.121 16:06:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:57.121 16:06:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:57.121 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:57.121 16:06:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:57.121 16:06:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:57.121 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:57.121 16:06:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:57.121 16:06:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:57.121 16:06:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:57.121 16:06:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:57.121 16:06:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:57.121 16:06:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:57.121 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:57.121 16:06:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:57.121 16:06:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:57.121 16:06:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:57.121 16:06:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:57.121 16:06:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:57.121 16:06:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:57.121 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:57.121 16:06:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:57.121 16:06:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:57.121 16:06:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:57.121 16:06:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:57.121 16:06:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:57.121 16:06:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:57.121 16:06:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:57.121 16:06:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:57.122 16:06:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:57.122 16:06:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:57.122 16:06:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:57.122 16:06:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:57.122 16:06:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:57.122 16:06:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:57.122 16:06:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:57.122 16:06:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:57.122 16:06:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:57.122 16:06:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:57.122 16:06:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:57.122 16:06:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:57.122 16:06:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:57.122 16:06:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:57.122 16:06:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:57.122 16:06:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:57.122 16:06:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:57.122 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:57.122 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.303 ms 00:22:57.122 00:22:57.122 --- 10.0.0.2 ping statistics --- 00:22:57.122 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:57.122 rtt min/avg/max/mdev = 0.303/0.303/0.303/0.000 ms 00:22:57.122 16:06:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:57.122 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:57.122 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:22:57.122 00:22:57.122 --- 10.0.0.1 ping statistics --- 00:22:57.122 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:57.122 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:22:57.122 16:06:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:57.122 16:06:46 -- nvmf/common.sh@410 -- # return 0 00:22:57.122 16:06:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:57.122 16:06:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:57.122 16:06:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:57.122 16:06:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:57.122 16:06:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:57.122 16:06:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:57.122 16:06:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:57.379 16:06:47 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:22:57.379 16:06:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:57.379 16:06:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:57.379 16:06:47 -- common/autotest_common.sh@10 -- # set +x 00:22:57.380 16:06:47 -- nvmf/common.sh@469 -- # nvmfpid=2472826 00:22:57.380 16:06:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:57.380 16:06:47 -- nvmf/common.sh@470 -- # waitforlisten 2472826 00:22:57.380 16:06:47 -- common/autotest_common.sh@819 -- # '[' -z 2472826 ']' 00:22:57.380 16:06:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:57.380 16:06:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:57.380 16:06:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:57.380 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:57.380 16:06:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:57.380 16:06:47 -- common/autotest_common.sh@10 -- # set +x 00:22:57.380 [2024-10-30 16:06:47.061807] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:22:57.380 [2024-10-30 16:06:47.061879] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:57.380 EAL: No free 2048 kB hugepages reported on node 1 00:22:57.380 [2024-10-30 16:06:47.126505] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:57.380 [2024-10-30 16:06:47.211800] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:57.380 [2024-10-30 16:06:47.211936] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:57.380 [2024-10-30 16:06:47.211953] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:57.380 [2024-10-30 16:06:47.211967] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:57.380 [2024-10-30 16:06:47.212020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:57.380 [2024-10-30 16:06:47.212063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:57.380 [2024-10-30 16:06:47.212137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:57.380 [2024-10-30 16:06:47.212141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:58.312 16:06:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:58.312 16:06:48 -- common/autotest_common.sh@852 -- # return 0 00:22:58.312 16:06:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:58.312 16:06:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:58.312 16:06:48 -- common/autotest_common.sh@10 -- # set +x 00:22:58.312 16:06:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:58.312 16:06:48 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:22:58.312 16:06:48 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:58.312 16:06:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:58.312 16:06:48 -- common/autotest_common.sh@10 -- # set +x 00:22:58.312 Malloc0 00:22:58.312 16:06:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:58.312 16:06:48 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:22:58.312 16:06:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:58.312 16:06:48 -- common/autotest_common.sh@10 -- # set +x 00:22:58.312 Delay0 00:22:58.312 16:06:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:58.312 16:06:48 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:58.312 16:06:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:58.312 16:06:48 -- common/autotest_common.sh@10 -- # set +x 00:22:58.312 [2024-10-30 16:06:48.184491] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:58.570 16:06:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:58.570 16:06:48 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:22:58.570 16:06:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:58.570 16:06:48 -- common/autotest_common.sh@10 -- # set +x 00:22:58.570 16:06:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:58.570 16:06:48 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:22:58.570 16:06:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:58.570 16:06:48 -- common/autotest_common.sh@10 -- # set +x 00:22:58.570 16:06:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:58.570 16:06:48 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:58.570 16:06:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:58.570 16:06:48 -- common/autotest_common.sh@10 -- # set +x 00:22:58.570 [2024-10-30 16:06:48.212821] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:58.570 16:06:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:58.570 16:06:48 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:59.136 16:06:48 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:22:59.136 16:06:48 -- common/autotest_common.sh@1177 -- # local i=0 00:22:59.136 16:06:48 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:22:59.136 16:06:48 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:22:59.136 16:06:48 -- common/autotest_common.sh@1184 -- # sleep 2 00:23:01.662 16:06:50 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:23:01.662 16:06:50 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:23:01.662 16:06:50 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:23:01.662 16:06:50 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:23:01.662 16:06:50 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:23:01.662 16:06:50 -- common/autotest_common.sh@1187 -- # return 0 00:23:01.662 16:06:50 -- target/initiator_timeout.sh@35 -- # fio_pid=2473396 00:23:01.662 16:06:50 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:01.662 16:06:50 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:01.662 [global] 00:23:01.662 thread=1 00:23:01.662 invalidate=1 00:23:01.662 rw=write 00:23:01.662 time_based=1 00:23:01.662 runtime=60 00:23:01.662 ioengine=libaio 00:23:01.662 direct=1 00:23:01.662 bs=4096 00:23:01.662 iodepth=1 00:23:01.662 norandommap=0 00:23:01.662 numjobs=1 00:23:01.662 00:23:01.662 verify_dump=1 00:23:01.662 verify_backlog=512 00:23:01.662 verify_state_save=0 00:23:01.662 do_verify=1 00:23:01.662 verify=crc32c-intel 00:23:01.662 [job0] 00:23:01.662 filename=/dev/nvme0n1 00:23:01.662 Could not set queue depth (nvme0n1) 00:23:01.662 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:01.662 fio-3.35 00:23:01.662 Starting 1 thread 00:23:04.186 16:06:53 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:04.186 16:06:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:04.186 16:06:53 -- common/autotest_common.sh@10 -- # set +x 00:23:04.186 true 00:23:04.186 16:06:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:04.186 16:06:53 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:04.186 16:06:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:04.186 16:06:53 -- common/autotest_common.sh@10 -- # set +x 00:23:04.186 true 00:23:04.186 16:06:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:04.186 16:06:53 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:04.186 16:06:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:04.186 16:06:53 -- common/autotest_common.sh@10 -- # set +x 00:23:04.186 true 00:23:04.186 16:06:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:04.186 16:06:53 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:04.186 16:06:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:04.186 16:06:53 -- common/autotest_common.sh@10 -- # set +x 00:23:04.186 true 00:23:04.186 16:06:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:04.186 16:06:53 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:07.514 16:06:56 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:07.514 16:06:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:07.514 16:06:56 -- common/autotest_common.sh@10 -- # set +x 00:23:07.514 true 00:23:07.514 16:06:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:07.514 16:06:56 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:07.514 16:06:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:07.514 16:06:56 -- common/autotest_common.sh@10 -- # set +x 00:23:07.514 true 00:23:07.514 16:06:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:07.514 16:06:56 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:07.514 16:06:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:07.514 16:06:56 -- common/autotest_common.sh@10 -- # set +x 00:23:07.514 true 00:23:07.514 16:06:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:07.514 16:06:56 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:07.514 16:06:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:23:07.514 16:06:56 -- common/autotest_common.sh@10 -- # set +x 00:23:07.514 true 00:23:07.514 16:06:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:23:07.514 16:06:56 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:07.514 16:06:56 -- target/initiator_timeout.sh@54 -- # wait 2473396 00:24:03.724 00:24:03.724 job0: (groupid=0, jobs=1): err= 0: pid=2473466: Wed Oct 30 16:07:51 2024 00:24:03.724 read: IOPS=87, BW=349KiB/s (357kB/s)(20.4MiB/60008msec) 00:24:03.724 slat (usec): min=4, max=2828, avg=13.65, stdev=39.69 00:24:03.724 clat (usec): min=211, max=41225k, avg=11208.30, stdev=569942.70 00:24:03.725 lat (usec): min=217, max=41225k, avg=11221.94, stdev=569942.81 00:24:03.725 clat percentiles (usec): 00:24:03.725 | 1.00th=[ 223], 5.00th=[ 231], 10.00th=[ 235], 00:24:03.725 | 20.00th=[ 241], 30.00th=[ 245], 40.00th=[ 253], 00:24:03.725 | 50.00th=[ 265], 60.00th=[ 273], 70.00th=[ 285], 00:24:03.725 | 80.00th=[ 302], 90.00th=[ 478], 95.00th=[ 41157], 00:24:03.725 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42206], 00:24:03.725 | 99.95th=[ 42206], 99.99th=[17112761] 00:24:03.725 write: IOPS=93, BW=375KiB/s (384kB/s)(22.0MiB/60008msec); 0 zone resets 00:24:03.725 slat (nsec): min=5507, max=72233, avg=13631.48, stdev=8471.64 00:24:03.725 clat (usec): min=162, max=557, avg=206.62, stdev=40.07 00:24:03.725 lat (usec): min=168, max=595, avg=220.25, stdev=45.93 00:24:03.725 clat percentiles (usec): 00:24:03.725 | 1.00th=[ 169], 5.00th=[ 176], 10.00th=[ 180], 20.00th=[ 184], 00:24:03.725 | 30.00th=[ 188], 40.00th=[ 192], 50.00th=[ 196], 60.00th=[ 200], 00:24:03.725 | 70.00th=[ 208], 80.00th=[ 219], 90.00th=[ 239], 95.00th=[ 269], 00:24:03.725 | 99.00th=[ 408], 99.50th=[ 420], 99.90th=[ 433], 99.95th=[ 445], 00:24:03.725 | 99.99th=[ 562] 00:24:03.725 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=7509.33, stdev=1672.18, samples=6 00:24:03.725 iops : min= 1024, max= 2048, avg=1877.33, stdev=418.05, samples=6 00:24:03.725 lat (usec) : 250=65.51%, 500=30.20%, 750=0.70% 00:24:03.725 lat (msec) : 50=3.58%, >=2000=0.01% 00:24:03.725 cpu : usr=0.18%, sys=0.28%, ctx=10866, majf=0, minf=1 00:24:03.725 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:03.725 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.725 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.725 issued rwts: total=5233,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.725 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:03.725 00:24:03.725 Run status group 0 (all jobs): 00:24:03.725 READ: bw=349KiB/s (357kB/s), 349KiB/s-349KiB/s (357kB/s-357kB/s), io=20.4MiB (21.4MB), run=60008-60008msec 00:24:03.725 WRITE: bw=375KiB/s (384kB/s), 375KiB/s-375KiB/s (384kB/s-384kB/s), io=22.0MiB (23.1MB), run=60008-60008msec 00:24:03.725 00:24:03.725 Disk stats (read/write): 00:24:03.725 nvme0n1: ios=5329/5632, merge=0/0, ticks=18472/1100, in_queue=19572, util=99.89% 00:24:03.725 16:07:51 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:03.725 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:03.725 16:07:51 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:03.725 16:07:51 -- common/autotest_common.sh@1198 -- # local i=0 00:24:03.725 16:07:51 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:24:03.725 16:07:51 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:03.725 16:07:51 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:24:03.725 16:07:51 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:03.725 16:07:51 -- common/autotest_common.sh@1210 -- # return 0 00:24:03.725 16:07:51 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:03.725 16:07:51 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:03.725 nvmf hotplug test: fio successful as expected 00:24:03.725 16:07:51 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:03.725 16:07:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:03.725 16:07:51 -- common/autotest_common.sh@10 -- # set +x 00:24:03.725 16:07:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:03.725 16:07:51 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:03.725 16:07:51 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:03.725 16:07:51 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:03.725 16:07:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:03.725 16:07:51 -- nvmf/common.sh@116 -- # sync 00:24:03.725 16:07:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:03.725 16:07:51 -- nvmf/common.sh@119 -- # set +e 00:24:03.725 16:07:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:03.725 16:07:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:03.725 rmmod nvme_tcp 00:24:03.725 rmmod nvme_fabrics 00:24:03.725 rmmod nvme_keyring 00:24:03.725 16:07:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:03.725 16:07:51 -- nvmf/common.sh@123 -- # set -e 00:24:03.725 16:07:51 -- nvmf/common.sh@124 -- # return 0 00:24:03.725 16:07:51 -- nvmf/common.sh@477 -- # '[' -n 2472826 ']' 00:24:03.725 16:07:51 -- nvmf/common.sh@478 -- # killprocess 2472826 00:24:03.725 16:07:51 -- common/autotest_common.sh@926 -- # '[' -z 2472826 ']' 00:24:03.725 16:07:51 -- common/autotest_common.sh@930 -- # kill -0 2472826 00:24:03.725 16:07:51 -- common/autotest_common.sh@931 -- # uname 00:24:03.725 16:07:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:03.725 16:07:51 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2472826 00:24:03.725 16:07:51 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:03.725 16:07:51 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:03.725 16:07:51 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2472826' 00:24:03.725 killing process with pid 2472826 00:24:03.725 16:07:51 -- common/autotest_common.sh@945 -- # kill 2472826 00:24:03.725 16:07:51 -- common/autotest_common.sh@950 -- # wait 2472826 00:24:03.725 16:07:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:03.725 16:07:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:03.725 16:07:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:03.725 16:07:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:03.725 16:07:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:03.725 16:07:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:03.725 16:07:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:03.725 16:07:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:03.984 16:07:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:03.984 00:24:03.984 real 1m9.297s 00:24:03.984 user 4m14.757s 00:24:03.984 sys 0m6.642s 00:24:03.984 16:07:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:03.984 16:07:53 -- common/autotest_common.sh@10 -- # set +x 00:24:03.984 ************************************ 00:24:03.984 END TEST nvmf_initiator_timeout 00:24:03.984 ************************************ 00:24:03.984 16:07:53 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:03.984 16:07:53 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:03.984 16:07:53 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:03.984 16:07:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:03.984 16:07:53 -- common/autotest_common.sh@10 -- # set +x 00:24:06.525 16:07:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:06.525 16:07:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:06.525 16:07:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:06.525 16:07:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:06.525 16:07:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:06.525 16:07:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:06.525 16:07:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:06.525 16:07:55 -- nvmf/common.sh@294 -- # net_devs=() 00:24:06.525 16:07:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:06.525 16:07:55 -- nvmf/common.sh@295 -- # e810=() 00:24:06.525 16:07:55 -- nvmf/common.sh@295 -- # local -ga e810 00:24:06.525 16:07:55 -- nvmf/common.sh@296 -- # x722=() 00:24:06.525 16:07:55 -- nvmf/common.sh@296 -- # local -ga x722 00:24:06.525 16:07:55 -- nvmf/common.sh@297 -- # mlx=() 00:24:06.525 16:07:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:06.525 16:07:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:06.525 16:07:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:06.525 16:07:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:06.525 16:07:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:06.525 16:07:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:06.525 16:07:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:06.525 16:07:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:06.525 16:07:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:06.525 16:07:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:06.525 16:07:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:06.525 16:07:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:06.525 16:07:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:06.525 16:07:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:06.525 16:07:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:06.525 16:07:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:06.525 16:07:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:06.525 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:06.525 16:07:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:06.525 16:07:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:06.525 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:06.525 16:07:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:06.525 16:07:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:06.525 16:07:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:06.525 16:07:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:06.525 16:07:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:06.525 16:07:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:06.525 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:06.525 16:07:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:06.525 16:07:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:06.525 16:07:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:06.525 16:07:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:06.525 16:07:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:06.525 16:07:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:06.525 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:06.525 16:07:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:06.525 16:07:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:06.525 16:07:55 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:06.525 16:07:55 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:06.525 16:07:55 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:06.525 16:07:55 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:06.525 16:07:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:06.525 16:07:55 -- common/autotest_common.sh@10 -- # set +x 00:24:06.525 ************************************ 00:24:06.525 START TEST nvmf_perf_adq 00:24:06.525 ************************************ 00:24:06.525 16:07:55 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:06.525 * Looking for test storage... 00:24:06.525 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:06.525 16:07:55 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:06.525 16:07:55 -- nvmf/common.sh@7 -- # uname -s 00:24:06.525 16:07:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:06.525 16:07:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:06.525 16:07:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:06.525 16:07:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:06.525 16:07:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:06.525 16:07:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:06.525 16:07:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:06.525 16:07:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:06.525 16:07:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:06.525 16:07:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:06.525 16:07:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:06.525 16:07:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:06.525 16:07:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:06.525 16:07:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:06.525 16:07:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:06.525 16:07:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:06.525 16:07:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:06.525 16:07:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:06.525 16:07:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:06.525 16:07:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.525 16:07:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.525 16:07:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.525 16:07:55 -- paths/export.sh@5 -- # export PATH 00:24:06.525 16:07:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.525 16:07:55 -- nvmf/common.sh@46 -- # : 0 00:24:06.525 16:07:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:06.525 16:07:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:06.525 16:07:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:06.525 16:07:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:06.525 16:07:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:06.525 16:07:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:06.525 16:07:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:06.525 16:07:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:06.525 16:07:55 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:06.525 16:07:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:06.525 16:07:55 -- common/autotest_common.sh@10 -- # set +x 00:24:08.431 16:07:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:08.431 16:07:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:08.431 16:07:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:08.431 16:07:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:08.431 16:07:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:08.431 16:07:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:08.431 16:07:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:08.431 16:07:57 -- nvmf/common.sh@294 -- # net_devs=() 00:24:08.431 16:07:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:08.431 16:07:57 -- nvmf/common.sh@295 -- # e810=() 00:24:08.431 16:07:57 -- nvmf/common.sh@295 -- # local -ga e810 00:24:08.431 16:07:57 -- nvmf/common.sh@296 -- # x722=() 00:24:08.431 16:07:57 -- nvmf/common.sh@296 -- # local -ga x722 00:24:08.431 16:07:57 -- nvmf/common.sh@297 -- # mlx=() 00:24:08.431 16:07:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:08.431 16:07:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:08.431 16:07:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:08.431 16:07:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:08.431 16:07:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:08.431 16:07:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:08.431 16:07:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:08.431 16:07:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:08.431 16:07:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:08.431 16:07:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:08.431 16:07:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:08.431 16:07:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:08.431 16:07:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:08.431 16:07:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:08.431 16:07:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:08.431 16:07:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:08.431 16:07:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:08.431 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:08.431 16:07:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:08.431 16:07:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:08.431 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:08.431 16:07:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:08.431 16:07:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:08.431 16:07:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:08.431 16:07:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:08.431 16:07:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:08.431 16:07:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:08.431 16:07:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:08.431 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:08.431 16:07:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:08.431 16:07:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:08.431 16:07:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:08.431 16:07:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:08.431 16:07:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:08.431 16:07:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:08.431 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:08.431 16:07:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:08.431 16:07:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:08.431 16:07:57 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:08.431 16:07:57 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:08.431 16:07:57 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:08.431 16:07:57 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:08.431 16:07:57 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:09.000 16:07:58 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:11.530 16:08:01 -- target/perf_adq.sh@54 -- # sleep 5 00:24:16.805 16:08:06 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:16.806 16:08:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:16.806 16:08:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:16.806 16:08:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:16.806 16:08:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:16.806 16:08:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:16.806 16:08:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:16.806 16:08:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:16.806 16:08:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:16.806 16:08:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:16.806 16:08:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:16.806 16:08:06 -- common/autotest_common.sh@10 -- # set +x 00:24:16.806 16:08:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:16.806 16:08:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:16.806 16:08:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:16.806 16:08:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:16.806 16:08:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:16.806 16:08:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:16.806 16:08:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:16.806 16:08:06 -- nvmf/common.sh@294 -- # net_devs=() 00:24:16.806 16:08:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:16.806 16:08:06 -- nvmf/common.sh@295 -- # e810=() 00:24:16.806 16:08:06 -- nvmf/common.sh@295 -- # local -ga e810 00:24:16.806 16:08:06 -- nvmf/common.sh@296 -- # x722=() 00:24:16.806 16:08:06 -- nvmf/common.sh@296 -- # local -ga x722 00:24:16.806 16:08:06 -- nvmf/common.sh@297 -- # mlx=() 00:24:16.806 16:08:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:16.806 16:08:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:16.806 16:08:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:16.806 16:08:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:16.806 16:08:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:16.806 16:08:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:16.806 16:08:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:16.806 16:08:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:16.806 16:08:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:16.806 16:08:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:16.806 16:08:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:16.806 16:08:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:16.806 16:08:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:16.806 16:08:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:16.806 16:08:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:16.806 16:08:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:16.806 16:08:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:16.806 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:16.806 16:08:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:16.806 16:08:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:16.806 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:16.806 16:08:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:16.806 16:08:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:16.806 16:08:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:16.806 16:08:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:16.806 16:08:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:16.806 16:08:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:16.806 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:16.806 16:08:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:16.806 16:08:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:16.806 16:08:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:16.806 16:08:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:16.806 16:08:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:16.806 16:08:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:16.806 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:16.806 16:08:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:16.806 16:08:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:16.806 16:08:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:16.806 16:08:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:16.806 16:08:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:16.806 16:08:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:16.806 16:08:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:16.806 16:08:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:16.806 16:08:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:16.806 16:08:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:16.806 16:08:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:16.806 16:08:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:16.806 16:08:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:16.806 16:08:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:16.806 16:08:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:16.806 16:08:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:16.806 16:08:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:16.806 16:08:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:16.806 16:08:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:16.806 16:08:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:16.806 16:08:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:16.806 16:08:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:16.806 16:08:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:16.806 16:08:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:16.806 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:16.806 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:24:16.806 00:24:16.806 --- 10.0.0.2 ping statistics --- 00:24:16.806 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:16.806 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:24:16.806 16:08:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:16.806 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:16.806 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:24:16.806 00:24:16.806 --- 10.0.0.1 ping statistics --- 00:24:16.806 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:16.806 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:24:16.806 16:08:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:16.806 16:08:06 -- nvmf/common.sh@410 -- # return 0 00:24:16.806 16:08:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:16.806 16:08:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:16.806 16:08:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:16.806 16:08:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:16.806 16:08:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:16.806 16:08:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:16.806 16:08:06 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:16.806 16:08:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:16.806 16:08:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:16.806 16:08:06 -- common/autotest_common.sh@10 -- # set +x 00:24:16.806 16:08:06 -- nvmf/common.sh@469 -- # nvmfpid=2485381 00:24:16.806 16:08:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:16.806 16:08:06 -- nvmf/common.sh@470 -- # waitforlisten 2485381 00:24:16.806 16:08:06 -- common/autotest_common.sh@819 -- # '[' -z 2485381 ']' 00:24:16.806 16:08:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:16.806 16:08:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:16.806 16:08:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:16.806 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:16.806 16:08:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:16.806 16:08:06 -- common/autotest_common.sh@10 -- # set +x 00:24:16.806 [2024-10-30 16:08:06.249144] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:24:16.806 [2024-10-30 16:08:06.249226] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:16.806 EAL: No free 2048 kB hugepages reported on node 1 00:24:16.806 [2024-10-30 16:08:06.324867] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:16.806 [2024-10-30 16:08:06.419933] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:16.806 [2024-10-30 16:08:06.420088] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:16.806 [2024-10-30 16:08:06.420118] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:16.806 [2024-10-30 16:08:06.420133] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:16.806 [2024-10-30 16:08:06.420215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:16.806 [2024-10-30 16:08:06.420316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:16.807 [2024-10-30 16:08:06.420281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:16.807 [2024-10-30 16:08:06.420319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:16.807 16:08:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:16.807 16:08:06 -- common/autotest_common.sh@852 -- # return 0 00:24:16.807 16:08:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:16.807 16:08:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:16.807 16:08:06 -- common/autotest_common.sh@10 -- # set +x 00:24:16.807 16:08:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:16.807 16:08:06 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:16.807 16:08:06 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:16.807 16:08:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:16.807 16:08:06 -- common/autotest_common.sh@10 -- # set +x 00:24:16.807 16:08:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:16.807 16:08:06 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:16.807 16:08:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:16.807 16:08:06 -- common/autotest_common.sh@10 -- # set +x 00:24:16.807 16:08:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:16.807 16:08:06 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:16.807 16:08:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:16.807 16:08:06 -- common/autotest_common.sh@10 -- # set +x 00:24:16.807 [2024-10-30 16:08:06.597774] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:16.807 16:08:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:16.807 16:08:06 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:16.807 16:08:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:16.807 16:08:06 -- common/autotest_common.sh@10 -- # set +x 00:24:16.807 Malloc1 00:24:16.807 16:08:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:16.807 16:08:06 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:16.807 16:08:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:16.807 16:08:06 -- common/autotest_common.sh@10 -- # set +x 00:24:16.807 16:08:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:16.807 16:08:06 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:16.807 16:08:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:16.807 16:08:06 -- common/autotest_common.sh@10 -- # set +x 00:24:16.807 16:08:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:16.807 16:08:06 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:16.807 16:08:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:16.807 16:08:06 -- common/autotest_common.sh@10 -- # set +x 00:24:16.807 [2024-10-30 16:08:06.648691] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:16.807 16:08:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:16.807 16:08:06 -- target/perf_adq.sh@73 -- # perfpid=2485410 00:24:16.807 16:08:06 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:16.807 16:08:06 -- target/perf_adq.sh@74 -- # sleep 2 00:24:16.807 EAL: No free 2048 kB hugepages reported on node 1 00:24:19.334 16:08:08 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:19.334 16:08:08 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:19.334 16:08:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:19.334 16:08:08 -- common/autotest_common.sh@10 -- # set +x 00:24:19.334 16:08:08 -- target/perf_adq.sh@76 -- # wc -l 00:24:19.334 16:08:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:19.334 16:08:08 -- target/perf_adq.sh@76 -- # count=4 00:24:19.334 16:08:08 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:19.334 16:08:08 -- target/perf_adq.sh@81 -- # wait 2485410 00:24:27.443 Initializing NVMe Controllers 00:24:27.443 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:27.443 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:27.443 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:27.443 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:27.443 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:27.443 Initialization complete. Launching workers. 00:24:27.443 ======================================================== 00:24:27.443 Latency(us) 00:24:27.443 Device Information : IOPS MiB/s Average min max 00:24:27.443 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11219.80 43.83 5706.30 1827.53 10458.18 00:24:27.443 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11096.30 43.34 5770.13 1595.95 8852.26 00:24:27.443 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 10978.90 42.89 5829.53 1425.08 10146.32 00:24:27.443 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11336.40 44.28 5647.39 1438.23 9596.61 00:24:27.443 ======================================================== 00:24:27.443 Total : 44631.40 174.34 5737.52 1425.08 10458.18 00:24:27.443 00:24:27.443 16:08:16 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:27.443 16:08:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:27.443 16:08:16 -- nvmf/common.sh@116 -- # sync 00:24:27.443 16:08:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:27.443 16:08:16 -- nvmf/common.sh@119 -- # set +e 00:24:27.444 16:08:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:27.444 16:08:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:27.444 rmmod nvme_tcp 00:24:27.444 rmmod nvme_fabrics 00:24:27.444 rmmod nvme_keyring 00:24:27.444 16:08:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:27.444 16:08:16 -- nvmf/common.sh@123 -- # set -e 00:24:27.444 16:08:16 -- nvmf/common.sh@124 -- # return 0 00:24:27.444 16:08:16 -- nvmf/common.sh@477 -- # '[' -n 2485381 ']' 00:24:27.444 16:08:16 -- nvmf/common.sh@478 -- # killprocess 2485381 00:24:27.444 16:08:16 -- common/autotest_common.sh@926 -- # '[' -z 2485381 ']' 00:24:27.444 16:08:16 -- common/autotest_common.sh@930 -- # kill -0 2485381 00:24:27.444 16:08:16 -- common/autotest_common.sh@931 -- # uname 00:24:27.444 16:08:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:27.444 16:08:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2485381 00:24:27.444 16:08:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:27.444 16:08:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:27.444 16:08:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2485381' 00:24:27.444 killing process with pid 2485381 00:24:27.444 16:08:16 -- common/autotest_common.sh@945 -- # kill 2485381 00:24:27.444 16:08:16 -- common/autotest_common.sh@950 -- # wait 2485381 00:24:27.444 16:08:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:27.444 16:08:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:27.444 16:08:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:27.444 16:08:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:27.444 16:08:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:27.444 16:08:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:27.444 16:08:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:27.444 16:08:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:29.348 16:08:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:29.607 16:08:19 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:29.607 16:08:19 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:30.173 16:08:19 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:32.704 16:08:22 -- target/perf_adq.sh@54 -- # sleep 5 00:24:37.988 16:08:27 -- target/perf_adq.sh@87 -- # nvmftestinit 00:24:37.988 16:08:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:37.988 16:08:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:37.988 16:08:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:37.988 16:08:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:37.988 16:08:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:37.988 16:08:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:37.988 16:08:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:37.988 16:08:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:37.988 16:08:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:37.988 16:08:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:37.988 16:08:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:37.988 16:08:27 -- common/autotest_common.sh@10 -- # set +x 00:24:37.988 16:08:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:37.988 16:08:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:37.988 16:08:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:37.988 16:08:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:37.988 16:08:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:37.988 16:08:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:37.988 16:08:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:37.988 16:08:27 -- nvmf/common.sh@294 -- # net_devs=() 00:24:37.988 16:08:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:37.988 16:08:27 -- nvmf/common.sh@295 -- # e810=() 00:24:37.988 16:08:27 -- nvmf/common.sh@295 -- # local -ga e810 00:24:37.988 16:08:27 -- nvmf/common.sh@296 -- # x722=() 00:24:37.988 16:08:27 -- nvmf/common.sh@296 -- # local -ga x722 00:24:37.988 16:08:27 -- nvmf/common.sh@297 -- # mlx=() 00:24:37.988 16:08:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:37.988 16:08:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:37.988 16:08:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:37.988 16:08:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:37.988 16:08:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:37.988 16:08:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:37.989 16:08:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:37.989 16:08:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:37.989 16:08:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:37.989 16:08:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:37.989 16:08:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:37.989 16:08:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:37.989 16:08:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:37.989 16:08:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:37.989 16:08:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:37.989 16:08:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:37.989 16:08:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:37.989 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:37.989 16:08:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:37.989 16:08:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:37.989 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:37.989 16:08:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:37.989 16:08:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:37.989 16:08:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:37.989 16:08:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:37.989 16:08:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:37.989 16:08:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:37.989 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:37.989 16:08:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:37.989 16:08:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:37.989 16:08:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:37.989 16:08:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:37.989 16:08:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:37.989 16:08:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:37.989 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:37.989 16:08:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:37.989 16:08:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:37.989 16:08:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:37.989 16:08:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:37.989 16:08:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:37.989 16:08:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:37.989 16:08:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:37.989 16:08:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:37.989 16:08:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:37.989 16:08:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:37.989 16:08:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:37.989 16:08:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:37.989 16:08:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:37.989 16:08:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:37.989 16:08:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:37.989 16:08:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:37.989 16:08:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:37.989 16:08:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:37.989 16:08:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:37.989 16:08:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:37.989 16:08:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:37.989 16:08:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:37.989 16:08:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:37.989 16:08:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:37.989 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:37.989 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.349 ms 00:24:37.989 00:24:37.989 --- 10.0.0.2 ping statistics --- 00:24:37.989 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:37.989 rtt min/avg/max/mdev = 0.349/0.349/0.349/0.000 ms 00:24:37.989 16:08:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:37.989 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:37.989 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.153 ms 00:24:37.989 00:24:37.989 --- 10.0.0.1 ping statistics --- 00:24:37.989 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:37.989 rtt min/avg/max/mdev = 0.153/0.153/0.153/0.000 ms 00:24:37.989 16:08:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:37.989 16:08:27 -- nvmf/common.sh@410 -- # return 0 00:24:37.989 16:08:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:37.989 16:08:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:37.989 16:08:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:37.989 16:08:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:37.989 16:08:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:37.989 16:08:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:37.989 16:08:27 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:24:37.989 16:08:27 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:24:37.989 16:08:27 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:24:37.989 16:08:27 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:24:37.989 net.core.busy_poll = 1 00:24:37.989 16:08:27 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:24:37.989 net.core.busy_read = 1 00:24:37.989 16:08:27 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:24:37.989 16:08:27 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:24:37.989 16:08:27 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:24:37.989 16:08:27 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:24:37.989 16:08:27 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:24:37.989 16:08:27 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:37.989 16:08:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:37.989 16:08:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:37.989 16:08:27 -- common/autotest_common.sh@10 -- # set +x 00:24:37.989 16:08:27 -- nvmf/common.sh@469 -- # nvmfpid=2488105 00:24:37.989 16:08:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:37.989 16:08:27 -- nvmf/common.sh@470 -- # waitforlisten 2488105 00:24:37.989 16:08:27 -- common/autotest_common.sh@819 -- # '[' -z 2488105 ']' 00:24:37.989 16:08:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:37.989 16:08:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:37.989 16:08:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:37.989 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:37.989 16:08:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:37.989 16:08:27 -- common/autotest_common.sh@10 -- # set +x 00:24:37.989 [2024-10-30 16:08:27.679976] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:24:37.989 [2024-10-30 16:08:27.680061] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:37.989 EAL: No free 2048 kB hugepages reported on node 1 00:24:37.989 [2024-10-30 16:08:27.754494] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:37.989 [2024-10-30 16:08:27.847597] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:37.989 [2024-10-30 16:08:27.847752] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:37.989 [2024-10-30 16:08:27.847770] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:37.989 [2024-10-30 16:08:27.847782] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:37.989 [2024-10-30 16:08:27.847847] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:37.989 [2024-10-30 16:08:27.847936] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:37.989 [2024-10-30 16:08:27.848000] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:37.989 [2024-10-30 16:08:27.848002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:38.248 16:08:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:38.248 16:08:27 -- common/autotest_common.sh@852 -- # return 0 00:24:38.248 16:08:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:38.248 16:08:27 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:38.248 16:08:27 -- common/autotest_common.sh@10 -- # set +x 00:24:38.248 16:08:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:38.248 16:08:27 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:24:38.248 16:08:27 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:24:38.248 16:08:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:38.248 16:08:27 -- common/autotest_common.sh@10 -- # set +x 00:24:38.248 16:08:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:38.248 16:08:27 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:38.248 16:08:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:38.248 16:08:27 -- common/autotest_common.sh@10 -- # set +x 00:24:38.248 16:08:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:38.248 16:08:28 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:24:38.248 16:08:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:38.248 16:08:28 -- common/autotest_common.sh@10 -- # set +x 00:24:38.248 [2024-10-30 16:08:28.044233] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:38.248 16:08:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:38.248 16:08:28 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:38.248 16:08:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:38.248 16:08:28 -- common/autotest_common.sh@10 -- # set +x 00:24:38.248 Malloc1 00:24:38.248 16:08:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:38.248 16:08:28 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:38.248 16:08:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:38.248 16:08:28 -- common/autotest_common.sh@10 -- # set +x 00:24:38.248 16:08:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:38.248 16:08:28 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:38.248 16:08:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:38.248 16:08:28 -- common/autotest_common.sh@10 -- # set +x 00:24:38.248 16:08:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:38.248 16:08:28 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:38.248 16:08:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:38.248 16:08:28 -- common/autotest_common.sh@10 -- # set +x 00:24:38.248 [2024-10-30 16:08:28.097139] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:38.248 16:08:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:38.248 16:08:28 -- target/perf_adq.sh@94 -- # perfpid=2488252 00:24:38.248 16:08:28 -- target/perf_adq.sh@95 -- # sleep 2 00:24:38.248 16:08:28 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:38.507 EAL: No free 2048 kB hugepages reported on node 1 00:24:40.411 16:08:30 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:24:40.411 16:08:30 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:24:40.411 16:08:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:40.411 16:08:30 -- common/autotest_common.sh@10 -- # set +x 00:24:40.411 16:08:30 -- target/perf_adq.sh@97 -- # wc -l 00:24:40.411 16:08:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:40.411 16:08:30 -- target/perf_adq.sh@97 -- # count=2 00:24:40.411 16:08:30 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:24:40.411 16:08:30 -- target/perf_adq.sh@103 -- # wait 2488252 00:24:48.609 Initializing NVMe Controllers 00:24:48.609 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:48.609 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:48.609 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:48.609 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:48.609 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:48.609 Initialization complete. Launching workers. 00:24:48.609 ======================================================== 00:24:48.609 Latency(us) 00:24:48.609 Device Information : IOPS MiB/s Average min max 00:24:48.609 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 4211.70 16.45 15265.54 2096.82 62318.67 00:24:48.609 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 5439.00 21.25 11771.83 1705.81 61106.49 00:24:48.609 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 4228.20 16.52 15178.73 1745.57 62915.20 00:24:48.609 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 15173.09 59.27 4218.19 2627.42 45642.54 00:24:48.609 ======================================================== 00:24:48.609 Total : 29051.99 113.48 8829.09 1705.81 62915.20 00:24:48.609 00:24:48.609 16:08:38 -- target/perf_adq.sh@104 -- # nvmftestfini 00:24:48.609 16:08:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:48.609 16:08:38 -- nvmf/common.sh@116 -- # sync 00:24:48.609 16:08:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:48.609 16:08:38 -- nvmf/common.sh@119 -- # set +e 00:24:48.609 16:08:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:48.609 16:08:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:48.609 rmmod nvme_tcp 00:24:48.609 rmmod nvme_fabrics 00:24:48.609 rmmod nvme_keyring 00:24:48.609 16:08:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:48.610 16:08:38 -- nvmf/common.sh@123 -- # set -e 00:24:48.610 16:08:38 -- nvmf/common.sh@124 -- # return 0 00:24:48.610 16:08:38 -- nvmf/common.sh@477 -- # '[' -n 2488105 ']' 00:24:48.610 16:08:38 -- nvmf/common.sh@478 -- # killprocess 2488105 00:24:48.610 16:08:38 -- common/autotest_common.sh@926 -- # '[' -z 2488105 ']' 00:24:48.610 16:08:38 -- common/autotest_common.sh@930 -- # kill -0 2488105 00:24:48.610 16:08:38 -- common/autotest_common.sh@931 -- # uname 00:24:48.610 16:08:38 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:48.610 16:08:38 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2488105 00:24:48.610 16:08:38 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:48.610 16:08:38 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:48.610 16:08:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2488105' 00:24:48.610 killing process with pid 2488105 00:24:48.610 16:08:38 -- common/autotest_common.sh@945 -- # kill 2488105 00:24:48.610 16:08:38 -- common/autotest_common.sh@950 -- # wait 2488105 00:24:48.869 16:08:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:48.869 16:08:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:48.869 16:08:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:48.869 16:08:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:48.869 16:08:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:48.869 16:08:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:48.869 16:08:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:48.869 16:08:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:52.158 16:08:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:52.158 16:08:41 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:24:52.158 00:24:52.158 real 0m45.813s 00:24:52.158 user 2m38.201s 00:24:52.158 sys 0m10.247s 00:24:52.158 16:08:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:52.158 16:08:41 -- common/autotest_common.sh@10 -- # set +x 00:24:52.158 ************************************ 00:24:52.158 END TEST nvmf_perf_adq 00:24:52.158 ************************************ 00:24:52.158 16:08:41 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:52.158 16:08:41 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:52.158 16:08:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:52.158 16:08:41 -- common/autotest_common.sh@10 -- # set +x 00:24:52.158 ************************************ 00:24:52.158 START TEST nvmf_shutdown 00:24:52.158 ************************************ 00:24:52.158 16:08:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:52.158 * Looking for test storage... 00:24:52.158 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:52.158 16:08:41 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:52.158 16:08:41 -- nvmf/common.sh@7 -- # uname -s 00:24:52.158 16:08:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:52.158 16:08:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:52.158 16:08:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:52.158 16:08:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:52.158 16:08:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:52.158 16:08:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:52.158 16:08:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:52.158 16:08:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:52.158 16:08:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:52.158 16:08:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:52.158 16:08:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:52.158 16:08:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:52.158 16:08:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:52.158 16:08:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:52.158 16:08:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:52.158 16:08:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:52.158 16:08:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:52.158 16:08:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:52.158 16:08:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:52.158 16:08:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:52.158 16:08:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:52.158 16:08:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:52.158 16:08:41 -- paths/export.sh@5 -- # export PATH 00:24:52.158 16:08:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:52.158 16:08:41 -- nvmf/common.sh@46 -- # : 0 00:24:52.158 16:08:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:52.158 16:08:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:52.158 16:08:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:52.158 16:08:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:52.158 16:08:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:52.158 16:08:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:52.159 16:08:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:52.159 16:08:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:52.159 16:08:41 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:52.159 16:08:41 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:52.159 16:08:41 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:24:52.159 16:08:41 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:24:52.159 16:08:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:52.159 16:08:41 -- common/autotest_common.sh@10 -- # set +x 00:24:52.159 ************************************ 00:24:52.159 START TEST nvmf_shutdown_tc1 00:24:52.159 ************************************ 00:24:52.159 16:08:41 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc1 00:24:52.159 16:08:41 -- target/shutdown.sh@74 -- # starttarget 00:24:52.159 16:08:41 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:52.159 16:08:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:52.159 16:08:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:52.159 16:08:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:52.159 16:08:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:52.159 16:08:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:52.159 16:08:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:52.159 16:08:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:52.159 16:08:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:52.159 16:08:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:52.159 16:08:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:52.159 16:08:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:52.159 16:08:41 -- common/autotest_common.sh@10 -- # set +x 00:24:54.069 16:08:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:54.069 16:08:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:54.069 16:08:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:54.069 16:08:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:54.069 16:08:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:54.069 16:08:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:54.069 16:08:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:54.069 16:08:43 -- nvmf/common.sh@294 -- # net_devs=() 00:24:54.069 16:08:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:54.069 16:08:43 -- nvmf/common.sh@295 -- # e810=() 00:24:54.069 16:08:43 -- nvmf/common.sh@295 -- # local -ga e810 00:24:54.069 16:08:43 -- nvmf/common.sh@296 -- # x722=() 00:24:54.069 16:08:43 -- nvmf/common.sh@296 -- # local -ga x722 00:24:54.069 16:08:43 -- nvmf/common.sh@297 -- # mlx=() 00:24:54.069 16:08:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:54.069 16:08:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:54.069 16:08:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:54.069 16:08:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:54.069 16:08:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:54.069 16:08:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:54.069 16:08:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:54.069 16:08:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:54.069 16:08:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:54.069 16:08:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:54.069 16:08:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:54.069 16:08:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:54.069 16:08:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:54.069 16:08:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:54.069 16:08:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:54.069 16:08:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:54.069 16:08:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:54.069 16:08:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:54.069 16:08:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:54.069 16:08:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:54.069 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:54.069 16:08:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:54.069 16:08:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:54.069 16:08:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:54.070 16:08:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:54.070 16:08:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:54.070 16:08:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:54.070 16:08:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:54.070 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:54.070 16:08:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:54.070 16:08:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:54.070 16:08:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:54.070 16:08:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:54.070 16:08:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:54.070 16:08:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:54.070 16:08:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:54.070 16:08:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:54.070 16:08:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:54.070 16:08:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:54.070 16:08:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:54.070 16:08:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:54.070 16:08:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:54.070 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:54.070 16:08:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:54.070 16:08:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:54.070 16:08:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:54.070 16:08:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:54.070 16:08:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:54.070 16:08:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:54.070 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:54.070 16:08:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:54.070 16:08:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:54.070 16:08:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:54.070 16:08:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:54.070 16:08:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:54.070 16:08:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:54.070 16:08:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:54.070 16:08:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:54.070 16:08:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:54.070 16:08:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:54.070 16:08:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:54.070 16:08:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:54.070 16:08:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:54.070 16:08:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:54.070 16:08:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:54.070 16:08:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:54.070 16:08:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:54.070 16:08:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:54.070 16:08:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:54.070 16:08:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:54.070 16:08:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:54.070 16:08:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:54.070 16:08:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:54.328 16:08:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:54.328 16:08:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:54.328 16:08:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:54.328 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:54.328 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.306 ms 00:24:54.328 00:24:54.328 --- 10.0.0.2 ping statistics --- 00:24:54.328 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:54.329 rtt min/avg/max/mdev = 0.306/0.306/0.306/0.000 ms 00:24:54.329 16:08:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:54.329 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:54.329 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.181 ms 00:24:54.329 00:24:54.329 --- 10.0.0.1 ping statistics --- 00:24:54.329 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:54.329 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:24:54.329 16:08:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:54.329 16:08:43 -- nvmf/common.sh@410 -- # return 0 00:24:54.329 16:08:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:54.329 16:08:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:54.329 16:08:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:54.329 16:08:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:54.329 16:08:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:54.329 16:08:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:54.329 16:08:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:54.329 16:08:44 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:54.329 16:08:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:54.329 16:08:44 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:54.329 16:08:44 -- common/autotest_common.sh@10 -- # set +x 00:24:54.329 16:08:44 -- nvmf/common.sh@469 -- # nvmfpid=2491593 00:24:54.329 16:08:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:54.329 16:08:44 -- nvmf/common.sh@470 -- # waitforlisten 2491593 00:24:54.329 16:08:44 -- common/autotest_common.sh@819 -- # '[' -z 2491593 ']' 00:24:54.329 16:08:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:54.329 16:08:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:54.329 16:08:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:54.329 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:54.329 16:08:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:54.329 16:08:44 -- common/autotest_common.sh@10 -- # set +x 00:24:54.329 [2024-10-30 16:08:44.060498] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:24:54.329 [2024-10-30 16:08:44.060582] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:54.329 EAL: No free 2048 kB hugepages reported on node 1 00:24:54.329 [2024-10-30 16:08:44.123790] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:54.585 [2024-10-30 16:08:44.208315] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:54.585 [2024-10-30 16:08:44.208459] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:54.585 [2024-10-30 16:08:44.208476] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:54.585 [2024-10-30 16:08:44.208489] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:54.585 [2024-10-30 16:08:44.208538] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:54.585 [2024-10-30 16:08:44.208600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:54.585 [2024-10-30 16:08:44.208653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:54.585 [2024-10-30 16:08:44.208656] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:55.516 16:08:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:55.516 16:08:45 -- common/autotest_common.sh@852 -- # return 0 00:24:55.516 16:08:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:55.516 16:08:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:55.516 16:08:45 -- common/autotest_common.sh@10 -- # set +x 00:24:55.516 16:08:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:55.516 16:08:45 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:55.516 16:08:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:55.516 16:08:45 -- common/autotest_common.sh@10 -- # set +x 00:24:55.516 [2024-10-30 16:08:45.087084] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:55.516 16:08:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:55.516 16:08:45 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:55.516 16:08:45 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:55.516 16:08:45 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:55.516 16:08:45 -- common/autotest_common.sh@10 -- # set +x 00:24:55.516 16:08:45 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:55.516 16:08:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.516 16:08:45 -- target/shutdown.sh@28 -- # cat 00:24:55.516 16:08:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.516 16:08:45 -- target/shutdown.sh@28 -- # cat 00:24:55.516 16:08:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.516 16:08:45 -- target/shutdown.sh@28 -- # cat 00:24:55.516 16:08:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.516 16:08:45 -- target/shutdown.sh@28 -- # cat 00:24:55.516 16:08:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.516 16:08:45 -- target/shutdown.sh@28 -- # cat 00:24:55.516 16:08:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.516 16:08:45 -- target/shutdown.sh@28 -- # cat 00:24:55.516 16:08:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.516 16:08:45 -- target/shutdown.sh@28 -- # cat 00:24:55.516 16:08:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.516 16:08:45 -- target/shutdown.sh@28 -- # cat 00:24:55.516 16:08:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.516 16:08:45 -- target/shutdown.sh@28 -- # cat 00:24:55.516 16:08:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:55.516 16:08:45 -- target/shutdown.sh@28 -- # cat 00:24:55.516 16:08:45 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:55.516 16:08:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:55.516 16:08:45 -- common/autotest_common.sh@10 -- # set +x 00:24:55.516 Malloc1 00:24:55.516 [2024-10-30 16:08:45.176687] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:55.516 Malloc2 00:24:55.516 Malloc3 00:24:55.516 Malloc4 00:24:55.516 Malloc5 00:24:55.774 Malloc6 00:24:55.774 Malloc7 00:24:55.774 Malloc8 00:24:55.774 Malloc9 00:24:55.774 Malloc10 00:24:55.774 16:08:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:55.774 16:08:45 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:55.774 16:08:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:55.774 16:08:45 -- common/autotest_common.sh@10 -- # set +x 00:24:55.774 16:08:45 -- target/shutdown.sh@78 -- # perfpid=2491793 00:24:55.774 16:08:45 -- target/shutdown.sh@79 -- # waitforlisten 2491793 /var/tmp/bdevperf.sock 00:24:55.774 16:08:45 -- common/autotest_common.sh@819 -- # '[' -z 2491793 ']' 00:24:55.774 16:08:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:55.774 16:08:45 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:55.774 16:08:45 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:24:55.774 16:08:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:55.774 16:08:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:55.774 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:55.774 16:08:45 -- nvmf/common.sh@520 -- # config=() 00:24:55.774 16:08:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:55.774 16:08:45 -- nvmf/common.sh@520 -- # local subsystem config 00:24:55.774 16:08:45 -- common/autotest_common.sh@10 -- # set +x 00:24:55.774 16:08:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.774 16:08:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.774 { 00:24:55.774 "params": { 00:24:55.774 "name": "Nvme$subsystem", 00:24:55.774 "trtype": "$TEST_TRANSPORT", 00:24:55.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.774 "adrfam": "ipv4", 00:24:55.774 "trsvcid": "$NVMF_PORT", 00:24:55.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.774 "hdgst": ${hdgst:-false}, 00:24:55.774 "ddgst": ${ddgst:-false} 00:24:55.774 }, 00:24:55.774 "method": "bdev_nvme_attach_controller" 00:24:55.774 } 00:24:55.774 EOF 00:24:55.774 )") 00:24:55.774 16:08:45 -- nvmf/common.sh@542 -- # cat 00:24:55.774 16:08:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.774 16:08:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.774 { 00:24:55.774 "params": { 00:24:55.774 "name": "Nvme$subsystem", 00:24:55.774 "trtype": "$TEST_TRANSPORT", 00:24:55.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.774 "adrfam": "ipv4", 00:24:55.774 "trsvcid": "$NVMF_PORT", 00:24:55.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.774 "hdgst": ${hdgst:-false}, 00:24:55.774 "ddgst": ${ddgst:-false} 00:24:55.774 }, 00:24:55.774 "method": "bdev_nvme_attach_controller" 00:24:55.774 } 00:24:55.774 EOF 00:24:55.774 )") 00:24:55.774 16:08:45 -- nvmf/common.sh@542 -- # cat 00:24:55.774 16:08:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.774 16:08:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.774 { 00:24:55.774 "params": { 00:24:55.774 "name": "Nvme$subsystem", 00:24:55.774 "trtype": "$TEST_TRANSPORT", 00:24:55.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.774 "adrfam": "ipv4", 00:24:55.774 "trsvcid": "$NVMF_PORT", 00:24:55.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.774 "hdgst": ${hdgst:-false}, 00:24:55.774 "ddgst": ${ddgst:-false} 00:24:55.774 }, 00:24:55.774 "method": "bdev_nvme_attach_controller" 00:24:55.774 } 00:24:55.774 EOF 00:24:55.774 )") 00:24:55.774 16:08:45 -- nvmf/common.sh@542 -- # cat 00:24:55.774 16:08:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.775 16:08:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.775 { 00:24:55.775 "params": { 00:24:55.775 "name": "Nvme$subsystem", 00:24:55.775 "trtype": "$TEST_TRANSPORT", 00:24:55.775 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.775 "adrfam": "ipv4", 00:24:55.775 "trsvcid": "$NVMF_PORT", 00:24:55.775 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.775 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.775 "hdgst": ${hdgst:-false}, 00:24:55.775 "ddgst": ${ddgst:-false} 00:24:55.775 }, 00:24:55.775 "method": "bdev_nvme_attach_controller" 00:24:55.775 } 00:24:55.775 EOF 00:24:55.775 )") 00:24:55.775 16:08:45 -- nvmf/common.sh@542 -- # cat 00:24:55.775 16:08:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.775 16:08:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.775 { 00:24:55.775 "params": { 00:24:55.775 "name": "Nvme$subsystem", 00:24:55.775 "trtype": "$TEST_TRANSPORT", 00:24:55.775 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.775 "adrfam": "ipv4", 00:24:55.775 "trsvcid": "$NVMF_PORT", 00:24:55.775 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.775 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.775 "hdgst": ${hdgst:-false}, 00:24:55.775 "ddgst": ${ddgst:-false} 00:24:55.775 }, 00:24:55.775 "method": "bdev_nvme_attach_controller" 00:24:55.775 } 00:24:55.775 EOF 00:24:55.775 )") 00:24:55.775 16:08:45 -- nvmf/common.sh@542 -- # cat 00:24:55.775 16:08:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.775 16:08:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.775 { 00:24:55.775 "params": { 00:24:55.775 "name": "Nvme$subsystem", 00:24:55.775 "trtype": "$TEST_TRANSPORT", 00:24:55.775 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.775 "adrfam": "ipv4", 00:24:55.775 "trsvcid": "$NVMF_PORT", 00:24:55.775 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.775 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.775 "hdgst": ${hdgst:-false}, 00:24:55.775 "ddgst": ${ddgst:-false} 00:24:55.775 }, 00:24:55.775 "method": "bdev_nvme_attach_controller" 00:24:55.775 } 00:24:55.775 EOF 00:24:55.775 )") 00:24:56.033 16:08:45 -- nvmf/common.sh@542 -- # cat 00:24:56.033 16:08:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:56.033 16:08:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:56.033 { 00:24:56.033 "params": { 00:24:56.033 "name": "Nvme$subsystem", 00:24:56.033 "trtype": "$TEST_TRANSPORT", 00:24:56.033 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:56.033 "adrfam": "ipv4", 00:24:56.033 "trsvcid": "$NVMF_PORT", 00:24:56.033 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:56.033 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:56.034 "hdgst": ${hdgst:-false}, 00:24:56.034 "ddgst": ${ddgst:-false} 00:24:56.034 }, 00:24:56.034 "method": "bdev_nvme_attach_controller" 00:24:56.034 } 00:24:56.034 EOF 00:24:56.034 )") 00:24:56.034 16:08:45 -- nvmf/common.sh@542 -- # cat 00:24:56.034 16:08:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:56.034 16:08:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:56.034 { 00:24:56.034 "params": { 00:24:56.034 "name": "Nvme$subsystem", 00:24:56.034 "trtype": "$TEST_TRANSPORT", 00:24:56.034 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:56.034 "adrfam": "ipv4", 00:24:56.034 "trsvcid": "$NVMF_PORT", 00:24:56.034 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:56.034 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:56.034 "hdgst": ${hdgst:-false}, 00:24:56.034 "ddgst": ${ddgst:-false} 00:24:56.034 }, 00:24:56.034 "method": "bdev_nvme_attach_controller" 00:24:56.034 } 00:24:56.034 EOF 00:24:56.034 )") 00:24:56.034 16:08:45 -- nvmf/common.sh@542 -- # cat 00:24:56.034 16:08:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:56.034 16:08:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:56.034 { 00:24:56.034 "params": { 00:24:56.034 "name": "Nvme$subsystem", 00:24:56.034 "trtype": "$TEST_TRANSPORT", 00:24:56.034 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:56.034 "adrfam": "ipv4", 00:24:56.034 "trsvcid": "$NVMF_PORT", 00:24:56.034 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:56.034 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:56.034 "hdgst": ${hdgst:-false}, 00:24:56.034 "ddgst": ${ddgst:-false} 00:24:56.034 }, 00:24:56.034 "method": "bdev_nvme_attach_controller" 00:24:56.034 } 00:24:56.034 EOF 00:24:56.034 )") 00:24:56.034 16:08:45 -- nvmf/common.sh@542 -- # cat 00:24:56.034 16:08:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:56.034 16:08:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:56.034 { 00:24:56.034 "params": { 00:24:56.034 "name": "Nvme$subsystem", 00:24:56.034 "trtype": "$TEST_TRANSPORT", 00:24:56.034 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:56.034 "adrfam": "ipv4", 00:24:56.034 "trsvcid": "$NVMF_PORT", 00:24:56.034 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:56.034 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:56.034 "hdgst": ${hdgst:-false}, 00:24:56.034 "ddgst": ${ddgst:-false} 00:24:56.034 }, 00:24:56.034 "method": "bdev_nvme_attach_controller" 00:24:56.034 } 00:24:56.034 EOF 00:24:56.034 )") 00:24:56.034 16:08:45 -- nvmf/common.sh@542 -- # cat 00:24:56.034 16:08:45 -- nvmf/common.sh@544 -- # jq . 00:24:56.034 16:08:45 -- nvmf/common.sh@545 -- # IFS=, 00:24:56.034 16:08:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:56.034 "params": { 00:24:56.034 "name": "Nvme1", 00:24:56.034 "trtype": "tcp", 00:24:56.034 "traddr": "10.0.0.2", 00:24:56.034 "adrfam": "ipv4", 00:24:56.034 "trsvcid": "4420", 00:24:56.034 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:56.034 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:56.034 "hdgst": false, 00:24:56.034 "ddgst": false 00:24:56.034 }, 00:24:56.034 "method": "bdev_nvme_attach_controller" 00:24:56.034 },{ 00:24:56.034 "params": { 00:24:56.034 "name": "Nvme2", 00:24:56.034 "trtype": "tcp", 00:24:56.034 "traddr": "10.0.0.2", 00:24:56.034 "adrfam": "ipv4", 00:24:56.034 "trsvcid": "4420", 00:24:56.034 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:56.034 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:56.034 "hdgst": false, 00:24:56.034 "ddgst": false 00:24:56.034 }, 00:24:56.034 "method": "bdev_nvme_attach_controller" 00:24:56.034 },{ 00:24:56.034 "params": { 00:24:56.034 "name": "Nvme3", 00:24:56.034 "trtype": "tcp", 00:24:56.034 "traddr": "10.0.0.2", 00:24:56.034 "adrfam": "ipv4", 00:24:56.034 "trsvcid": "4420", 00:24:56.034 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:56.034 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:56.034 "hdgst": false, 00:24:56.034 "ddgst": false 00:24:56.034 }, 00:24:56.034 "method": "bdev_nvme_attach_controller" 00:24:56.034 },{ 00:24:56.034 "params": { 00:24:56.034 "name": "Nvme4", 00:24:56.034 "trtype": "tcp", 00:24:56.034 "traddr": "10.0.0.2", 00:24:56.034 "adrfam": "ipv4", 00:24:56.034 "trsvcid": "4420", 00:24:56.034 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:56.034 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:56.034 "hdgst": false, 00:24:56.034 "ddgst": false 00:24:56.034 }, 00:24:56.034 "method": "bdev_nvme_attach_controller" 00:24:56.034 },{ 00:24:56.034 "params": { 00:24:56.034 "name": "Nvme5", 00:24:56.034 "trtype": "tcp", 00:24:56.034 "traddr": "10.0.0.2", 00:24:56.034 "adrfam": "ipv4", 00:24:56.034 "trsvcid": "4420", 00:24:56.034 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:56.034 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:56.034 "hdgst": false, 00:24:56.034 "ddgst": false 00:24:56.034 }, 00:24:56.034 "method": "bdev_nvme_attach_controller" 00:24:56.034 },{ 00:24:56.034 "params": { 00:24:56.034 "name": "Nvme6", 00:24:56.034 "trtype": "tcp", 00:24:56.034 "traddr": "10.0.0.2", 00:24:56.034 "adrfam": "ipv4", 00:24:56.034 "trsvcid": "4420", 00:24:56.034 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:56.034 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:56.034 "hdgst": false, 00:24:56.034 "ddgst": false 00:24:56.034 }, 00:24:56.034 "method": "bdev_nvme_attach_controller" 00:24:56.034 },{ 00:24:56.034 "params": { 00:24:56.034 "name": "Nvme7", 00:24:56.034 "trtype": "tcp", 00:24:56.034 "traddr": "10.0.0.2", 00:24:56.034 "adrfam": "ipv4", 00:24:56.034 "trsvcid": "4420", 00:24:56.034 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:56.034 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:56.034 "hdgst": false, 00:24:56.034 "ddgst": false 00:24:56.034 }, 00:24:56.034 "method": "bdev_nvme_attach_controller" 00:24:56.034 },{ 00:24:56.034 "params": { 00:24:56.034 "name": "Nvme8", 00:24:56.034 "trtype": "tcp", 00:24:56.034 "traddr": "10.0.0.2", 00:24:56.034 "adrfam": "ipv4", 00:24:56.034 "trsvcid": "4420", 00:24:56.034 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:56.034 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:56.034 "hdgst": false, 00:24:56.034 "ddgst": false 00:24:56.034 }, 00:24:56.034 "method": "bdev_nvme_attach_controller" 00:24:56.034 },{ 00:24:56.034 "params": { 00:24:56.034 "name": "Nvme9", 00:24:56.034 "trtype": "tcp", 00:24:56.034 "traddr": "10.0.0.2", 00:24:56.034 "adrfam": "ipv4", 00:24:56.034 "trsvcid": "4420", 00:24:56.034 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:56.034 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:56.034 "hdgst": false, 00:24:56.034 "ddgst": false 00:24:56.034 }, 00:24:56.034 "method": "bdev_nvme_attach_controller" 00:24:56.034 },{ 00:24:56.034 "params": { 00:24:56.034 "name": "Nvme10", 00:24:56.034 "trtype": "tcp", 00:24:56.034 "traddr": "10.0.0.2", 00:24:56.034 "adrfam": "ipv4", 00:24:56.034 "trsvcid": "4420", 00:24:56.034 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:56.034 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:56.034 "hdgst": false, 00:24:56.034 "ddgst": false 00:24:56.034 }, 00:24:56.034 "method": "bdev_nvme_attach_controller" 00:24:56.034 }' 00:24:56.034 [2024-10-30 16:08:45.674635] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:24:56.034 [2024-10-30 16:08:45.674707] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:24:56.034 EAL: No free 2048 kB hugepages reported on node 1 00:24:56.034 [2024-10-30 16:08:45.738955] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:56.034 [2024-10-30 16:08:45.823621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:57.933 16:08:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:57.933 16:08:47 -- common/autotest_common.sh@852 -- # return 0 00:24:57.933 16:08:47 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:57.933 16:08:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:24:57.933 16:08:47 -- common/autotest_common.sh@10 -- # set +x 00:24:57.933 16:08:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:24:57.933 16:08:47 -- target/shutdown.sh@83 -- # kill -9 2491793 00:24:57.933 16:08:47 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:24:57.933 16:08:47 -- target/shutdown.sh@87 -- # sleep 1 00:24:58.868 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 2491793 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:24:58.868 16:08:48 -- target/shutdown.sh@88 -- # kill -0 2491593 00:24:58.868 16:08:48 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:24:58.868 16:08:48 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:58.868 16:08:48 -- nvmf/common.sh@520 -- # config=() 00:24:58.868 16:08:48 -- nvmf/common.sh@520 -- # local subsystem config 00:24:58.868 16:08:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.868 16:08:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.868 { 00:24:58.868 "params": { 00:24:58.868 "name": "Nvme$subsystem", 00:24:58.868 "trtype": "$TEST_TRANSPORT", 00:24:58.868 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.868 "adrfam": "ipv4", 00:24:58.868 "trsvcid": "$NVMF_PORT", 00:24:58.868 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.869 "hdgst": ${hdgst:-false}, 00:24:58.869 "ddgst": ${ddgst:-false} 00:24:58.869 }, 00:24:58.869 "method": "bdev_nvme_attach_controller" 00:24:58.869 } 00:24:58.869 EOF 00:24:58.869 )") 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # cat 00:24:58.869 16:08:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.869 { 00:24:58.869 "params": { 00:24:58.869 "name": "Nvme$subsystem", 00:24:58.869 "trtype": "$TEST_TRANSPORT", 00:24:58.869 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.869 "adrfam": "ipv4", 00:24:58.869 "trsvcid": "$NVMF_PORT", 00:24:58.869 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.869 "hdgst": ${hdgst:-false}, 00:24:58.869 "ddgst": ${ddgst:-false} 00:24:58.869 }, 00:24:58.869 "method": "bdev_nvme_attach_controller" 00:24:58.869 } 00:24:58.869 EOF 00:24:58.869 )") 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # cat 00:24:58.869 16:08:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.869 { 00:24:58.869 "params": { 00:24:58.869 "name": "Nvme$subsystem", 00:24:58.869 "trtype": "$TEST_TRANSPORT", 00:24:58.869 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.869 "adrfam": "ipv4", 00:24:58.869 "trsvcid": "$NVMF_PORT", 00:24:58.869 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.869 "hdgst": ${hdgst:-false}, 00:24:58.869 "ddgst": ${ddgst:-false} 00:24:58.869 }, 00:24:58.869 "method": "bdev_nvme_attach_controller" 00:24:58.869 } 00:24:58.869 EOF 00:24:58.869 )") 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # cat 00:24:58.869 16:08:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.869 { 00:24:58.869 "params": { 00:24:58.869 "name": "Nvme$subsystem", 00:24:58.869 "trtype": "$TEST_TRANSPORT", 00:24:58.869 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.869 "adrfam": "ipv4", 00:24:58.869 "trsvcid": "$NVMF_PORT", 00:24:58.869 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.869 "hdgst": ${hdgst:-false}, 00:24:58.869 "ddgst": ${ddgst:-false} 00:24:58.869 }, 00:24:58.869 "method": "bdev_nvme_attach_controller" 00:24:58.869 } 00:24:58.869 EOF 00:24:58.869 )") 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # cat 00:24:58.869 16:08:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.869 { 00:24:58.869 "params": { 00:24:58.869 "name": "Nvme$subsystem", 00:24:58.869 "trtype": "$TEST_TRANSPORT", 00:24:58.869 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.869 "adrfam": "ipv4", 00:24:58.869 "trsvcid": "$NVMF_PORT", 00:24:58.869 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.869 "hdgst": ${hdgst:-false}, 00:24:58.869 "ddgst": ${ddgst:-false} 00:24:58.869 }, 00:24:58.869 "method": "bdev_nvme_attach_controller" 00:24:58.869 } 00:24:58.869 EOF 00:24:58.869 )") 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # cat 00:24:58.869 16:08:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.869 { 00:24:58.869 "params": { 00:24:58.869 "name": "Nvme$subsystem", 00:24:58.869 "trtype": "$TEST_TRANSPORT", 00:24:58.869 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.869 "adrfam": "ipv4", 00:24:58.869 "trsvcid": "$NVMF_PORT", 00:24:58.869 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.869 "hdgst": ${hdgst:-false}, 00:24:58.869 "ddgst": ${ddgst:-false} 00:24:58.869 }, 00:24:58.869 "method": "bdev_nvme_attach_controller" 00:24:58.869 } 00:24:58.869 EOF 00:24:58.869 )") 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # cat 00:24:58.869 16:08:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.869 { 00:24:58.869 "params": { 00:24:58.869 "name": "Nvme$subsystem", 00:24:58.869 "trtype": "$TEST_TRANSPORT", 00:24:58.869 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.869 "adrfam": "ipv4", 00:24:58.869 "trsvcid": "$NVMF_PORT", 00:24:58.869 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.869 "hdgst": ${hdgst:-false}, 00:24:58.869 "ddgst": ${ddgst:-false} 00:24:58.869 }, 00:24:58.869 "method": "bdev_nvme_attach_controller" 00:24:58.869 } 00:24:58.869 EOF 00:24:58.869 )") 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # cat 00:24:58.869 16:08:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.869 { 00:24:58.869 "params": { 00:24:58.869 "name": "Nvme$subsystem", 00:24:58.869 "trtype": "$TEST_TRANSPORT", 00:24:58.869 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.869 "adrfam": "ipv4", 00:24:58.869 "trsvcid": "$NVMF_PORT", 00:24:58.869 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.869 "hdgst": ${hdgst:-false}, 00:24:58.869 "ddgst": ${ddgst:-false} 00:24:58.869 }, 00:24:58.869 "method": "bdev_nvme_attach_controller" 00:24:58.869 } 00:24:58.869 EOF 00:24:58.869 )") 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # cat 00:24:58.869 16:08:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.869 { 00:24:58.869 "params": { 00:24:58.869 "name": "Nvme$subsystem", 00:24:58.869 "trtype": "$TEST_TRANSPORT", 00:24:58.869 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.869 "adrfam": "ipv4", 00:24:58.869 "trsvcid": "$NVMF_PORT", 00:24:58.869 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.869 "hdgst": ${hdgst:-false}, 00:24:58.869 "ddgst": ${ddgst:-false} 00:24:58.869 }, 00:24:58.869 "method": "bdev_nvme_attach_controller" 00:24:58.869 } 00:24:58.869 EOF 00:24:58.869 )") 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # cat 00:24:58.869 16:08:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.869 { 00:24:58.869 "params": { 00:24:58.869 "name": "Nvme$subsystem", 00:24:58.869 "trtype": "$TEST_TRANSPORT", 00:24:58.869 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.869 "adrfam": "ipv4", 00:24:58.869 "trsvcid": "$NVMF_PORT", 00:24:58.869 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.869 "hdgst": ${hdgst:-false}, 00:24:58.869 "ddgst": ${ddgst:-false} 00:24:58.869 }, 00:24:58.869 "method": "bdev_nvme_attach_controller" 00:24:58.869 } 00:24:58.869 EOF 00:24:58.869 )") 00:24:58.869 16:08:48 -- nvmf/common.sh@542 -- # cat 00:24:58.869 16:08:48 -- nvmf/common.sh@544 -- # jq . 00:24:58.869 16:08:48 -- nvmf/common.sh@545 -- # IFS=, 00:24:58.869 16:08:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:58.869 "params": { 00:24:58.869 "name": "Nvme1", 00:24:58.869 "trtype": "tcp", 00:24:58.869 "traddr": "10.0.0.2", 00:24:58.869 "adrfam": "ipv4", 00:24:58.869 "trsvcid": "4420", 00:24:58.869 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:58.869 "hdgst": false, 00:24:58.869 "ddgst": false 00:24:58.869 }, 00:24:58.869 "method": "bdev_nvme_attach_controller" 00:24:58.869 },{ 00:24:58.869 "params": { 00:24:58.869 "name": "Nvme2", 00:24:58.869 "trtype": "tcp", 00:24:58.869 "traddr": "10.0.0.2", 00:24:58.869 "adrfam": "ipv4", 00:24:58.869 "trsvcid": "4420", 00:24:58.869 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:58.869 "hdgst": false, 00:24:58.869 "ddgst": false 00:24:58.869 }, 00:24:58.869 "method": "bdev_nvme_attach_controller" 00:24:58.869 },{ 00:24:58.869 "params": { 00:24:58.869 "name": "Nvme3", 00:24:58.869 "trtype": "tcp", 00:24:58.869 "traddr": "10.0.0.2", 00:24:58.869 "adrfam": "ipv4", 00:24:58.869 "trsvcid": "4420", 00:24:58.869 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:58.869 "hdgst": false, 00:24:58.869 "ddgst": false 00:24:58.869 }, 00:24:58.869 "method": "bdev_nvme_attach_controller" 00:24:58.869 },{ 00:24:58.869 "params": { 00:24:58.869 "name": "Nvme4", 00:24:58.869 "trtype": "tcp", 00:24:58.869 "traddr": "10.0.0.2", 00:24:58.869 "adrfam": "ipv4", 00:24:58.869 "trsvcid": "4420", 00:24:58.869 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:58.869 "hdgst": false, 00:24:58.869 "ddgst": false 00:24:58.869 }, 00:24:58.869 "method": "bdev_nvme_attach_controller" 00:24:58.869 },{ 00:24:58.869 "params": { 00:24:58.869 "name": "Nvme5", 00:24:58.869 "trtype": "tcp", 00:24:58.869 "traddr": "10.0.0.2", 00:24:58.869 "adrfam": "ipv4", 00:24:58.869 "trsvcid": "4420", 00:24:58.869 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:58.869 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:58.869 "hdgst": false, 00:24:58.870 "ddgst": false 00:24:58.870 }, 00:24:58.870 "method": "bdev_nvme_attach_controller" 00:24:58.870 },{ 00:24:58.870 "params": { 00:24:58.870 "name": "Nvme6", 00:24:58.870 "trtype": "tcp", 00:24:58.870 "traddr": "10.0.0.2", 00:24:58.870 "adrfam": "ipv4", 00:24:58.870 "trsvcid": "4420", 00:24:58.870 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:58.870 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:58.870 "hdgst": false, 00:24:58.870 "ddgst": false 00:24:58.870 }, 00:24:58.870 "method": "bdev_nvme_attach_controller" 00:24:58.870 },{ 00:24:58.870 "params": { 00:24:58.870 "name": "Nvme7", 00:24:58.870 "trtype": "tcp", 00:24:58.870 "traddr": "10.0.0.2", 00:24:58.870 "adrfam": "ipv4", 00:24:58.870 "trsvcid": "4420", 00:24:58.870 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:58.870 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:58.870 "hdgst": false, 00:24:58.870 "ddgst": false 00:24:58.870 }, 00:24:58.870 "method": "bdev_nvme_attach_controller" 00:24:58.870 },{ 00:24:58.870 "params": { 00:24:58.870 "name": "Nvme8", 00:24:58.870 "trtype": "tcp", 00:24:58.870 "traddr": "10.0.0.2", 00:24:58.870 "adrfam": "ipv4", 00:24:58.870 "trsvcid": "4420", 00:24:58.870 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:58.870 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:58.870 "hdgst": false, 00:24:58.870 "ddgst": false 00:24:58.870 }, 00:24:58.870 "method": "bdev_nvme_attach_controller" 00:24:58.870 },{ 00:24:58.870 "params": { 00:24:58.870 "name": "Nvme9", 00:24:58.870 "trtype": "tcp", 00:24:58.870 "traddr": "10.0.0.2", 00:24:58.870 "adrfam": "ipv4", 00:24:58.870 "trsvcid": "4420", 00:24:58.870 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:58.870 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:58.870 "hdgst": false, 00:24:58.870 "ddgst": false 00:24:58.870 }, 00:24:58.870 "method": "bdev_nvme_attach_controller" 00:24:58.870 },{ 00:24:58.870 "params": { 00:24:58.870 "name": "Nvme10", 00:24:58.870 "trtype": "tcp", 00:24:58.870 "traddr": "10.0.0.2", 00:24:58.870 "adrfam": "ipv4", 00:24:58.870 "trsvcid": "4420", 00:24:58.870 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:58.870 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:58.870 "hdgst": false, 00:24:58.870 "ddgst": false 00:24:58.870 }, 00:24:58.870 "method": "bdev_nvme_attach_controller" 00:24:58.870 }' 00:24:58.870 [2024-10-30 16:08:48.440099] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:24:58.870 [2024-10-30 16:08:48.440181] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2492220 ] 00:24:58.870 EAL: No free 2048 kB hugepages reported on node 1 00:24:58.870 [2024-10-30 16:08:48.505652] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:58.870 [2024-10-30 16:08:48.594910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:00.253 Running I/O for 1 seconds... 00:25:01.626 00:25:01.626 Latency(us) 00:25:01.626 [2024-10-30T15:08:51.502Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:01.626 [2024-10-30T15:08:51.502Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:01.626 Verification LBA range: start 0x0 length 0x400 00:25:01.626 Nvme1n1 : 1.09 366.30 22.89 0.00 0.00 168219.07 62526.20 125052.40 00:25:01.626 [2024-10-30T15:08:51.502Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:01.626 Verification LBA range: start 0x0 length 0x400 00:25:01.626 Nvme2n1 : 1.09 369.25 23.08 0.00 0.00 166067.04 38641.97 151460.98 00:25:01.626 [2024-10-30T15:08:51.502Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:01.626 Verification LBA range: start 0x0 length 0x400 00:25:01.626 Nvme3n1 : 1.09 364.80 22.80 0.00 0.00 166126.50 64079.64 125829.12 00:25:01.626 [2024-10-30T15:08:51.502Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:01.626 Verification LBA range: start 0x0 length 0x400 00:25:01.626 Nvme4n1 : 1.09 364.27 22.77 0.00 0.00 165125.84 64468.01 127382.57 00:25:01.626 [2024-10-30T15:08:51.502Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:01.626 Verification LBA range: start 0x0 length 0x400 00:25:01.626 Nvme5n1 : 1.12 388.85 24.30 0.00 0.00 157629.91 13398.47 128159.29 00:25:01.626 [2024-10-30T15:08:51.502Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:01.626 Verification LBA range: start 0x0 length 0x400 00:25:01.626 Nvme6n1 : 1.12 388.17 24.26 0.00 0.00 156725.45 12815.93 124275.67 00:25:01.626 [2024-10-30T15:08:51.502Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:01.626 Verification LBA range: start 0x0 length 0x400 00:25:01.626 Nvme7n1 : 1.12 387.20 24.20 0.00 0.00 155911.14 13592.65 128159.29 00:25:01.626 [2024-10-30T15:08:51.502Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:01.626 Verification LBA range: start 0x0 length 0x400 00:25:01.626 Nvme8n1 : 1.12 386.79 24.17 0.00 0.00 155016.07 13398.47 128936.01 00:25:01.626 [2024-10-30T15:08:51.502Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:01.626 Verification LBA range: start 0x0 length 0x400 00:25:01.626 Nvme9n1 : 1.12 386.34 24.15 0.00 0.00 154255.85 12039.21 128936.01 00:25:01.626 [2024-10-30T15:08:51.502Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:01.626 Verification LBA range: start 0x0 length 0x400 00:25:01.626 Nvme10n1 : 1.13 389.67 24.35 0.00 0.00 151812.29 13398.47 129712.73 00:25:01.626 [2024-10-30T15:08:51.502Z] =================================================================================================================== 00:25:01.626 [2024-10-30T15:08:51.502Z] Total : 3791.63 236.98 0.00 0.00 159456.32 12039.21 151460.98 00:25:01.626 16:08:51 -- target/shutdown.sh@93 -- # stoptarget 00:25:01.626 16:08:51 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:01.626 16:08:51 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:01.626 16:08:51 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:01.626 16:08:51 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:01.626 16:08:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:01.626 16:08:51 -- nvmf/common.sh@116 -- # sync 00:25:01.626 16:08:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:01.626 16:08:51 -- nvmf/common.sh@119 -- # set +e 00:25:01.626 16:08:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:01.626 16:08:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:01.626 rmmod nvme_tcp 00:25:01.626 rmmod nvme_fabrics 00:25:01.626 rmmod nvme_keyring 00:25:01.626 16:08:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:01.626 16:08:51 -- nvmf/common.sh@123 -- # set -e 00:25:01.626 16:08:51 -- nvmf/common.sh@124 -- # return 0 00:25:01.626 16:08:51 -- nvmf/common.sh@477 -- # '[' -n 2491593 ']' 00:25:01.626 16:08:51 -- nvmf/common.sh@478 -- # killprocess 2491593 00:25:01.626 16:08:51 -- common/autotest_common.sh@926 -- # '[' -z 2491593 ']' 00:25:01.626 16:08:51 -- common/autotest_common.sh@930 -- # kill -0 2491593 00:25:01.626 16:08:51 -- common/autotest_common.sh@931 -- # uname 00:25:01.626 16:08:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:01.626 16:08:51 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2491593 00:25:01.626 16:08:51 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:01.626 16:08:51 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:01.626 16:08:51 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2491593' 00:25:01.626 killing process with pid 2491593 00:25:01.626 16:08:51 -- common/autotest_common.sh@945 -- # kill 2491593 00:25:01.626 16:08:51 -- common/autotest_common.sh@950 -- # wait 2491593 00:25:02.192 16:08:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:02.192 16:08:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:02.192 16:08:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:02.192 16:08:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:02.192 16:08:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:02.192 16:08:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:02.192 16:08:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:02.192 16:08:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:04.729 16:08:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:04.729 00:25:04.729 real 0m12.262s 00:25:04.729 user 0m35.814s 00:25:04.729 sys 0m3.353s 00:25:04.729 16:08:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:04.729 16:08:54 -- common/autotest_common.sh@10 -- # set +x 00:25:04.729 ************************************ 00:25:04.729 END TEST nvmf_shutdown_tc1 00:25:04.729 ************************************ 00:25:04.729 16:08:54 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:04.729 16:08:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:25:04.729 16:08:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:04.729 16:08:54 -- common/autotest_common.sh@10 -- # set +x 00:25:04.729 ************************************ 00:25:04.729 START TEST nvmf_shutdown_tc2 00:25:04.729 ************************************ 00:25:04.729 16:08:54 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc2 00:25:04.729 16:08:54 -- target/shutdown.sh@98 -- # starttarget 00:25:04.729 16:08:54 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:04.729 16:08:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:04.729 16:08:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:04.729 16:08:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:04.729 16:08:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:04.729 16:08:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:04.729 16:08:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:04.729 16:08:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:04.729 16:08:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:04.729 16:08:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:04.729 16:08:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:04.729 16:08:54 -- common/autotest_common.sh@10 -- # set +x 00:25:04.729 16:08:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:04.729 16:08:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:04.729 16:08:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:04.729 16:08:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:04.729 16:08:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:04.729 16:08:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:04.729 16:08:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:04.729 16:08:54 -- nvmf/common.sh@294 -- # net_devs=() 00:25:04.729 16:08:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:04.729 16:08:54 -- nvmf/common.sh@295 -- # e810=() 00:25:04.729 16:08:54 -- nvmf/common.sh@295 -- # local -ga e810 00:25:04.729 16:08:54 -- nvmf/common.sh@296 -- # x722=() 00:25:04.729 16:08:54 -- nvmf/common.sh@296 -- # local -ga x722 00:25:04.729 16:08:54 -- nvmf/common.sh@297 -- # mlx=() 00:25:04.729 16:08:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:04.729 16:08:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:04.729 16:08:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:04.729 16:08:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:04.729 16:08:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:04.729 16:08:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:04.729 16:08:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:04.729 16:08:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:04.729 16:08:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:04.729 16:08:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:04.729 16:08:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:04.729 16:08:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:04.729 16:08:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:04.729 16:08:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:04.729 16:08:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:04.729 16:08:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:04.729 16:08:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:04.729 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:04.729 16:08:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:04.729 16:08:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:04.729 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:04.729 16:08:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:04.729 16:08:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:04.729 16:08:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:04.729 16:08:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:04.729 16:08:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:04.729 16:08:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:04.729 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:04.729 16:08:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:04.729 16:08:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:04.729 16:08:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:04.729 16:08:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:04.729 16:08:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:04.729 16:08:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:04.729 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:04.729 16:08:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:04.729 16:08:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:04.729 16:08:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:04.729 16:08:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:04.729 16:08:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:04.729 16:08:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:04.729 16:08:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:04.729 16:08:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:04.729 16:08:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:04.729 16:08:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:04.729 16:08:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:04.729 16:08:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:04.729 16:08:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:04.729 16:08:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:04.729 16:08:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:04.729 16:08:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:04.729 16:08:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:04.729 16:08:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:04.729 16:08:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:04.729 16:08:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:04.729 16:08:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:04.729 16:08:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:04.729 16:08:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:04.729 16:08:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:04.729 16:08:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:04.729 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:04.729 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.342 ms 00:25:04.729 00:25:04.729 --- 10.0.0.2 ping statistics --- 00:25:04.729 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:04.729 rtt min/avg/max/mdev = 0.342/0.342/0.342/0.000 ms 00:25:04.729 16:08:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:04.729 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:04.729 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.181 ms 00:25:04.729 00:25:04.729 --- 10.0.0.1 ping statistics --- 00:25:04.729 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:04.729 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:25:04.729 16:08:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:04.729 16:08:54 -- nvmf/common.sh@410 -- # return 0 00:25:04.729 16:08:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:04.730 16:08:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:04.730 16:08:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:04.730 16:08:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:04.730 16:08:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:04.730 16:08:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:04.730 16:08:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:04.730 16:08:54 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:04.730 16:08:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:04.730 16:08:54 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:04.730 16:08:54 -- common/autotest_common.sh@10 -- # set +x 00:25:04.730 16:08:54 -- nvmf/common.sh@469 -- # nvmfpid=2492998 00:25:04.730 16:08:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:04.730 16:08:54 -- nvmf/common.sh@470 -- # waitforlisten 2492998 00:25:04.730 16:08:54 -- common/autotest_common.sh@819 -- # '[' -z 2492998 ']' 00:25:04.730 16:08:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:04.730 16:08:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:04.730 16:08:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:04.730 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:04.730 16:08:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:04.730 16:08:54 -- common/autotest_common.sh@10 -- # set +x 00:25:04.730 [2024-10-30 16:08:54.313789] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:25:04.730 [2024-10-30 16:08:54.313872] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:04.730 EAL: No free 2048 kB hugepages reported on node 1 00:25:04.730 [2024-10-30 16:08:54.377551] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:04.730 [2024-10-30 16:08:54.463119] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:04.730 [2024-10-30 16:08:54.463274] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:04.730 [2024-10-30 16:08:54.463292] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:04.730 [2024-10-30 16:08:54.463305] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:04.730 [2024-10-30 16:08:54.463394] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:04.730 [2024-10-30 16:08:54.463459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:04.730 [2024-10-30 16:08:54.463507] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:04.730 [2024-10-30 16:08:54.463509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:05.664 16:08:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:05.664 16:08:55 -- common/autotest_common.sh@852 -- # return 0 00:25:05.664 16:08:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:05.664 16:08:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:05.664 16:08:55 -- common/autotest_common.sh@10 -- # set +x 00:25:05.664 16:08:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:05.664 16:08:55 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:05.664 16:08:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:05.664 16:08:55 -- common/autotest_common.sh@10 -- # set +x 00:25:05.664 [2024-10-30 16:08:55.343050] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:05.664 16:08:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:05.664 16:08:55 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:05.664 16:08:55 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:05.664 16:08:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:05.664 16:08:55 -- common/autotest_common.sh@10 -- # set +x 00:25:05.664 16:08:55 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:05.664 16:08:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:05.664 16:08:55 -- target/shutdown.sh@28 -- # cat 00:25:05.664 16:08:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:05.664 16:08:55 -- target/shutdown.sh@28 -- # cat 00:25:05.664 16:08:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:05.664 16:08:55 -- target/shutdown.sh@28 -- # cat 00:25:05.664 16:08:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:05.664 16:08:55 -- target/shutdown.sh@28 -- # cat 00:25:05.664 16:08:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:05.664 16:08:55 -- target/shutdown.sh@28 -- # cat 00:25:05.664 16:08:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:05.664 16:08:55 -- target/shutdown.sh@28 -- # cat 00:25:05.664 16:08:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:05.664 16:08:55 -- target/shutdown.sh@28 -- # cat 00:25:05.664 16:08:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:05.664 16:08:55 -- target/shutdown.sh@28 -- # cat 00:25:05.664 16:08:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:05.664 16:08:55 -- target/shutdown.sh@28 -- # cat 00:25:05.664 16:08:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:05.664 16:08:55 -- target/shutdown.sh@28 -- # cat 00:25:05.664 16:08:55 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:05.664 16:08:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:05.665 16:08:55 -- common/autotest_common.sh@10 -- # set +x 00:25:05.665 Malloc1 00:25:05.665 [2024-10-30 16:08:55.432803] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:05.665 Malloc2 00:25:05.665 Malloc3 00:25:05.922 Malloc4 00:25:05.922 Malloc5 00:25:05.922 Malloc6 00:25:05.922 Malloc7 00:25:05.922 Malloc8 00:25:06.181 Malloc9 00:25:06.181 Malloc10 00:25:06.181 16:08:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:06.181 16:08:55 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:06.181 16:08:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:06.181 16:08:55 -- common/autotest_common.sh@10 -- # set +x 00:25:06.181 16:08:55 -- target/shutdown.sh@102 -- # perfpid=2493196 00:25:06.181 16:08:55 -- target/shutdown.sh@103 -- # waitforlisten 2493196 /var/tmp/bdevperf.sock 00:25:06.181 16:08:55 -- common/autotest_common.sh@819 -- # '[' -z 2493196 ']' 00:25:06.181 16:08:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:06.181 16:08:55 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:06.181 16:08:55 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:06.181 16:08:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:06.181 16:08:55 -- nvmf/common.sh@520 -- # config=() 00:25:06.181 16:08:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:06.181 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:06.181 16:08:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:06.181 16:08:55 -- nvmf/common.sh@520 -- # local subsystem config 00:25:06.181 16:08:55 -- common/autotest_common.sh@10 -- # set +x 00:25:06.181 16:08:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.181 16:08:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.181 { 00:25:06.181 "params": { 00:25:06.181 "name": "Nvme$subsystem", 00:25:06.181 "trtype": "$TEST_TRANSPORT", 00:25:06.181 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.181 "adrfam": "ipv4", 00:25:06.181 "trsvcid": "$NVMF_PORT", 00:25:06.181 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.181 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.181 "hdgst": ${hdgst:-false}, 00:25:06.181 "ddgst": ${ddgst:-false} 00:25:06.181 }, 00:25:06.181 "method": "bdev_nvme_attach_controller" 00:25:06.181 } 00:25:06.181 EOF 00:25:06.181 )") 00:25:06.181 16:08:55 -- nvmf/common.sh@542 -- # cat 00:25:06.181 16:08:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.181 16:08:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.181 { 00:25:06.181 "params": { 00:25:06.181 "name": "Nvme$subsystem", 00:25:06.181 "trtype": "$TEST_TRANSPORT", 00:25:06.181 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.181 "adrfam": "ipv4", 00:25:06.181 "trsvcid": "$NVMF_PORT", 00:25:06.181 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.181 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.181 "hdgst": ${hdgst:-false}, 00:25:06.181 "ddgst": ${ddgst:-false} 00:25:06.181 }, 00:25:06.181 "method": "bdev_nvme_attach_controller" 00:25:06.181 } 00:25:06.181 EOF 00:25:06.181 )") 00:25:06.181 16:08:55 -- nvmf/common.sh@542 -- # cat 00:25:06.181 16:08:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.181 16:08:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.181 { 00:25:06.181 "params": { 00:25:06.181 "name": "Nvme$subsystem", 00:25:06.181 "trtype": "$TEST_TRANSPORT", 00:25:06.181 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.181 "adrfam": "ipv4", 00:25:06.181 "trsvcid": "$NVMF_PORT", 00:25:06.181 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.181 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.181 "hdgst": ${hdgst:-false}, 00:25:06.181 "ddgst": ${ddgst:-false} 00:25:06.181 }, 00:25:06.181 "method": "bdev_nvme_attach_controller" 00:25:06.181 } 00:25:06.181 EOF 00:25:06.181 )") 00:25:06.181 16:08:55 -- nvmf/common.sh@542 -- # cat 00:25:06.181 16:08:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.181 16:08:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.181 { 00:25:06.181 "params": { 00:25:06.181 "name": "Nvme$subsystem", 00:25:06.181 "trtype": "$TEST_TRANSPORT", 00:25:06.181 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.181 "adrfam": "ipv4", 00:25:06.181 "trsvcid": "$NVMF_PORT", 00:25:06.181 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.181 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.181 "hdgst": ${hdgst:-false}, 00:25:06.181 "ddgst": ${ddgst:-false} 00:25:06.181 }, 00:25:06.181 "method": "bdev_nvme_attach_controller" 00:25:06.181 } 00:25:06.181 EOF 00:25:06.181 )") 00:25:06.181 16:08:55 -- nvmf/common.sh@542 -- # cat 00:25:06.181 16:08:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.181 16:08:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.181 { 00:25:06.181 "params": { 00:25:06.181 "name": "Nvme$subsystem", 00:25:06.181 "trtype": "$TEST_TRANSPORT", 00:25:06.181 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.181 "adrfam": "ipv4", 00:25:06.181 "trsvcid": "$NVMF_PORT", 00:25:06.181 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.181 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.181 "hdgst": ${hdgst:-false}, 00:25:06.181 "ddgst": ${ddgst:-false} 00:25:06.181 }, 00:25:06.181 "method": "bdev_nvme_attach_controller" 00:25:06.181 } 00:25:06.181 EOF 00:25:06.181 )") 00:25:06.182 16:08:55 -- nvmf/common.sh@542 -- # cat 00:25:06.182 16:08:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.182 16:08:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.182 { 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme$subsystem", 00:25:06.182 "trtype": "$TEST_TRANSPORT", 00:25:06.182 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "$NVMF_PORT", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.182 "hdgst": ${hdgst:-false}, 00:25:06.182 "ddgst": ${ddgst:-false} 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 } 00:25:06.182 EOF 00:25:06.182 )") 00:25:06.182 16:08:55 -- nvmf/common.sh@542 -- # cat 00:25:06.182 16:08:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.182 16:08:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.182 { 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme$subsystem", 00:25:06.182 "trtype": "$TEST_TRANSPORT", 00:25:06.182 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "$NVMF_PORT", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.182 "hdgst": ${hdgst:-false}, 00:25:06.182 "ddgst": ${ddgst:-false} 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 } 00:25:06.182 EOF 00:25:06.182 )") 00:25:06.182 16:08:55 -- nvmf/common.sh@542 -- # cat 00:25:06.182 16:08:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.182 16:08:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.182 { 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme$subsystem", 00:25:06.182 "trtype": "$TEST_TRANSPORT", 00:25:06.182 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "$NVMF_PORT", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.182 "hdgst": ${hdgst:-false}, 00:25:06.182 "ddgst": ${ddgst:-false} 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 } 00:25:06.182 EOF 00:25:06.182 )") 00:25:06.182 16:08:55 -- nvmf/common.sh@542 -- # cat 00:25:06.182 16:08:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.182 16:08:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.182 { 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme$subsystem", 00:25:06.182 "trtype": "$TEST_TRANSPORT", 00:25:06.182 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "$NVMF_PORT", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.182 "hdgst": ${hdgst:-false}, 00:25:06.182 "ddgst": ${ddgst:-false} 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 } 00:25:06.182 EOF 00:25:06.182 )") 00:25:06.182 16:08:55 -- nvmf/common.sh@542 -- # cat 00:25:06.182 16:08:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:06.182 16:08:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:06.182 { 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme$subsystem", 00:25:06.182 "trtype": "$TEST_TRANSPORT", 00:25:06.182 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "$NVMF_PORT", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:06.182 "hdgst": ${hdgst:-false}, 00:25:06.182 "ddgst": ${ddgst:-false} 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 } 00:25:06.182 EOF 00:25:06.182 )") 00:25:06.182 16:08:55 -- nvmf/common.sh@542 -- # cat 00:25:06.182 16:08:55 -- nvmf/common.sh@544 -- # jq . 00:25:06.182 16:08:55 -- nvmf/common.sh@545 -- # IFS=, 00:25:06.182 16:08:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme1", 00:25:06.182 "trtype": "tcp", 00:25:06.182 "traddr": "10.0.0.2", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "4420", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:06.182 "hdgst": false, 00:25:06.182 "ddgst": false 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 },{ 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme2", 00:25:06.182 "trtype": "tcp", 00:25:06.182 "traddr": "10.0.0.2", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "4420", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:06.182 "hdgst": false, 00:25:06.182 "ddgst": false 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 },{ 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme3", 00:25:06.182 "trtype": "tcp", 00:25:06.182 "traddr": "10.0.0.2", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "4420", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:06.182 "hdgst": false, 00:25:06.182 "ddgst": false 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 },{ 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme4", 00:25:06.182 "trtype": "tcp", 00:25:06.182 "traddr": "10.0.0.2", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "4420", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:06.182 "hdgst": false, 00:25:06.182 "ddgst": false 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 },{ 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme5", 00:25:06.182 "trtype": "tcp", 00:25:06.182 "traddr": "10.0.0.2", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "4420", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:06.182 "hdgst": false, 00:25:06.182 "ddgst": false 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 },{ 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme6", 00:25:06.182 "trtype": "tcp", 00:25:06.182 "traddr": "10.0.0.2", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "4420", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:06.182 "hdgst": false, 00:25:06.182 "ddgst": false 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 },{ 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme7", 00:25:06.182 "trtype": "tcp", 00:25:06.182 "traddr": "10.0.0.2", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "4420", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:06.182 "hdgst": false, 00:25:06.182 "ddgst": false 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 },{ 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme8", 00:25:06.182 "trtype": "tcp", 00:25:06.182 "traddr": "10.0.0.2", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "4420", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:06.182 "hdgst": false, 00:25:06.182 "ddgst": false 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 },{ 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme9", 00:25:06.182 "trtype": "tcp", 00:25:06.182 "traddr": "10.0.0.2", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "4420", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:06.182 "hdgst": false, 00:25:06.182 "ddgst": false 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 },{ 00:25:06.182 "params": { 00:25:06.182 "name": "Nvme10", 00:25:06.182 "trtype": "tcp", 00:25:06.182 "traddr": "10.0.0.2", 00:25:06.182 "adrfam": "ipv4", 00:25:06.182 "trsvcid": "4420", 00:25:06.182 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:06.182 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:06.182 "hdgst": false, 00:25:06.182 "ddgst": false 00:25:06.182 }, 00:25:06.182 "method": "bdev_nvme_attach_controller" 00:25:06.182 }' 00:25:06.182 [2024-10-30 16:08:55.941904] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:25:06.182 [2024-10-30 16:08:55.941982] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2493196 ] 00:25:06.182 EAL: No free 2048 kB hugepages reported on node 1 00:25:06.182 [2024-10-30 16:08:56.006647] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:06.441 [2024-10-30 16:08:56.092620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:07.815 Running I/O for 10 seconds... 00:25:08.073 16:08:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:08.073 16:08:57 -- common/autotest_common.sh@852 -- # return 0 00:25:08.073 16:08:57 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:08.073 16:08:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:08.073 16:08:57 -- common/autotest_common.sh@10 -- # set +x 00:25:08.073 16:08:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:08.073 16:08:57 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:08.073 16:08:57 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:08.073 16:08:57 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:08.073 16:08:57 -- target/shutdown.sh@57 -- # local ret=1 00:25:08.073 16:08:57 -- target/shutdown.sh@58 -- # local i 00:25:08.073 16:08:57 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:08.073 16:08:57 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:08.073 16:08:57 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:08.073 16:08:57 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:08.073 16:08:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:08.073 16:08:57 -- common/autotest_common.sh@10 -- # set +x 00:25:08.073 16:08:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:08.073 16:08:57 -- target/shutdown.sh@60 -- # read_io_count=42 00:25:08.073 16:08:57 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:25:08.073 16:08:57 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:08.331 16:08:58 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:08.331 16:08:58 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:08.331 16:08:58 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:08.331 16:08:58 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:08.331 16:08:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:08.331 16:08:58 -- common/autotest_common.sh@10 -- # set +x 00:25:08.331 16:08:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:08.331 16:08:58 -- target/shutdown.sh@60 -- # read_io_count=167 00:25:08.331 16:08:58 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:25:08.331 16:08:58 -- target/shutdown.sh@64 -- # ret=0 00:25:08.331 16:08:58 -- target/shutdown.sh@65 -- # break 00:25:08.331 16:08:58 -- target/shutdown.sh@69 -- # return 0 00:25:08.331 16:08:58 -- target/shutdown.sh@109 -- # killprocess 2493196 00:25:08.331 16:08:58 -- common/autotest_common.sh@926 -- # '[' -z 2493196 ']' 00:25:08.331 16:08:58 -- common/autotest_common.sh@930 -- # kill -0 2493196 00:25:08.331 16:08:58 -- common/autotest_common.sh@931 -- # uname 00:25:08.331 16:08:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:08.331 16:08:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2493196 00:25:08.331 16:08:58 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:08.331 16:08:58 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:08.331 16:08:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2493196' 00:25:08.331 killing process with pid 2493196 00:25:08.331 16:08:58 -- common/autotest_common.sh@945 -- # kill 2493196 00:25:08.331 16:08:58 -- common/autotest_common.sh@950 -- # wait 2493196 00:25:08.331 Received shutdown signal, test time was about 0.582702 seconds 00:25:08.331 00:25:08.331 Latency(us) 00:25:08.331 [2024-10-30T15:08:58.207Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:08.331 [2024-10-30T15:08:58.207Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:08.331 Verification LBA range: start 0x0 length 0x400 00:25:08.331 Nvme1n1 : 0.56 405.56 25.35 0.00 0.00 151566.58 25437.68 118838.61 00:25:08.331 [2024-10-30T15:08:58.207Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:08.331 Verification LBA range: start 0x0 length 0x400 00:25:08.331 Nvme2n1 : 0.56 404.57 25.29 0.00 0.00 149876.87 25243.50 116508.44 00:25:08.331 [2024-10-30T15:08:58.207Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:08.331 Verification LBA range: start 0x0 length 0x400 00:25:08.331 Nvme3n1 : 0.56 406.97 25.44 0.00 0.00 147437.69 20388.98 121945.51 00:25:08.331 [2024-10-30T15:08:58.207Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:08.331 Verification LBA range: start 0x0 length 0x400 00:25:08.331 Nvme4n1 : 0.57 401.43 25.09 0.00 0.00 146694.82 22427.88 116508.44 00:25:08.331 [2024-10-30T15:08:58.207Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:08.331 Verification LBA range: start 0x0 length 0x400 00:25:08.331 Nvme5n1 : 0.57 400.47 25.03 0.00 0.00 144949.96 25826.04 117285.17 00:25:08.331 [2024-10-30T15:08:58.207Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:08.331 Verification LBA range: start 0x0 length 0x400 00:25:08.331 Nvme6n1 : 0.57 403.51 25.22 0.00 0.00 142449.46 20000.62 119615.34 00:25:08.331 [2024-10-30T15:08:58.207Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:08.331 Verification LBA range: start 0x0 length 0x400 00:25:08.331 Nvme7n1 : 0.57 402.23 25.14 0.00 0.00 139985.82 26796.94 121168.78 00:25:08.331 [2024-10-30T15:08:58.207Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:08.331 Verification LBA range: start 0x0 length 0x400 00:25:08.331 Nvme8n1 : 0.58 393.38 24.59 0.00 0.00 142371.53 21845.33 122722.23 00:25:08.331 [2024-10-30T15:08:58.207Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:08.331 Verification LBA range: start 0x0 length 0x400 00:25:08.331 Nvme9n1 : 0.58 394.68 24.67 0.00 0.00 139658.96 23010.42 119615.34 00:25:08.331 [2024-10-30T15:08:58.207Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:08.331 Verification LBA range: start 0x0 length 0x400 00:25:08.331 Nvme10n1 : 0.58 398.70 24.92 0.00 0.00 138561.77 9272.13 123498.95 00:25:08.331 [2024-10-30T15:08:58.207Z] =================================================================================================================== 00:25:08.331 [2024-10-30T15:08:58.207Z] Total : 4011.51 250.72 0.00 0.00 144339.48 9272.13 123498.95 00:25:08.589 16:08:58 -- target/shutdown.sh@112 -- # sleep 1 00:25:09.961 16:08:59 -- target/shutdown.sh@113 -- # kill -0 2492998 00:25:09.961 16:08:59 -- target/shutdown.sh@115 -- # stoptarget 00:25:09.961 16:08:59 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:09.961 16:08:59 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:09.961 16:08:59 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:09.961 16:08:59 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:09.961 16:08:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:09.961 16:08:59 -- nvmf/common.sh@116 -- # sync 00:25:09.961 16:08:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:09.961 16:08:59 -- nvmf/common.sh@119 -- # set +e 00:25:09.961 16:08:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:09.961 16:08:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:09.961 rmmod nvme_tcp 00:25:09.961 rmmod nvme_fabrics 00:25:09.961 rmmod nvme_keyring 00:25:09.961 16:08:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:09.961 16:08:59 -- nvmf/common.sh@123 -- # set -e 00:25:09.961 16:08:59 -- nvmf/common.sh@124 -- # return 0 00:25:09.961 16:08:59 -- nvmf/common.sh@477 -- # '[' -n 2492998 ']' 00:25:09.961 16:08:59 -- nvmf/common.sh@478 -- # killprocess 2492998 00:25:09.961 16:08:59 -- common/autotest_common.sh@926 -- # '[' -z 2492998 ']' 00:25:09.961 16:08:59 -- common/autotest_common.sh@930 -- # kill -0 2492998 00:25:09.961 16:08:59 -- common/autotest_common.sh@931 -- # uname 00:25:09.961 16:08:59 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:09.961 16:08:59 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2492998 00:25:09.961 16:08:59 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:09.961 16:08:59 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:09.961 16:08:59 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2492998' 00:25:09.961 killing process with pid 2492998 00:25:09.961 16:08:59 -- common/autotest_common.sh@945 -- # kill 2492998 00:25:09.961 16:08:59 -- common/autotest_common.sh@950 -- # wait 2492998 00:25:10.219 16:08:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:10.219 16:08:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:10.219 16:08:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:10.219 16:08:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:10.219 16:08:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:10.219 16:08:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:10.219 16:08:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:10.219 16:08:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:12.124 16:09:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:12.124 00:25:12.124 real 0m7.917s 00:25:12.124 user 0m24.403s 00:25:12.124 sys 0m1.435s 00:25:12.124 16:09:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:12.124 16:09:01 -- common/autotest_common.sh@10 -- # set +x 00:25:12.124 ************************************ 00:25:12.124 END TEST nvmf_shutdown_tc2 00:25:12.124 ************************************ 00:25:12.384 16:09:02 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:12.384 16:09:02 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:25:12.384 16:09:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:12.384 16:09:02 -- common/autotest_common.sh@10 -- # set +x 00:25:12.384 ************************************ 00:25:12.384 START TEST nvmf_shutdown_tc3 00:25:12.384 ************************************ 00:25:12.384 16:09:02 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc3 00:25:12.384 16:09:02 -- target/shutdown.sh@120 -- # starttarget 00:25:12.384 16:09:02 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:12.384 16:09:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:12.384 16:09:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:12.384 16:09:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:12.384 16:09:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:12.384 16:09:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:12.384 16:09:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:12.384 16:09:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:12.384 16:09:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:12.384 16:09:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:12.384 16:09:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:12.384 16:09:02 -- common/autotest_common.sh@10 -- # set +x 00:25:12.384 16:09:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:12.384 16:09:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:12.384 16:09:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:12.384 16:09:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:12.384 16:09:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:12.384 16:09:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:12.384 16:09:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:12.384 16:09:02 -- nvmf/common.sh@294 -- # net_devs=() 00:25:12.384 16:09:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:12.384 16:09:02 -- nvmf/common.sh@295 -- # e810=() 00:25:12.384 16:09:02 -- nvmf/common.sh@295 -- # local -ga e810 00:25:12.384 16:09:02 -- nvmf/common.sh@296 -- # x722=() 00:25:12.384 16:09:02 -- nvmf/common.sh@296 -- # local -ga x722 00:25:12.384 16:09:02 -- nvmf/common.sh@297 -- # mlx=() 00:25:12.384 16:09:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:12.384 16:09:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:12.384 16:09:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:12.384 16:09:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:12.384 16:09:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:12.384 16:09:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:12.384 16:09:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:12.384 16:09:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:12.384 16:09:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:12.384 16:09:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:12.384 16:09:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:12.384 16:09:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:12.384 16:09:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:12.384 16:09:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:12.384 16:09:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:12.384 16:09:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:12.384 16:09:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:12.384 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:12.384 16:09:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:12.384 16:09:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:12.384 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:12.384 16:09:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:12.384 16:09:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:12.384 16:09:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:12.384 16:09:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:12.384 16:09:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:12.384 16:09:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:12.384 16:09:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:12.384 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:12.384 16:09:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:12.384 16:09:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:12.385 16:09:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:12.385 16:09:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:12.385 16:09:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:12.385 16:09:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:12.385 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:12.385 16:09:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:12.385 16:09:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:12.385 16:09:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:12.385 16:09:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:12.385 16:09:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:12.385 16:09:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:12.385 16:09:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:12.385 16:09:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:12.385 16:09:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:12.385 16:09:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:12.385 16:09:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:12.385 16:09:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:12.385 16:09:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:12.385 16:09:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:12.385 16:09:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:12.385 16:09:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:12.385 16:09:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:12.385 16:09:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:12.385 16:09:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:12.385 16:09:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:12.385 16:09:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:12.385 16:09:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:12.385 16:09:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:12.385 16:09:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:12.385 16:09:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:12.385 16:09:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:12.385 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:12.385 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:25:12.385 00:25:12.385 --- 10.0.0.2 ping statistics --- 00:25:12.385 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:12.385 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:25:12.385 16:09:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:12.385 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:12.385 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:25:12.385 00:25:12.385 --- 10.0.0.1 ping statistics --- 00:25:12.385 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:12.385 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:25:12.385 16:09:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:12.385 16:09:02 -- nvmf/common.sh@410 -- # return 0 00:25:12.385 16:09:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:12.385 16:09:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:12.385 16:09:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:12.385 16:09:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:12.385 16:09:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:12.385 16:09:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:12.385 16:09:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:12.385 16:09:02 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:12.385 16:09:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:12.385 16:09:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:12.385 16:09:02 -- common/autotest_common.sh@10 -- # set +x 00:25:12.385 16:09:02 -- nvmf/common.sh@469 -- # nvmfpid=2494231 00:25:12.385 16:09:02 -- nvmf/common.sh@470 -- # waitforlisten 2494231 00:25:12.385 16:09:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:12.385 16:09:02 -- common/autotest_common.sh@819 -- # '[' -z 2494231 ']' 00:25:12.385 16:09:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:12.385 16:09:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:12.385 16:09:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:12.385 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:12.385 16:09:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:12.385 16:09:02 -- common/autotest_common.sh@10 -- # set +x 00:25:12.385 [2024-10-30 16:09:02.244827] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:25:12.385 [2024-10-30 16:09:02.244913] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:12.644 EAL: No free 2048 kB hugepages reported on node 1 00:25:12.644 [2024-10-30 16:09:02.316170] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:12.644 [2024-10-30 16:09:02.405707] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:12.644 [2024-10-30 16:09:02.405888] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:12.644 [2024-10-30 16:09:02.405930] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:12.644 [2024-10-30 16:09:02.405957] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:12.644 [2024-10-30 16:09:02.406056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:12.644 [2024-10-30 16:09:02.406173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:12.644 [2024-10-30 16:09:02.406246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:12.644 [2024-10-30 16:09:02.406238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:13.578 16:09:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:13.578 16:09:03 -- common/autotest_common.sh@852 -- # return 0 00:25:13.578 16:09:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:13.578 16:09:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:13.578 16:09:03 -- common/autotest_common.sh@10 -- # set +x 00:25:13.578 16:09:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:13.578 16:09:03 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:13.578 16:09:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:13.578 16:09:03 -- common/autotest_common.sh@10 -- # set +x 00:25:13.578 [2024-10-30 16:09:03.231928] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:13.578 16:09:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:13.578 16:09:03 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:13.578 16:09:03 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:13.578 16:09:03 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:13.578 16:09:03 -- common/autotest_common.sh@10 -- # set +x 00:25:13.578 16:09:03 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:13.578 16:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.578 16:09:03 -- target/shutdown.sh@28 -- # cat 00:25:13.578 16:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.578 16:09:03 -- target/shutdown.sh@28 -- # cat 00:25:13.578 16:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.578 16:09:03 -- target/shutdown.sh@28 -- # cat 00:25:13.578 16:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.578 16:09:03 -- target/shutdown.sh@28 -- # cat 00:25:13.578 16:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.578 16:09:03 -- target/shutdown.sh@28 -- # cat 00:25:13.578 16:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.578 16:09:03 -- target/shutdown.sh@28 -- # cat 00:25:13.578 16:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.578 16:09:03 -- target/shutdown.sh@28 -- # cat 00:25:13.578 16:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.578 16:09:03 -- target/shutdown.sh@28 -- # cat 00:25:13.578 16:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.578 16:09:03 -- target/shutdown.sh@28 -- # cat 00:25:13.578 16:09:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.578 16:09:03 -- target/shutdown.sh@28 -- # cat 00:25:13.578 16:09:03 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:13.578 16:09:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:13.578 16:09:03 -- common/autotest_common.sh@10 -- # set +x 00:25:13.578 Malloc1 00:25:13.578 [2024-10-30 16:09:03.307046] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:13.578 Malloc2 00:25:13.578 Malloc3 00:25:13.578 Malloc4 00:25:13.836 Malloc5 00:25:13.836 Malloc6 00:25:13.836 Malloc7 00:25:13.836 Malloc8 00:25:13.836 Malloc9 00:25:14.095 Malloc10 00:25:14.095 16:09:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:14.095 16:09:03 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:14.095 16:09:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:14.095 16:09:03 -- common/autotest_common.sh@10 -- # set +x 00:25:14.095 16:09:03 -- target/shutdown.sh@124 -- # perfpid=2494427 00:25:14.095 16:09:03 -- target/shutdown.sh@125 -- # waitforlisten 2494427 /var/tmp/bdevperf.sock 00:25:14.095 16:09:03 -- common/autotest_common.sh@819 -- # '[' -z 2494427 ']' 00:25:14.095 16:09:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:14.095 16:09:03 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:14.095 16:09:03 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:14.095 16:09:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:14.095 16:09:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:14.095 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:14.095 16:09:03 -- nvmf/common.sh@520 -- # config=() 00:25:14.095 16:09:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:14.095 16:09:03 -- nvmf/common.sh@520 -- # local subsystem config 00:25:14.095 16:09:03 -- common/autotest_common.sh@10 -- # set +x 00:25:14.095 16:09:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:14.095 16:09:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:14.095 { 00:25:14.095 "params": { 00:25:14.095 "name": "Nvme$subsystem", 00:25:14.095 "trtype": "$TEST_TRANSPORT", 00:25:14.095 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:14.095 "adrfam": "ipv4", 00:25:14.095 "trsvcid": "$NVMF_PORT", 00:25:14.095 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:14.095 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:14.095 "hdgst": ${hdgst:-false}, 00:25:14.095 "ddgst": ${ddgst:-false} 00:25:14.095 }, 00:25:14.095 "method": "bdev_nvme_attach_controller" 00:25:14.095 } 00:25:14.095 EOF 00:25:14.095 )") 00:25:14.095 16:09:03 -- nvmf/common.sh@542 -- # cat 00:25:14.095 16:09:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:14.095 16:09:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:14.095 { 00:25:14.095 "params": { 00:25:14.095 "name": "Nvme$subsystem", 00:25:14.095 "trtype": "$TEST_TRANSPORT", 00:25:14.095 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:14.095 "adrfam": "ipv4", 00:25:14.095 "trsvcid": "$NVMF_PORT", 00:25:14.095 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:14.095 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:14.096 "hdgst": ${hdgst:-false}, 00:25:14.096 "ddgst": ${ddgst:-false} 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 } 00:25:14.096 EOF 00:25:14.096 )") 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # cat 00:25:14.096 16:09:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:14.096 { 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme$subsystem", 00:25:14.096 "trtype": "$TEST_TRANSPORT", 00:25:14.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "$NVMF_PORT", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:14.096 "hdgst": ${hdgst:-false}, 00:25:14.096 "ddgst": ${ddgst:-false} 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 } 00:25:14.096 EOF 00:25:14.096 )") 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # cat 00:25:14.096 16:09:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:14.096 { 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme$subsystem", 00:25:14.096 "trtype": "$TEST_TRANSPORT", 00:25:14.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "$NVMF_PORT", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:14.096 "hdgst": ${hdgst:-false}, 00:25:14.096 "ddgst": ${ddgst:-false} 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 } 00:25:14.096 EOF 00:25:14.096 )") 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # cat 00:25:14.096 16:09:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:14.096 { 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme$subsystem", 00:25:14.096 "trtype": "$TEST_TRANSPORT", 00:25:14.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "$NVMF_PORT", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:14.096 "hdgst": ${hdgst:-false}, 00:25:14.096 "ddgst": ${ddgst:-false} 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 } 00:25:14.096 EOF 00:25:14.096 )") 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # cat 00:25:14.096 16:09:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:14.096 { 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme$subsystem", 00:25:14.096 "trtype": "$TEST_TRANSPORT", 00:25:14.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "$NVMF_PORT", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:14.096 "hdgst": ${hdgst:-false}, 00:25:14.096 "ddgst": ${ddgst:-false} 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 } 00:25:14.096 EOF 00:25:14.096 )") 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # cat 00:25:14.096 16:09:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:14.096 { 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme$subsystem", 00:25:14.096 "trtype": "$TEST_TRANSPORT", 00:25:14.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "$NVMF_PORT", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:14.096 "hdgst": ${hdgst:-false}, 00:25:14.096 "ddgst": ${ddgst:-false} 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 } 00:25:14.096 EOF 00:25:14.096 )") 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # cat 00:25:14.096 16:09:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:14.096 { 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme$subsystem", 00:25:14.096 "trtype": "$TEST_TRANSPORT", 00:25:14.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "$NVMF_PORT", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:14.096 "hdgst": ${hdgst:-false}, 00:25:14.096 "ddgst": ${ddgst:-false} 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 } 00:25:14.096 EOF 00:25:14.096 )") 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # cat 00:25:14.096 16:09:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:14.096 { 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme$subsystem", 00:25:14.096 "trtype": "$TEST_TRANSPORT", 00:25:14.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "$NVMF_PORT", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:14.096 "hdgst": ${hdgst:-false}, 00:25:14.096 "ddgst": ${ddgst:-false} 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 } 00:25:14.096 EOF 00:25:14.096 )") 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # cat 00:25:14.096 16:09:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:14.096 { 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme$subsystem", 00:25:14.096 "trtype": "$TEST_TRANSPORT", 00:25:14.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "$NVMF_PORT", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:14.096 "hdgst": ${hdgst:-false}, 00:25:14.096 "ddgst": ${ddgst:-false} 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 } 00:25:14.096 EOF 00:25:14.096 )") 00:25:14.096 16:09:03 -- nvmf/common.sh@542 -- # cat 00:25:14.096 16:09:03 -- nvmf/common.sh@544 -- # jq . 00:25:14.096 16:09:03 -- nvmf/common.sh@545 -- # IFS=, 00:25:14.096 16:09:03 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme1", 00:25:14.096 "trtype": "tcp", 00:25:14.096 "traddr": "10.0.0.2", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "4420", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:14.096 "hdgst": false, 00:25:14.096 "ddgst": false 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 },{ 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme2", 00:25:14.096 "trtype": "tcp", 00:25:14.096 "traddr": "10.0.0.2", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "4420", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:14.096 "hdgst": false, 00:25:14.096 "ddgst": false 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 },{ 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme3", 00:25:14.096 "trtype": "tcp", 00:25:14.096 "traddr": "10.0.0.2", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "4420", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:14.096 "hdgst": false, 00:25:14.096 "ddgst": false 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 },{ 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme4", 00:25:14.096 "trtype": "tcp", 00:25:14.096 "traddr": "10.0.0.2", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "4420", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:14.096 "hdgst": false, 00:25:14.096 "ddgst": false 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 },{ 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme5", 00:25:14.096 "trtype": "tcp", 00:25:14.096 "traddr": "10.0.0.2", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "4420", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:14.096 "hdgst": false, 00:25:14.096 "ddgst": false 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 },{ 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme6", 00:25:14.096 "trtype": "tcp", 00:25:14.096 "traddr": "10.0.0.2", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "4420", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:14.096 "hdgst": false, 00:25:14.096 "ddgst": false 00:25:14.096 }, 00:25:14.096 "method": "bdev_nvme_attach_controller" 00:25:14.096 },{ 00:25:14.096 "params": { 00:25:14.096 "name": "Nvme7", 00:25:14.096 "trtype": "tcp", 00:25:14.096 "traddr": "10.0.0.2", 00:25:14.096 "adrfam": "ipv4", 00:25:14.096 "trsvcid": "4420", 00:25:14.096 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:14.096 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:14.096 "hdgst": false, 00:25:14.096 "ddgst": false 00:25:14.096 }, 00:25:14.097 "method": "bdev_nvme_attach_controller" 00:25:14.097 },{ 00:25:14.097 "params": { 00:25:14.097 "name": "Nvme8", 00:25:14.097 "trtype": "tcp", 00:25:14.097 "traddr": "10.0.0.2", 00:25:14.097 "adrfam": "ipv4", 00:25:14.097 "trsvcid": "4420", 00:25:14.097 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:14.097 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:14.097 "hdgst": false, 00:25:14.097 "ddgst": false 00:25:14.097 }, 00:25:14.097 "method": "bdev_nvme_attach_controller" 00:25:14.097 },{ 00:25:14.097 "params": { 00:25:14.097 "name": "Nvme9", 00:25:14.097 "trtype": "tcp", 00:25:14.097 "traddr": "10.0.0.2", 00:25:14.097 "adrfam": "ipv4", 00:25:14.097 "trsvcid": "4420", 00:25:14.097 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:14.097 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:14.097 "hdgst": false, 00:25:14.097 "ddgst": false 00:25:14.097 }, 00:25:14.097 "method": "bdev_nvme_attach_controller" 00:25:14.097 },{ 00:25:14.097 "params": { 00:25:14.097 "name": "Nvme10", 00:25:14.097 "trtype": "tcp", 00:25:14.097 "traddr": "10.0.0.2", 00:25:14.097 "adrfam": "ipv4", 00:25:14.097 "trsvcid": "4420", 00:25:14.097 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:14.097 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:14.097 "hdgst": false, 00:25:14.097 "ddgst": false 00:25:14.097 }, 00:25:14.097 "method": "bdev_nvme_attach_controller" 00:25:14.097 }' 00:25:14.097 [2024-10-30 16:09:03.823312] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:25:14.097 [2024-10-30 16:09:03.823386] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2494427 ] 00:25:14.097 EAL: No free 2048 kB hugepages reported on node 1 00:25:14.097 [2024-10-30 16:09:03.887327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:14.097 [2024-10-30 16:09:03.972754] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:16.027 Running I/O for 10 seconds... 00:25:16.027 16:09:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:16.027 16:09:05 -- common/autotest_common.sh@852 -- # return 0 00:25:16.027 16:09:05 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:16.027 16:09:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.027 16:09:05 -- common/autotest_common.sh@10 -- # set +x 00:25:16.027 16:09:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.027 16:09:05 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:16.027 16:09:05 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:16.027 16:09:05 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:16.027 16:09:05 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:16.027 16:09:05 -- target/shutdown.sh@57 -- # local ret=1 00:25:16.027 16:09:05 -- target/shutdown.sh@58 -- # local i 00:25:16.027 16:09:05 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:16.027 16:09:05 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:16.027 16:09:05 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:16.027 16:09:05 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:16.027 16:09:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.027 16:09:05 -- common/autotest_common.sh@10 -- # set +x 00:25:16.027 16:09:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.027 16:09:05 -- target/shutdown.sh@60 -- # read_io_count=3 00:25:16.027 16:09:05 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:25:16.027 16:09:05 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:16.300 16:09:05 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:16.300 16:09:05 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:16.300 16:09:05 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:16.300 16:09:05 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:16.300 16:09:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:16.300 16:09:05 -- common/autotest_common.sh@10 -- # set +x 00:25:16.300 16:09:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:16.300 16:09:05 -- target/shutdown.sh@60 -- # read_io_count=129 00:25:16.300 16:09:05 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:25:16.300 16:09:05 -- target/shutdown.sh@64 -- # ret=0 00:25:16.300 16:09:05 -- target/shutdown.sh@65 -- # break 00:25:16.300 16:09:05 -- target/shutdown.sh@69 -- # return 0 00:25:16.300 16:09:05 -- target/shutdown.sh@134 -- # killprocess 2494231 00:25:16.300 16:09:05 -- common/autotest_common.sh@926 -- # '[' -z 2494231 ']' 00:25:16.300 16:09:05 -- common/autotest_common.sh@930 -- # kill -0 2494231 00:25:16.300 16:09:05 -- common/autotest_common.sh@931 -- # uname 00:25:16.300 16:09:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:16.300 16:09:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2494231 00:25:16.300 16:09:06 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:16.300 16:09:06 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:16.300 16:09:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2494231' 00:25:16.300 killing process with pid 2494231 00:25:16.300 16:09:06 -- common/autotest_common.sh@945 -- # kill 2494231 00:25:16.300 16:09:06 -- common/autotest_common.sh@950 -- # wait 2494231 00:25:16.300 [2024-10-30 16:09:06.013114] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013252] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013292] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013319] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013332] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013355] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013368] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013381] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013394] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013406] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013418] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013431] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013443] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013456] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013468] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013481] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013493] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013506] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013518] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013541] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013554] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013567] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013579] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013592] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013604] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013617] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013630] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013642] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013654] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013668] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013681] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013694] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013710] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013723] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013736] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013748] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013761] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013788] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013801] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013813] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013825] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013837] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013849] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013861] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013873] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013885] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013898] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013909] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013921] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013933] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013945] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013957] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013969] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013981] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.013993] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.014005] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.014017] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.014029] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.014041] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.014056] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.014069] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.014083] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.014095] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a7e90 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.018328] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.018365] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.018388] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.018401] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.018414] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.018427] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.018440] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.018453] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.018466] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.300 [2024-10-30 16:09:06.018478] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018491] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018504] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018517] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018530] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018543] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018555] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018568] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018581] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018594] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018607] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018620] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018633] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018646] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018664] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018678] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018691] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018703] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018715] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018728] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018740] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018752] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018765] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018778] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018790] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018803] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018815] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018828] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018841] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018853] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018866] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018879] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018891] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018903] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018916] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018928] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018941] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018959] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.018988] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019000] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019012] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019028] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019041] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019054] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019065] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019078] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019090] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019102] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019114] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019126] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019138] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019149] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019162] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.019174] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa750 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021640] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021676] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021693] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021706] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021719] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021732] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021745] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021758] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021770] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021783] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021796] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021884] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021900] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021913] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021935] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021948] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021961] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021973] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021986] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.021998] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022010] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022022] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022035] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022047] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022059] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022071] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022084] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022096] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022108] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022120] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022132] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022144] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022156] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022183] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022195] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022207] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022219] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022231] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022243] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022263] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022294] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022309] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022326] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022338] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022351] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022363] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022379] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022391] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022403] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022417] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022429] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022442] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022455] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022467] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022480] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022492] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022505] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022516] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022529] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.022541] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a87f0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.023688] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.023730] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.023755] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.023776] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.023784] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-10-30 16:09:06.023800] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with id:0 cdw10:00000000 cdw11:00000000 00:25:16.301 the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.023824] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.023830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 [2024-10-30 16:09:06.023850] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 ns[2024-10-30 16:09:06.023847] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with id:0 cdw10:00000000 cdw11:00000000 00:25:16.301 the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.023879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 [2024-10-30 16:09:06.023882] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.023894] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.023907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-10-30 16:09:06.023905] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.023923] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.023927] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.023936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 [2024-10-30 16:09:06.023949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1408a30 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.023950] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.023972] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024000] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024021] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024023] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.024045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-10-30 16:09:06.024042] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024062] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.024064] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 [2024-10-30 16:09:06.024089] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.024087] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 [2024-10-30 16:09:06.024109] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with [2024-10-30 16:09:06.024116] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsthe state(5) to be set 00:25:16.301 id:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.024131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 [2024-10-30 16:09:06.024132] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024147] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13e66b0 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024154] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024174] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024194] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-10-30 16:09:06.024195] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with id:0 cdw10:00000000 cdw11:00000000 00:25:16.301 the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 [2024-10-30 16:09:06.024219] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024232] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.024245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-10-30 16:09:06.024243] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024271] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.024274] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 [2024-10-30 16:09:06.024299] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.024298] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 [2024-10-30 16:09:06.024325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13f3d30 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024324] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024346] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024380] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-10-30 16:09:06.024378] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with id:0 cdw10:00000000 cdw11:00000000 00:25:16.301 the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 [2024-10-30 16:09:06.024405] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024417] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.024430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-10-30 16:09:06.024429] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024453] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.024455] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 [2024-10-30 16:09:06.024480] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.024479] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 [2024-10-30 16:09:06.024500] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with [2024-10-30 16:09:06.024506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ad100 is same the state(5) to be set 00:25:16.301 with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024524] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024545] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024570] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with [2024-10-30 16:09:06.024570] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsthe state(5) to be set 00:25:16.301 id:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.024594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 [2024-10-30 16:09:06.024594] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024609] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.024615] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with [2024-10-30 16:09:06.024622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:25:16.301 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.301 [2024-10-30 16:09:06.024638] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.301 [2024-10-30 16:09:06.024639] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.301 [2024-10-30 16:09:06.024651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.024665] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 ns[2024-10-30 16:09:06.024660] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with id:0 cdw10:00000000 cdw11:00000000 00:25:16.302 the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.024685] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15abc50 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024706] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024728] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024749] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024770] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024792] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.024812] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.024832] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.024854] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.024875] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with [2024-10-30 16:09:06.024880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:12the state(5) to be set 00:25:16.302 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.024897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.024898] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.024919] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.024942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.024940] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.024963] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.024972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.024986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.024984] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.025001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025014] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.025045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025050] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.025059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128[2024-10-30 16:09:06.025072] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.025090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025095] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.025105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025117] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.025135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025138] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.025148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025158] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a8c80 is same with [2024-10-30 16:09:06.025163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:12the state(5) to be set 00:25:16.302 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.025978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.025990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26368 len:12[2024-10-30 16:09:06.026082] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026112] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026127] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026139] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026151] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026164] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026176] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with [2024-10-30 16:09:06.026176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26752 len:12the state(5) to be set 00:25:16.302 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026189] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with [2024-10-30 16:09:06.026191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:16.302 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026203] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026216] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026228] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026240] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with [2024-10-30 16:09:06.026247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:16.302 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026283] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with [2024-10-30 16:09:06.026285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27136 len:12the state(5) to be set 00:25:16.302 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026307] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026320] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026333] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026346] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with [2024-10-30 16:09:06.026346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:1the state(5) to be set 00:25:16.302 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026361] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with [2024-10-30 16:09:06.026362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:16.302 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026380] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with [2024-10-30 16:09:06.026380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:1the state(5) to be set 00:25:16.302 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026395] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with [2024-10-30 16:09:06.026396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:16.302 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026409] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026422] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026435] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026448] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026460] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026477] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026491] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026503] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026516] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026529] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026543] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026555] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with [2024-10-30 16:09:06.026556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:28288 len:1the state(5) to be set 00:25:16.302 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026585] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026597] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026610] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.302 [2024-10-30 16:09:06.026623] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.302 [2024-10-30 16:09:06.026632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.302 [2024-10-30 16:09:06.026635] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.026648] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:28672 len:1[2024-10-30 16:09:06.026660] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026678] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with [2024-10-30 16:09:06.026678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:16.303 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.026691] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.026704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.026716] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.026729] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.026741] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.026759] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.026773] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026785] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026798] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026809] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026821] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026834] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026846] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026858] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026870] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026878] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1458010 was disconnected and fr[2024-10-30 16:09:06.026882] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with eed. reset controller. 00:25:16.303 the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026897] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026918] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026931] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.026944] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.026956] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026969] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.026981] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9130 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.026987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.027982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.027997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028018] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a95e0 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.028031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028903] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1563950 was disconnected and freed. reset controller. 00:25:16.303 [2024-10-30 16:09:06.028912] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.028940] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.028954] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.028955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.028967] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.028974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.028980] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.028993] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.028993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.029005] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.029008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.029018] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.029024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.029031] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.029037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.029044] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.029057] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with [2024-10-30 16:09:06.029058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:12the state(5) to be set 00:25:16.303 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.029071] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with [2024-10-30 16:09:06.029073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:16.303 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.029086] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.029089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.029100] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.029102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.029112] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.029117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.029125] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.029130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.029138] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.029146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.303 [2024-10-30 16:09:06.029151] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.303 [2024-10-30 16:09:06.029159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.303 [2024-10-30 16:09:06.029164] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 [2024-10-30 16:09:06.029177] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 [2024-10-30 16:09:06.029190] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128[2024-10-30 16:09:06.029202] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-10-30 16:09:06.029216] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 [2024-10-30 16:09:06.029251] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 [2024-10-30 16:09:06.029276] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:12[2024-10-30 16:09:06.029289] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-10-30 16:09:06.029319] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029333] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029345] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029357] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029376] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029388] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029400] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029419] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029432] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029444] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029456] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029468] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029480] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029493] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029505] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029517] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029528] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029540] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029552] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029564] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029580] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029608] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029620] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029632] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029644] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029655] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029667] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029679] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029690] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029702] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029714] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029726] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029737] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029749] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029761] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029773] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.029785] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9a90 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.030867] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.030902] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.030926] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.030948] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.030968] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.030990] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031010] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031032] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031053] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031072] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031114] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031135] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031169] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031188] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031206] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031227] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031272] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031299] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031320] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031339] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031361] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031383] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031404] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031425] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031444] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031464] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031484] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031503] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031524] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031544] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031565] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031604] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031623] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031659] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031677] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031697] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031716] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031741] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031762] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031781] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031801] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031820] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031839] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031861] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031879] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031898] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031918] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031937] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031958] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.031985] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.032006] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.032025] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.032045] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.032066] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.032084] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.032105] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.032124] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.032143] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.032165] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.032184] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.032204] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.032223] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.032262] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10a9df0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033136] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033159] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033178] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033191] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033202] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033214] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033225] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033252] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033276] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033289] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033316] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033329] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033342] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033370] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033383] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033395] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033407] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033419] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033432] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033444] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033456] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033468] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033481] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033493] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033506] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033518] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033530] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033556] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033568] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033584] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033611] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033623] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033635] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033646] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033658] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033670] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033681] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033693] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033715] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033727] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033738] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033750] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033761] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.033773] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10aa2a0 is same with the state(5) to be set 00:25:16.304 [2024-10-30 16:09:06.043833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 [2024-10-30 16:09:06.043903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 [2024-10-30 16:09:06.043922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 [2024-10-30 16:09:06.043936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 [2024-10-30 16:09:06.043951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 [2024-10-30 16:09:06.043964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 [2024-10-30 16:09:06.043980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 [2024-10-30 16:09:06.043993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 [2024-10-30 16:09:06.044009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 [2024-10-30 16:09:06.044022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 [2024-10-30 16:09:06.044048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 [2024-10-30 16:09:06.044062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 [2024-10-30 16:09:06.044077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 [2024-10-30 16:09:06.044090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 [2024-10-30 16:09:06.044105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 [2024-10-30 16:09:06.044118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 [2024-10-30 16:09:06.044132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 [2024-10-30 16:09:06.044145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 [2024-10-30 16:09:06.044161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 [2024-10-30 16:09:06.044174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 [2024-10-30 16:09:06.044189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 [2024-10-30 16:09:06.044202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.304 [2024-10-30 16:09:06.044217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.304 [2024-10-30 16:09:06.044230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.044981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.044996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.045500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.045657] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1564ef0 was disconnected and freed. reset controller. 00:25:16.305 [2024-10-30 16:09:06.047797] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1408a30 (9): Bad file descriptor 00:25:16.305 [2024-10-30 16:09:06.047872] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.047895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.047920] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.047935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.047948] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.047961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.047975] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.047987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1587c80 is same with the state(5) to be set 00:25:16.305 [2024-10-30 16:09:06.048046] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048081] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048107] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048133] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x159c700 is same with the state(5) to be set 00:25:16.305 [2024-10-30 16:09:06.048187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13e66b0 (9): Bad file descriptor 00:25:16.305 [2024-10-30 16:09:06.048213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13f3d30 (9): Bad file descriptor 00:25:16.305 [2024-10-30 16:09:06.048236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ad100 (9): Bad file descriptor 00:25:16.305 [2024-10-30 16:09:06.048290] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048325] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048351] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048376] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1597660 is same with the state(5) to be set 00:25:16.305 [2024-10-30 16:09:06.048452] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048486] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048512] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048538] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x143b070 is same with the state(5) to be set 00:25:16.305 [2024-10-30 16:09:06.048590] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15abc50 (9): Bad file descriptor 00:25:16.305 [2024-10-30 16:09:06.048641] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048675] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048701] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048727] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.305 [2024-10-30 16:09:06.048740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.048752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x143d650 is same with the state(5) to be set 00:25:16.305 [2024-10-30 16:09:06.052141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.305 [2024-10-30 16:09:06.052780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.305 [2024-10-30 16:09:06.052794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.052808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.052822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.052836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.052849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.052864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.052877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.052891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.052904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.052920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.052933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.052948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.052965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.052981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.052994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.053893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.053908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.068333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.068427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.068443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.068460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.068474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.068489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.068502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.068668] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1565d30 was disconnected and freed. reset controller. 00:25:16.306 [2024-10-30 16:09:06.068774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.068808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.068831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.068846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.068861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.068875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.068890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.068902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.068917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.068930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.068945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.068958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.068972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.068985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.069976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.069991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.070005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.070019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.070032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.070047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.070061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.070076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.070088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.070103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.070116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.070130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.070143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.070158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.306 [2024-10-30 16:09:06.070171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.306 [2024-10-30 16:09:06.070186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.070635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.070738] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x15670e0 was disconnected and freed. reset controller. 00:25:16.307 [2024-10-30 16:09:06.071397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:16.307 [2024-10-30 16:09:06.071434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:16.307 [2024-10-30 16:09:06.071453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:16.307 [2024-10-30 16:09:06.071547] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.307 [2024-10-30 16:09:06.071579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1587c80 (9): Bad file descriptor 00:25:16.307 [2024-10-30 16:09:06.071607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x159c700 (9): Bad file descriptor 00:25:16.307 [2024-10-30 16:09:06.071637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1597660 (9): Bad file descriptor 00:25:16.307 [2024-10-30 16:09:06.071660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x143b070 (9): Bad file descriptor 00:25:16.307 [2024-10-30 16:09:06.071692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x143d650 (9): Bad file descriptor 00:25:16.307 [2024-10-30 16:09:06.075048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.075986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.075999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.076910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.076923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.077039] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x145c9a0 was disconnected and freed. reset controller. 00:25:16.307 [2024-10-30 16:09:06.077294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.307 [2024-10-30 16:09:06.077394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.307 [2024-10-30 16:09:06.077419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13e66b0 with addr=10.0.0.2, port=4420 00:25:16.307 [2024-10-30 16:09:06.077436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13e66b0 is same with the state(5) to be set 00:25:16.307 [2024-10-30 16:09:06.077517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.307 [2024-10-30 16:09:06.077614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.307 [2024-10-30 16:09:06.077638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13f3d30 with addr=10.0.0.2, port=4420 00:25:16.307 [2024-10-30 16:09:06.077654] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13f3d30 is same with the state(5) to be set 00:25:16.307 [2024-10-30 16:09:06.077742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.307 [2024-10-30 16:09:06.077827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.307 [2024-10-30 16:09:06.077851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ad100 with addr=10.0.0.2, port=4420 00:25:16.307 [2024-10-30 16:09:06.077866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ad100 is same with the state(5) to be set 00:25:16.307 [2024-10-30 16:09:06.078816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.078845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.078867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.078882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.078897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.078911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.078925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.078939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.078954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.078967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.078982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.078995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.079010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.079023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.079038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.079051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.079066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.079079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.079094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.079107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.079122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.307 [2024-10-30 16:09:06.079135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.307 [2024-10-30 16:09:06.079157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.079583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.079598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14588a0 is same with the state(5) to be set 00:25:16.308 [2024-10-30 16:09:06.079674] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x14588a0 was disconnected and freed. reset controller. 00:25:16.308 [2024-10-30 16:09:06.080971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.080995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.081981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.081995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.082821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.082834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.308 [2024-10-30 16:09:06.084581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:16.308 [2024-10-30 16:09:06.084623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:16.308 [2024-10-30 16:09:06.084691] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13e66b0 (9): Bad file descriptor 00:25:16.308 [2024-10-30 16:09:06.084715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13f3d30 (9): Bad file descriptor 00:25:16.308 [2024-10-30 16:09:06.084734] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ad100 (9): Bad file descriptor 00:25:16.308 [2024-10-30 16:09:06.084787] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.308 [2024-10-30 16:09:06.084817] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.308 [2024-10-30 16:09:06.084843] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.308 [2024-10-30 16:09:06.084862] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.308 [2024-10-30 16:09:06.084880] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.308 [2024-10-30 16:09:06.084900] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.308 [2024-10-30 16:09:06.086483] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:16.308 [2024-10-30 16:09:06.086562] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:16.308 [2024-10-30 16:09:06.086620] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:16.308 [2024-10-30 16:09:06.086654] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:16.308 [2024-10-30 16:09:06.086672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:16.308 [2024-10-30 16:09:06.086843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.308 [2024-10-30 16:09:06.086950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.308 [2024-10-30 16:09:06.086975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1408a30 with addr=10.0.0.2, port=4420 00:25:16.308 [2024-10-30 16:09:06.086992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1408a30 is same with the state(5) to be set 00:25:16.308 [2024-10-30 16:09:06.087069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.308 [2024-10-30 16:09:06.087155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.308 [2024-10-30 16:09:06.087179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1587c80 with addr=10.0.0.2, port=4420 00:25:16.308 [2024-10-30 16:09:06.087194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1587c80 is same with the state(5) to be set 00:25:16.308 [2024-10-30 16:09:06.087209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:16.308 [2024-10-30 16:09:06.087228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:16.308 [2024-10-30 16:09:06.087246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:16.308 [2024-10-30 16:09:06.087278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:16.308 [2024-10-30 16:09:06.087294] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:16.308 [2024-10-30 16:09:06.087307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:16.308 [2024-10-30 16:09:06.087324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:16.308 [2024-10-30 16:09:06.087337] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:16.308 [2024-10-30 16:09:06.087350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:16.308 [2024-10-30 16:09:06.087461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.308 [2024-10-30 16:09:06.087484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.087973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.087988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.088842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.088854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.100884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.100899] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1459dd0 is same with the state(5) to be set 00:25:16.309 [2024-10-30 16:09:06.102295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:14976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:15104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:15232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:15360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:15744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:16000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:16256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:16768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:17152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:17408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.102978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.102991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.103006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:17536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.103019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.103034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:17664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.103046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.103061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:17792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.103074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.309 [2024-10-30 16:09:06.103089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:17920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.309 [2024-10-30 16:09:06.103101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:18560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:22400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:22528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:22912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.103980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.103994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.104007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.104022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.104034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.104049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.104061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.104076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.104089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.104103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.310 [2024-10-30 16:09:06.104116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.310 [2024-10-30 16:09:06.104129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x145b3b0 is same with the state(5) to be set 00:25:16.310 [2024-10-30 16:09:06.106223] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:16.310 [2024-10-30 16:09:06.106252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:16.310 [2024-10-30 16:09:06.106274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:16.310 [2024-10-30 16:09:06.106291] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:16.310 task offset: 24320 on job bdev=Nvme1n1 fails 00:25:16.310 00:25:16.310 Latency(us) 00:25:16.310 [2024-10-30T15:09:06.186Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme1n1 ended in about 0.50 seconds with error 00:25:16.310 Verification LBA range: start 0x0 length 0x400 00:25:16.310 Nvme1n1 : 0.50 326.97 20.44 127.60 0.00 139464.36 56700.78 119615.34 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme2n1 ended in about 0.50 seconds with error 00:25:16.310 Verification LBA range: start 0x0 length 0x400 00:25:16.310 Nvme2n1 : 0.50 326.25 20.39 127.32 0.00 137620.49 27185.30 144470.47 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme3n1 ended in about 0.50 seconds with error 00:25:16.310 Verification LBA range: start 0x0 length 0x400 00:25:16.310 Nvme3n1 : 0.50 325.55 20.35 127.04 0.00 135742.56 43302.31 123498.95 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme4n1 ended in about 0.52 seconds with error 00:25:16.310 Verification LBA range: start 0x0 length 0x400 00:25:16.310 Nvme4n1 : 0.52 312.67 19.54 122.02 0.00 139452.43 65244.73 115731.72 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme5n1 ended in about 0.53 seconds with error 00:25:16.310 Verification LBA range: start 0x0 length 0x400 00:25:16.310 Nvme5n1 : 0.53 312.03 19.50 121.77 0.00 137631.56 57865.86 115731.72 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme6n1 ended in about 0.54 seconds with error 00:25:16.310 Verification LBA range: start 0x0 length 0x400 00:25:16.310 Nvme6n1 : 0.54 304.83 19.05 48.33 0.00 164757.76 10922.67 160004.93 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme7n1 ended in about 0.55 seconds with error 00:25:16.310 Verification LBA range: start 0x0 length 0x400 00:25:16.310 Nvme7n1 : 0.55 227.60 14.22 115.60 0.00 169621.99 98255.45 173985.94 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme8n1 ended in about 0.56 seconds with error 00:25:16.310 Verification LBA range: start 0x0 length 0x400 00:25:16.310 Nvme8n1 : 0.56 226.30 14.14 114.95 0.00 168209.58 103304.15 166218.71 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme9n1 ended in about 0.53 seconds with error 00:25:16.310 Verification LBA range: start 0x0 length 0x400 00:25:16.310 Nvme9n1 : 0.53 246.00 15.38 120.18 0.00 153622.36 32428.18 129712.73 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:16.310 [2024-10-30T15:09:06.186Z] Job: Nvme10n1 ended in about 0.54 seconds with error 00:25:16.310 Verification LBA range: start 0x0 length 0x400 00:25:16.310 Nvme10n1 : 0.54 235.28 14.71 119.51 0.00 156321.63 107187.77 126605.84 00:25:16.310 [2024-10-30T15:09:06.186Z] =================================================================================================================== 00:25:16.310 [2024-10-30T15:09:06.186Z] Total : 2843.48 177.72 1144.32 0.00 149140.45 10922.67 173985.94 00:25:16.310 [2024-10-30 16:09:06.134125] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:16.310 [2024-10-30 16:09:06.134218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:16.310 [2024-10-30 16:09:06.134495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.134639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.134666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15abc50 with addr=10.0.0.2, port=4420 00:25:16.310 [2024-10-30 16:09:06.134688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15abc50 is same with the state(5) to be set 00:25:16.310 [2024-10-30 16:09:06.134790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.134875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.134899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1597660 with addr=10.0.0.2, port=4420 00:25:16.310 [2024-10-30 16:09:06.134915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1597660 is same with the state(5) to be set 00:25:16.310 [2024-10-30 16:09:06.134997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.135080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.135104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x143d650 with addr=10.0.0.2, port=4420 00:25:16.310 [2024-10-30 16:09:06.135119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x143d650 is same with the state(5) to be set 00:25:16.310 [2024-10-30 16:09:06.135147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1408a30 (9): Bad file descriptor 00:25:16.310 [2024-10-30 16:09:06.135185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1587c80 (9): Bad file descriptor 00:25:16.310 [2024-10-30 16:09:06.135278] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.310 [2024-10-30 16:09:06.135305] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.310 [2024-10-30 16:09:06.135325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x143d650 (9): Bad file descriptor 00:25:16.310 [2024-10-30 16:09:06.135353] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1597660 (9): Bad file descriptor 00:25:16.310 [2024-10-30 16:09:06.135377] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15abc50 (9): Bad file descriptor 00:25:16.310 [2024-10-30 16:09:06.136241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.136331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.136358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x159c700 with addr=10.0.0.2, port=4420 00:25:16.310 [2024-10-30 16:09:06.136374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x159c700 is same with the state(5) to be set 00:25:16.310 [2024-10-30 16:09:06.136464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.136546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.136569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x143b070 with addr=10.0.0.2, port=4420 00:25:16.310 [2024-10-30 16:09:06.136584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x143b070 is same with the state(5) to be set 00:25:16.310 [2024-10-30 16:09:06.136603] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:16.310 [2024-10-30 16:09:06.136616] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:16.310 [2024-10-30 16:09:06.136633] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:16.310 [2024-10-30 16:09:06.136653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:16.310 [2024-10-30 16:09:06.136666] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:16.310 [2024-10-30 16:09:06.136678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:16.310 [2024-10-30 16:09:06.136713] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.310 [2024-10-30 16:09:06.136738] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.310 [2024-10-30 16:09:06.136756] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.310 [2024-10-30 16:09:06.136775] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.310 [2024-10-30 16:09:06.136792] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.310 [2024-10-30 16:09:06.136810] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.310 [2024-10-30 16:09:06.136829] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.310 [2024-10-30 16:09:06.136847] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:16.310 [2024-10-30 16:09:06.137413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:16.310 [2024-10-30 16:09:06.137439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:16.310 [2024-10-30 16:09:06.137461] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:16.310 [2024-10-30 16:09:06.137503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:16.310 [2024-10-30 16:09:06.137520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:16.310 [2024-10-30 16:09:06.137557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x159c700 (9): Bad file descriptor 00:25:16.310 [2024-10-30 16:09:06.137578] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x143b070 (9): Bad file descriptor 00:25:16.310 [2024-10-30 16:09:06.137593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:16.310 [2024-10-30 16:09:06.137605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:16.310 [2024-10-30 16:09:06.137617] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:16.310 [2024-10-30 16:09:06.137634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:16.310 [2024-10-30 16:09:06.137647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:16.310 [2024-10-30 16:09:06.137659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:16.310 [2024-10-30 16:09:06.137675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:16.310 [2024-10-30 16:09:06.137687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:16.310 [2024-10-30 16:09:06.137699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:16.310 [2024-10-30 16:09:06.137769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:16.310 [2024-10-30 16:09:06.137789] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:16.310 [2024-10-30 16:09:06.137801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:16.310 [2024-10-30 16:09:06.137882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.137961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.137985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ad100 with addr=10.0.0.2, port=4420 00:25:16.310 [2024-10-30 16:09:06.138000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ad100 is same with the state(5) to be set 00:25:16.310 [2024-10-30 16:09:06.138086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.138175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.138199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13f3d30 with addr=10.0.0.2, port=4420 00:25:16.310 [2024-10-30 16:09:06.138214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13f3d30 is same with the state(5) to be set 00:25:16.310 [2024-10-30 16:09:06.138294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.138370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:16.310 [2024-10-30 16:09:06.138393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13e66b0 with addr=10.0.0.2, port=4420 00:25:16.310 [2024-10-30 16:09:06.138408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13e66b0 is same with the state(5) to be set 00:25:16.310 [2024-10-30 16:09:06.138422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:16.310 [2024-10-30 16:09:06.138434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:16.310 [2024-10-30 16:09:06.138451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:16.310 [2024-10-30 16:09:06.138469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:16.310 [2024-10-30 16:09:06.138483] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:16.310 [2024-10-30 16:09:06.138495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:16.310 [2024-10-30 16:09:06.138550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:16.310 [2024-10-30 16:09:06.138569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:16.310 [2024-10-30 16:09:06.138585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ad100 (9): Bad file descriptor 00:25:16.310 [2024-10-30 16:09:06.138604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13f3d30 (9): Bad file descriptor 00:25:16.310 [2024-10-30 16:09:06.138621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13e66b0 (9): Bad file descriptor 00:25:16.310 [2024-10-30 16:09:06.138660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:16.310 [2024-10-30 16:09:06.138677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:16.310 [2024-10-30 16:09:06.138690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:16.310 [2024-10-30 16:09:06.138706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:16.310 [2024-10-30 16:09:06.138719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:16.310 [2024-10-30 16:09:06.138732] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:16.310 [2024-10-30 16:09:06.138746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:16.310 [2024-10-30 16:09:06.138758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:16.310 [2024-10-30 16:09:06.138770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:16.310 [2024-10-30 16:09:06.138804] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:16.310 [2024-10-30 16:09:06.138821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:16.310 [2024-10-30 16:09:06.138832] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:16.876 16:09:06 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:16.876 16:09:06 -- target/shutdown.sh@138 -- # sleep 1 00:25:17.814 16:09:07 -- target/shutdown.sh@141 -- # kill -9 2494427 00:25:17.814 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (2494427) - No such process 00:25:17.814 16:09:07 -- target/shutdown.sh@141 -- # true 00:25:17.814 16:09:07 -- target/shutdown.sh@143 -- # stoptarget 00:25:17.814 16:09:07 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:17.814 16:09:07 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:17.814 16:09:07 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:17.814 16:09:07 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:17.814 16:09:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:17.814 16:09:07 -- nvmf/common.sh@116 -- # sync 00:25:17.814 16:09:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:17.814 16:09:07 -- nvmf/common.sh@119 -- # set +e 00:25:17.814 16:09:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:17.814 16:09:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:17.814 rmmod nvme_tcp 00:25:17.814 rmmod nvme_fabrics 00:25:17.814 rmmod nvme_keyring 00:25:17.814 16:09:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:17.814 16:09:07 -- nvmf/common.sh@123 -- # set -e 00:25:17.814 16:09:07 -- nvmf/common.sh@124 -- # return 0 00:25:17.814 16:09:07 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:17.814 16:09:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:17.814 16:09:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:17.814 16:09:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:17.814 16:09:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:17.814 16:09:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:17.814 16:09:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:17.814 16:09:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:17.814 16:09:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:20.346 16:09:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:20.346 00:25:20.346 real 0m7.645s 00:25:20.346 user 0m19.134s 00:25:20.346 sys 0m1.305s 00:25:20.346 16:09:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:20.346 16:09:09 -- common/autotest_common.sh@10 -- # set +x 00:25:20.346 ************************************ 00:25:20.346 END TEST nvmf_shutdown_tc3 00:25:20.346 ************************************ 00:25:20.346 16:09:09 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:20.346 00:25:20.346 real 0m27.989s 00:25:20.346 user 1m19.411s 00:25:20.346 sys 0m6.218s 00:25:20.346 16:09:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:20.346 16:09:09 -- common/autotest_common.sh@10 -- # set +x 00:25:20.346 ************************************ 00:25:20.346 END TEST nvmf_shutdown 00:25:20.346 ************************************ 00:25:20.346 16:09:09 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:20.346 16:09:09 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:20.346 16:09:09 -- common/autotest_common.sh@10 -- # set +x 00:25:20.346 16:09:09 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:20.346 16:09:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:20.346 16:09:09 -- common/autotest_common.sh@10 -- # set +x 00:25:20.346 16:09:09 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:20.346 16:09:09 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:20.346 16:09:09 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:20.346 16:09:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:20.346 16:09:09 -- common/autotest_common.sh@10 -- # set +x 00:25:20.346 ************************************ 00:25:20.346 START TEST nvmf_multicontroller 00:25:20.346 ************************************ 00:25:20.346 16:09:09 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:20.346 * Looking for test storage... 00:25:20.346 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:20.346 16:09:09 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:20.346 16:09:09 -- nvmf/common.sh@7 -- # uname -s 00:25:20.346 16:09:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:20.346 16:09:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:20.346 16:09:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:20.346 16:09:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:20.346 16:09:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:20.346 16:09:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:20.346 16:09:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:20.346 16:09:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:20.346 16:09:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:20.346 16:09:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:20.346 16:09:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:20.346 16:09:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:20.346 16:09:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:20.346 16:09:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:20.346 16:09:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:20.346 16:09:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:20.346 16:09:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:20.346 16:09:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:20.346 16:09:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:20.346 16:09:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.347 16:09:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.347 16:09:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.347 16:09:09 -- paths/export.sh@5 -- # export PATH 00:25:20.347 16:09:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:20.347 16:09:09 -- nvmf/common.sh@46 -- # : 0 00:25:20.347 16:09:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:20.347 16:09:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:20.347 16:09:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:20.347 16:09:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:20.347 16:09:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:20.347 16:09:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:20.347 16:09:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:20.347 16:09:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:20.347 16:09:09 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:20.347 16:09:09 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:20.347 16:09:09 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:20.347 16:09:09 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:20.347 16:09:09 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:20.347 16:09:09 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:20.347 16:09:09 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:20.347 16:09:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:20.347 16:09:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:20.347 16:09:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:20.347 16:09:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:20.347 16:09:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:20.347 16:09:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:20.347 16:09:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:20.347 16:09:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:20.347 16:09:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:20.347 16:09:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:20.347 16:09:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:20.347 16:09:09 -- common/autotest_common.sh@10 -- # set +x 00:25:22.315 16:09:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:22.315 16:09:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:22.315 16:09:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:22.315 16:09:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:22.315 16:09:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:22.315 16:09:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:22.315 16:09:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:22.315 16:09:11 -- nvmf/common.sh@294 -- # net_devs=() 00:25:22.315 16:09:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:22.315 16:09:11 -- nvmf/common.sh@295 -- # e810=() 00:25:22.315 16:09:11 -- nvmf/common.sh@295 -- # local -ga e810 00:25:22.315 16:09:11 -- nvmf/common.sh@296 -- # x722=() 00:25:22.315 16:09:11 -- nvmf/common.sh@296 -- # local -ga x722 00:25:22.315 16:09:11 -- nvmf/common.sh@297 -- # mlx=() 00:25:22.315 16:09:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:22.315 16:09:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:22.315 16:09:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:22.315 16:09:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:22.315 16:09:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:22.315 16:09:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:22.315 16:09:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:22.315 16:09:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:22.315 16:09:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:22.315 16:09:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:22.315 16:09:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:22.315 16:09:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:22.315 16:09:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:22.315 16:09:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:22.315 16:09:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:22.315 16:09:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:22.315 16:09:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:22.315 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:22.315 16:09:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:22.315 16:09:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:22.315 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:22.315 16:09:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:22.315 16:09:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:22.315 16:09:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:22.315 16:09:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:22.315 16:09:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:22.315 16:09:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:22.315 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:22.315 16:09:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:22.315 16:09:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:22.315 16:09:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:22.315 16:09:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:22.315 16:09:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:22.315 16:09:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:22.315 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:22.315 16:09:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:22.315 16:09:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:22.315 16:09:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:22.315 16:09:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:22.315 16:09:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:22.315 16:09:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:22.315 16:09:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:22.315 16:09:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:22.315 16:09:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:22.315 16:09:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:22.315 16:09:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:22.315 16:09:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:22.315 16:09:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:22.315 16:09:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:22.315 16:09:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:22.315 16:09:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:22.315 16:09:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:22.315 16:09:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:22.315 16:09:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:22.315 16:09:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:22.315 16:09:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:22.315 16:09:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:22.315 16:09:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:22.315 16:09:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:22.315 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:22.315 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.280 ms 00:25:22.315 00:25:22.315 --- 10.0.0.2 ping statistics --- 00:25:22.315 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:22.315 rtt min/avg/max/mdev = 0.280/0.280/0.280/0.000 ms 00:25:22.315 16:09:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:22.315 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:22.315 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:25:22.315 00:25:22.315 --- 10.0.0.1 ping statistics --- 00:25:22.315 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:22.315 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:25:22.315 16:09:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:22.315 16:09:11 -- nvmf/common.sh@410 -- # return 0 00:25:22.315 16:09:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:22.315 16:09:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:22.315 16:09:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:22.315 16:09:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:22.315 16:09:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:22.315 16:09:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:22.315 16:09:11 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:22.315 16:09:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:22.315 16:09:11 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:22.315 16:09:11 -- common/autotest_common.sh@10 -- # set +x 00:25:22.315 16:09:11 -- nvmf/common.sh@469 -- # nvmfpid=2497439 00:25:22.315 16:09:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:22.315 16:09:11 -- nvmf/common.sh@470 -- # waitforlisten 2497439 00:25:22.315 16:09:11 -- common/autotest_common.sh@819 -- # '[' -z 2497439 ']' 00:25:22.315 16:09:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:22.315 16:09:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:22.315 16:09:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:22.315 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:22.315 16:09:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:22.315 16:09:11 -- common/autotest_common.sh@10 -- # set +x 00:25:22.315 [2024-10-30 16:09:12.028881] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:25:22.315 [2024-10-30 16:09:12.028953] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:22.315 EAL: No free 2048 kB hugepages reported on node 1 00:25:22.315 [2024-10-30 16:09:12.097840] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:22.574 [2024-10-30 16:09:12.191140] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:22.574 [2024-10-30 16:09:12.191313] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:22.574 [2024-10-30 16:09:12.191339] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:22.574 [2024-10-30 16:09:12.191357] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:22.574 [2024-10-30 16:09:12.191453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:22.574 [2024-10-30 16:09:12.191486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:22.574 [2024-10-30 16:09:12.191492] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:23.507 16:09:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:23.507 16:09:13 -- common/autotest_common.sh@852 -- # return 0 00:25:23.507 16:09:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:23.507 16:09:13 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:23.507 16:09:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.507 16:09:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:23.507 16:09:13 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:23.507 16:09:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:23.507 16:09:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.507 [2024-10-30 16:09:13.057507] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:23.507 16:09:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:23.507 16:09:13 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:23.507 16:09:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:23.507 16:09:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.507 Malloc0 00:25:23.507 16:09:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:23.507 16:09:13 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:23.507 16:09:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:23.507 16:09:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.507 16:09:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:23.507 16:09:13 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:23.507 16:09:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:23.507 16:09:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.507 16:09:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:23.507 16:09:13 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:23.507 16:09:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:23.507 16:09:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.507 [2024-10-30 16:09:13.116022] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:23.507 16:09:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:23.507 16:09:13 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:23.507 16:09:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:23.507 16:09:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.507 [2024-10-30 16:09:13.123931] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:23.507 16:09:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:23.507 16:09:13 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:23.507 16:09:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:23.507 16:09:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.507 Malloc1 00:25:23.507 16:09:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:23.507 16:09:13 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:23.507 16:09:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:23.507 16:09:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.508 16:09:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:23.508 16:09:13 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:23.508 16:09:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:23.508 16:09:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.508 16:09:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:23.508 16:09:13 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:23.508 16:09:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:23.508 16:09:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.508 16:09:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:23.508 16:09:13 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:23.508 16:09:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:23.508 16:09:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.508 16:09:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:23.508 16:09:13 -- host/multicontroller.sh@44 -- # bdevperf_pid=2497628 00:25:23.508 16:09:13 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:23.508 16:09:13 -- host/multicontroller.sh@47 -- # waitforlisten 2497628 /var/tmp/bdevperf.sock 00:25:23.508 16:09:13 -- common/autotest_common.sh@819 -- # '[' -z 2497628 ']' 00:25:23.508 16:09:13 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:23.508 16:09:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:23.508 16:09:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:23.508 16:09:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:23.508 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:23.508 16:09:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:23.508 16:09:13 -- common/autotest_common.sh@10 -- # set +x 00:25:24.442 16:09:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:24.442 16:09:14 -- common/autotest_common.sh@852 -- # return 0 00:25:24.442 16:09:14 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:24.442 16:09:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:24.442 16:09:14 -- common/autotest_common.sh@10 -- # set +x 00:25:24.700 NVMe0n1 00:25:24.700 16:09:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:24.700 16:09:14 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:24.700 16:09:14 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:24.700 16:09:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:24.700 16:09:14 -- common/autotest_common.sh@10 -- # set +x 00:25:24.700 16:09:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:24.700 1 00:25:24.700 16:09:14 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:24.700 16:09:14 -- common/autotest_common.sh@640 -- # local es=0 00:25:24.700 16:09:14 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:24.700 16:09:14 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:24.700 16:09:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:24.700 16:09:14 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:24.700 16:09:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:24.700 16:09:14 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:24.700 16:09:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:24.700 16:09:14 -- common/autotest_common.sh@10 -- # set +x 00:25:24.700 request: 00:25:24.700 { 00:25:24.700 "name": "NVMe0", 00:25:24.700 "trtype": "tcp", 00:25:24.700 "traddr": "10.0.0.2", 00:25:24.700 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:24.700 "hostaddr": "10.0.0.2", 00:25:24.700 "hostsvcid": "60000", 00:25:24.700 "adrfam": "ipv4", 00:25:24.700 "trsvcid": "4420", 00:25:24.700 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:24.700 "method": "bdev_nvme_attach_controller", 00:25:24.700 "req_id": 1 00:25:24.700 } 00:25:24.700 Got JSON-RPC error response 00:25:24.700 response: 00:25:24.700 { 00:25:24.700 "code": -114, 00:25:24.700 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:24.700 } 00:25:24.700 16:09:14 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:24.700 16:09:14 -- common/autotest_common.sh@643 -- # es=1 00:25:24.700 16:09:14 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:24.700 16:09:14 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:24.700 16:09:14 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:24.700 16:09:14 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:24.700 16:09:14 -- common/autotest_common.sh@640 -- # local es=0 00:25:24.700 16:09:14 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:24.700 16:09:14 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:24.700 16:09:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:24.700 16:09:14 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:24.700 16:09:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:24.700 16:09:14 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:24.700 16:09:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:24.700 16:09:14 -- common/autotest_common.sh@10 -- # set +x 00:25:24.700 request: 00:25:24.700 { 00:25:24.700 "name": "NVMe0", 00:25:24.700 "trtype": "tcp", 00:25:24.700 "traddr": "10.0.0.2", 00:25:24.700 "hostaddr": "10.0.0.2", 00:25:24.700 "hostsvcid": "60000", 00:25:24.700 "adrfam": "ipv4", 00:25:24.700 "trsvcid": "4420", 00:25:24.700 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:24.700 "method": "bdev_nvme_attach_controller", 00:25:24.700 "req_id": 1 00:25:24.700 } 00:25:24.700 Got JSON-RPC error response 00:25:24.700 response: 00:25:24.700 { 00:25:24.700 "code": -114, 00:25:24.700 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:24.700 } 00:25:24.700 16:09:14 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:24.700 16:09:14 -- common/autotest_common.sh@643 -- # es=1 00:25:24.700 16:09:14 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:24.701 16:09:14 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:24.701 16:09:14 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:24.701 16:09:14 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:24.701 16:09:14 -- common/autotest_common.sh@640 -- # local es=0 00:25:24.701 16:09:14 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:24.701 16:09:14 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:24.701 16:09:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:24.701 16:09:14 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:24.701 16:09:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:24.701 16:09:14 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:24.701 16:09:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:24.701 16:09:14 -- common/autotest_common.sh@10 -- # set +x 00:25:24.701 request: 00:25:24.701 { 00:25:24.701 "name": "NVMe0", 00:25:24.701 "trtype": "tcp", 00:25:24.701 "traddr": "10.0.0.2", 00:25:24.701 "hostaddr": "10.0.0.2", 00:25:24.701 "hostsvcid": "60000", 00:25:24.701 "adrfam": "ipv4", 00:25:24.701 "trsvcid": "4420", 00:25:24.701 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:24.701 "multipath": "disable", 00:25:24.701 "method": "bdev_nvme_attach_controller", 00:25:24.701 "req_id": 1 00:25:24.701 } 00:25:24.701 Got JSON-RPC error response 00:25:24.701 response: 00:25:24.701 { 00:25:24.701 "code": -114, 00:25:24.701 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:24.701 } 00:25:24.701 16:09:14 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:24.701 16:09:14 -- common/autotest_common.sh@643 -- # es=1 00:25:24.701 16:09:14 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:24.701 16:09:14 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:24.701 16:09:14 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:24.701 16:09:14 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:24.701 16:09:14 -- common/autotest_common.sh@640 -- # local es=0 00:25:24.701 16:09:14 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:24.701 16:09:14 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:24.701 16:09:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:24.701 16:09:14 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:24.701 16:09:14 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:24.701 16:09:14 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:24.701 16:09:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:24.701 16:09:14 -- common/autotest_common.sh@10 -- # set +x 00:25:24.701 request: 00:25:24.701 { 00:25:24.701 "name": "NVMe0", 00:25:24.701 "trtype": "tcp", 00:25:24.701 "traddr": "10.0.0.2", 00:25:24.701 "hostaddr": "10.0.0.2", 00:25:24.701 "hostsvcid": "60000", 00:25:24.701 "adrfam": "ipv4", 00:25:24.701 "trsvcid": "4420", 00:25:24.701 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:24.701 "multipath": "failover", 00:25:24.701 "method": "bdev_nvme_attach_controller", 00:25:24.701 "req_id": 1 00:25:24.701 } 00:25:24.701 Got JSON-RPC error response 00:25:24.701 response: 00:25:24.701 { 00:25:24.701 "code": -114, 00:25:24.701 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:24.701 } 00:25:24.701 16:09:14 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:24.701 16:09:14 -- common/autotest_common.sh@643 -- # es=1 00:25:24.701 16:09:14 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:24.701 16:09:14 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:24.701 16:09:14 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:24.701 16:09:14 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:24.701 16:09:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:24.701 16:09:14 -- common/autotest_common.sh@10 -- # set +x 00:25:24.960 00:25:24.960 16:09:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:24.960 16:09:14 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:24.960 16:09:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:24.960 16:09:14 -- common/autotest_common.sh@10 -- # set +x 00:25:24.960 16:09:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:24.960 16:09:14 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:24.960 16:09:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:24.960 16:09:14 -- common/autotest_common.sh@10 -- # set +x 00:25:24.960 00:25:24.960 16:09:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:24.960 16:09:14 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:24.960 16:09:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:24.960 16:09:14 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:24.960 16:09:14 -- common/autotest_common.sh@10 -- # set +x 00:25:24.960 16:09:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:24.960 16:09:14 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:24.960 16:09:14 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:26.334 0 00:25:26.334 16:09:15 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:26.334 16:09:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:26.334 16:09:15 -- common/autotest_common.sh@10 -- # set +x 00:25:26.334 16:09:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:26.334 16:09:15 -- host/multicontroller.sh@100 -- # killprocess 2497628 00:25:26.334 16:09:15 -- common/autotest_common.sh@926 -- # '[' -z 2497628 ']' 00:25:26.334 16:09:15 -- common/autotest_common.sh@930 -- # kill -0 2497628 00:25:26.334 16:09:15 -- common/autotest_common.sh@931 -- # uname 00:25:26.334 16:09:15 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:26.334 16:09:15 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2497628 00:25:26.334 16:09:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:26.334 16:09:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:26.334 16:09:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2497628' 00:25:26.334 killing process with pid 2497628 00:25:26.334 16:09:16 -- common/autotest_common.sh@945 -- # kill 2497628 00:25:26.334 16:09:16 -- common/autotest_common.sh@950 -- # wait 2497628 00:25:26.592 16:09:16 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:26.592 16:09:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:26.592 16:09:16 -- common/autotest_common.sh@10 -- # set +x 00:25:26.592 16:09:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:26.592 16:09:16 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:26.592 16:09:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:26.592 16:09:16 -- common/autotest_common.sh@10 -- # set +x 00:25:26.592 16:09:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:26.592 16:09:16 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:26.592 16:09:16 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:26.592 16:09:16 -- common/autotest_common.sh@1597 -- # read -r file 00:25:26.592 16:09:16 -- common/autotest_common.sh@1596 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:26.593 16:09:16 -- common/autotest_common.sh@1596 -- # sort -u 00:25:26.593 16:09:16 -- common/autotest_common.sh@1598 -- # cat 00:25:26.593 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:26.593 [2024-10-30 16:09:13.225196] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:25:26.593 [2024-10-30 16:09:13.225303] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2497628 ] 00:25:26.593 EAL: No free 2048 kB hugepages reported on node 1 00:25:26.593 [2024-10-30 16:09:13.287039] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:26.593 [2024-10-30 16:09:13.371511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:26.593 [2024-10-30 16:09:14.815560] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 95949f83-445d-429f-97ab-11635bb154ba already exists 00:25:26.593 [2024-10-30 16:09:14.815620] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:95949f83-445d-429f-97ab-11635bb154ba alias for bdev NVMe1n1 00:25:26.593 [2024-10-30 16:09:14.815640] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:26.593 Running I/O for 1 seconds... 00:25:26.593 00:25:26.593 Latency(us) 00:25:26.593 [2024-10-30T15:09:16.469Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:26.593 [2024-10-30T15:09:16.469Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:26.593 NVMe0n1 : 1.00 19816.22 77.41 0.00 0.00 6449.77 3689.43 13495.56 00:25:26.593 [2024-10-30T15:09:16.469Z] =================================================================================================================== 00:25:26.593 [2024-10-30T15:09:16.469Z] Total : 19816.22 77.41 0.00 0.00 6449.77 3689.43 13495.56 00:25:26.593 Received shutdown signal, test time was about 1.000000 seconds 00:25:26.593 00:25:26.593 Latency(us) 00:25:26.593 [2024-10-30T15:09:16.469Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:26.593 [2024-10-30T15:09:16.469Z] =================================================================================================================== 00:25:26.593 [2024-10-30T15:09:16.469Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:26.593 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:26.593 16:09:16 -- common/autotest_common.sh@1603 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:26.593 16:09:16 -- common/autotest_common.sh@1597 -- # read -r file 00:25:26.593 16:09:16 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:26.593 16:09:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:26.593 16:09:16 -- nvmf/common.sh@116 -- # sync 00:25:26.593 16:09:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:26.593 16:09:16 -- nvmf/common.sh@119 -- # set +e 00:25:26.593 16:09:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:26.593 16:09:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:26.593 rmmod nvme_tcp 00:25:26.593 rmmod nvme_fabrics 00:25:26.593 rmmod nvme_keyring 00:25:26.593 16:09:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:26.593 16:09:16 -- nvmf/common.sh@123 -- # set -e 00:25:26.593 16:09:16 -- nvmf/common.sh@124 -- # return 0 00:25:26.593 16:09:16 -- nvmf/common.sh@477 -- # '[' -n 2497439 ']' 00:25:26.593 16:09:16 -- nvmf/common.sh@478 -- # killprocess 2497439 00:25:26.593 16:09:16 -- common/autotest_common.sh@926 -- # '[' -z 2497439 ']' 00:25:26.593 16:09:16 -- common/autotest_common.sh@930 -- # kill -0 2497439 00:25:26.593 16:09:16 -- common/autotest_common.sh@931 -- # uname 00:25:26.593 16:09:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:26.593 16:09:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2497439 00:25:26.593 16:09:16 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:26.593 16:09:16 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:26.593 16:09:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2497439' 00:25:26.593 killing process with pid 2497439 00:25:26.593 16:09:16 -- common/autotest_common.sh@945 -- # kill 2497439 00:25:26.593 16:09:16 -- common/autotest_common.sh@950 -- # wait 2497439 00:25:26.852 16:09:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:26.852 16:09:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:26.852 16:09:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:26.852 16:09:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:26.852 16:09:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:26.852 16:09:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:26.852 16:09:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:26.852 16:09:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:29.391 16:09:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:29.391 00:25:29.391 real 0m8.942s 00:25:29.391 user 0m17.549s 00:25:29.391 sys 0m2.282s 00:25:29.391 16:09:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:29.391 16:09:18 -- common/autotest_common.sh@10 -- # set +x 00:25:29.391 ************************************ 00:25:29.391 END TEST nvmf_multicontroller 00:25:29.391 ************************************ 00:25:29.391 16:09:18 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:29.391 16:09:18 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:29.391 16:09:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:29.391 16:09:18 -- common/autotest_common.sh@10 -- # set +x 00:25:29.391 ************************************ 00:25:29.391 START TEST nvmf_aer 00:25:29.391 ************************************ 00:25:29.391 16:09:18 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:29.391 * Looking for test storage... 00:25:29.391 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:29.391 16:09:18 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:29.391 16:09:18 -- nvmf/common.sh@7 -- # uname -s 00:25:29.391 16:09:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:29.391 16:09:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:29.391 16:09:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:29.391 16:09:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:29.391 16:09:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:29.391 16:09:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:29.391 16:09:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:29.391 16:09:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:29.391 16:09:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:29.391 16:09:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:29.391 16:09:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:29.391 16:09:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:29.391 16:09:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:29.391 16:09:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:29.391 16:09:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:29.391 16:09:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:29.391 16:09:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:29.391 16:09:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:29.391 16:09:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:29.391 16:09:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:29.391 16:09:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:29.391 16:09:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:29.391 16:09:18 -- paths/export.sh@5 -- # export PATH 00:25:29.391 16:09:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:29.391 16:09:18 -- nvmf/common.sh@46 -- # : 0 00:25:29.391 16:09:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:29.391 16:09:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:29.391 16:09:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:29.391 16:09:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:29.391 16:09:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:29.391 16:09:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:29.391 16:09:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:29.392 16:09:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:29.392 16:09:18 -- host/aer.sh@11 -- # nvmftestinit 00:25:29.392 16:09:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:29.392 16:09:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:29.392 16:09:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:29.392 16:09:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:29.392 16:09:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:29.392 16:09:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:29.392 16:09:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:29.392 16:09:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:29.392 16:09:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:29.392 16:09:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:29.392 16:09:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:29.392 16:09:18 -- common/autotest_common.sh@10 -- # set +x 00:25:31.294 16:09:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:31.294 16:09:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:31.294 16:09:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:31.294 16:09:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:31.294 16:09:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:31.294 16:09:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:31.294 16:09:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:31.294 16:09:20 -- nvmf/common.sh@294 -- # net_devs=() 00:25:31.294 16:09:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:31.294 16:09:20 -- nvmf/common.sh@295 -- # e810=() 00:25:31.294 16:09:20 -- nvmf/common.sh@295 -- # local -ga e810 00:25:31.294 16:09:20 -- nvmf/common.sh@296 -- # x722=() 00:25:31.294 16:09:20 -- nvmf/common.sh@296 -- # local -ga x722 00:25:31.294 16:09:20 -- nvmf/common.sh@297 -- # mlx=() 00:25:31.294 16:09:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:31.294 16:09:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:31.294 16:09:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:31.294 16:09:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:31.294 16:09:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:31.294 16:09:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:31.294 16:09:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:31.294 16:09:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:31.294 16:09:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:31.294 16:09:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:31.294 16:09:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:31.294 16:09:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:31.294 16:09:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:31.294 16:09:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:31.294 16:09:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:31.294 16:09:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:31.294 16:09:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:31.294 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:31.294 16:09:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:31.294 16:09:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:31.294 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:31.294 16:09:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:31.294 16:09:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:31.294 16:09:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:31.294 16:09:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:31.294 16:09:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:31.294 16:09:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:31.294 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:31.294 16:09:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:31.294 16:09:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:31.294 16:09:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:31.294 16:09:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:31.294 16:09:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:31.294 16:09:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:31.294 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:31.294 16:09:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:31.294 16:09:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:31.294 16:09:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:31.294 16:09:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:31.294 16:09:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:31.294 16:09:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:31.294 16:09:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:31.294 16:09:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:31.294 16:09:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:31.294 16:09:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:31.294 16:09:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:31.294 16:09:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:31.294 16:09:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:31.294 16:09:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:31.294 16:09:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:31.294 16:09:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:31.294 16:09:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:31.294 16:09:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:31.294 16:09:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:31.294 16:09:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:31.294 16:09:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:31.294 16:09:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:31.294 16:09:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:31.294 16:09:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:31.294 16:09:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:31.294 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:31.294 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.179 ms 00:25:31.294 00:25:31.294 --- 10.0.0.2 ping statistics --- 00:25:31.294 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:31.294 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:25:31.294 16:09:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:31.294 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:31.294 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:25:31.294 00:25:31.294 --- 10.0.0.1 ping statistics --- 00:25:31.294 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:31.294 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:25:31.294 16:09:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:31.294 16:09:20 -- nvmf/common.sh@410 -- # return 0 00:25:31.294 16:09:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:31.294 16:09:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:31.294 16:09:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:31.295 16:09:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:31.295 16:09:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:31.295 16:09:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:31.295 16:09:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:31.295 16:09:21 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:25:31.295 16:09:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:31.295 16:09:21 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:31.295 16:09:21 -- common/autotest_common.sh@10 -- # set +x 00:25:31.295 16:09:21 -- nvmf/common.sh@469 -- # nvmfpid=2499887 00:25:31.295 16:09:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:31.295 16:09:21 -- nvmf/common.sh@470 -- # waitforlisten 2499887 00:25:31.295 16:09:21 -- common/autotest_common.sh@819 -- # '[' -z 2499887 ']' 00:25:31.295 16:09:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:31.295 16:09:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:31.295 16:09:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:31.295 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:31.295 16:09:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:31.295 16:09:21 -- common/autotest_common.sh@10 -- # set +x 00:25:31.295 [2024-10-30 16:09:21.058159] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:25:31.295 [2024-10-30 16:09:21.058234] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:31.295 EAL: No free 2048 kB hugepages reported on node 1 00:25:31.295 [2024-10-30 16:09:21.130765] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:31.553 [2024-10-30 16:09:21.225609] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:31.553 [2024-10-30 16:09:21.225765] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:31.553 [2024-10-30 16:09:21.225784] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:31.553 [2024-10-30 16:09:21.225797] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:31.553 [2024-10-30 16:09:21.225863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:31.553 [2024-10-30 16:09:21.225916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:31.553 [2024-10-30 16:09:21.225964] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:31.553 [2024-10-30 16:09:21.225967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:32.487 16:09:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:32.487 16:09:22 -- common/autotest_common.sh@852 -- # return 0 00:25:32.487 16:09:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:32.487 16:09:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:32.487 16:09:22 -- common/autotest_common.sh@10 -- # set +x 00:25:32.487 16:09:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:32.487 16:09:22 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:32.487 16:09:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:32.487 16:09:22 -- common/autotest_common.sh@10 -- # set +x 00:25:32.487 [2024-10-30 16:09:22.096075] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:32.487 16:09:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:32.487 16:09:22 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:25:32.487 16:09:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:32.487 16:09:22 -- common/autotest_common.sh@10 -- # set +x 00:25:32.487 Malloc0 00:25:32.487 16:09:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:32.487 16:09:22 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:25:32.487 16:09:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:32.487 16:09:22 -- common/autotest_common.sh@10 -- # set +x 00:25:32.487 16:09:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:32.487 16:09:22 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:32.487 16:09:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:32.487 16:09:22 -- common/autotest_common.sh@10 -- # set +x 00:25:32.487 16:09:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:32.487 16:09:22 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:32.487 16:09:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:32.487 16:09:22 -- common/autotest_common.sh@10 -- # set +x 00:25:32.487 [2024-10-30 16:09:22.149047] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:32.487 16:09:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:32.487 16:09:22 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:25:32.487 16:09:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:32.487 16:09:22 -- common/autotest_common.sh@10 -- # set +x 00:25:32.487 [2024-10-30 16:09:22.156807] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:32.487 [ 00:25:32.487 { 00:25:32.487 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:32.487 "subtype": "Discovery", 00:25:32.487 "listen_addresses": [], 00:25:32.487 "allow_any_host": true, 00:25:32.487 "hosts": [] 00:25:32.487 }, 00:25:32.487 { 00:25:32.487 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:32.487 "subtype": "NVMe", 00:25:32.487 "listen_addresses": [ 00:25:32.487 { 00:25:32.487 "transport": "TCP", 00:25:32.487 "trtype": "TCP", 00:25:32.487 "adrfam": "IPv4", 00:25:32.487 "traddr": "10.0.0.2", 00:25:32.487 "trsvcid": "4420" 00:25:32.487 } 00:25:32.487 ], 00:25:32.487 "allow_any_host": true, 00:25:32.487 "hosts": [], 00:25:32.487 "serial_number": "SPDK00000000000001", 00:25:32.487 "model_number": "SPDK bdev Controller", 00:25:32.487 "max_namespaces": 2, 00:25:32.487 "min_cntlid": 1, 00:25:32.487 "max_cntlid": 65519, 00:25:32.487 "namespaces": [ 00:25:32.487 { 00:25:32.487 "nsid": 1, 00:25:32.487 "bdev_name": "Malloc0", 00:25:32.487 "name": "Malloc0", 00:25:32.487 "nguid": "715061437D2B4638B16E6A968917D4D1", 00:25:32.487 "uuid": "71506143-7d2b-4638-b16e-6a968917d4d1" 00:25:32.487 } 00:25:32.487 ] 00:25:32.487 } 00:25:32.487 ] 00:25:32.487 16:09:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:32.487 16:09:22 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:25:32.487 16:09:22 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:25:32.487 16:09:22 -- host/aer.sh@33 -- # aerpid=2500061 00:25:32.487 16:09:22 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:25:32.487 16:09:22 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:25:32.487 16:09:22 -- common/autotest_common.sh@1244 -- # local i=0 00:25:32.487 16:09:22 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:32.487 16:09:22 -- common/autotest_common.sh@1246 -- # '[' 0 -lt 200 ']' 00:25:32.487 16:09:22 -- common/autotest_common.sh@1247 -- # i=1 00:25:32.487 16:09:22 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:25:32.487 EAL: No free 2048 kB hugepages reported on node 1 00:25:32.487 16:09:22 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:32.487 16:09:22 -- common/autotest_common.sh@1246 -- # '[' 1 -lt 200 ']' 00:25:32.487 16:09:22 -- common/autotest_common.sh@1247 -- # i=2 00:25:32.487 16:09:22 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:25:32.746 16:09:22 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:32.746 16:09:22 -- common/autotest_common.sh@1246 -- # '[' 2 -lt 200 ']' 00:25:32.746 16:09:22 -- common/autotest_common.sh@1247 -- # i=3 00:25:32.746 16:09:22 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:25:32.746 16:09:22 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:32.746 16:09:22 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:32.746 16:09:22 -- common/autotest_common.sh@1255 -- # return 0 00:25:32.746 16:09:22 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:25:32.746 16:09:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:32.746 16:09:22 -- common/autotest_common.sh@10 -- # set +x 00:25:32.746 Malloc1 00:25:32.746 16:09:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:32.746 16:09:22 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:25:32.746 16:09:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:32.746 16:09:22 -- common/autotest_common.sh@10 -- # set +x 00:25:32.746 16:09:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:32.746 16:09:22 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:25:32.746 16:09:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:32.746 16:09:22 -- common/autotest_common.sh@10 -- # set +x 00:25:32.746 Asynchronous Event Request test 00:25:32.746 Attaching to 10.0.0.2 00:25:32.746 Attached to 10.0.0.2 00:25:32.746 Registering asynchronous event callbacks... 00:25:32.746 Starting namespace attribute notice tests for all controllers... 00:25:32.746 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:25:32.746 aer_cb - Changed Namespace 00:25:32.746 Cleaning up... 00:25:32.746 [ 00:25:32.746 { 00:25:32.746 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:32.746 "subtype": "Discovery", 00:25:32.746 "listen_addresses": [], 00:25:32.746 "allow_any_host": true, 00:25:32.746 "hosts": [] 00:25:32.746 }, 00:25:32.746 { 00:25:32.746 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:32.746 "subtype": "NVMe", 00:25:32.746 "listen_addresses": [ 00:25:32.746 { 00:25:32.746 "transport": "TCP", 00:25:32.746 "trtype": "TCP", 00:25:32.746 "adrfam": "IPv4", 00:25:32.746 "traddr": "10.0.0.2", 00:25:32.746 "trsvcid": "4420" 00:25:32.746 } 00:25:32.746 ], 00:25:32.746 "allow_any_host": true, 00:25:32.746 "hosts": [], 00:25:32.746 "serial_number": "SPDK00000000000001", 00:25:32.746 "model_number": "SPDK bdev Controller", 00:25:32.746 "max_namespaces": 2, 00:25:32.746 "min_cntlid": 1, 00:25:32.746 "max_cntlid": 65519, 00:25:32.746 "namespaces": [ 00:25:32.746 { 00:25:32.746 "nsid": 1, 00:25:32.746 "bdev_name": "Malloc0", 00:25:32.746 "name": "Malloc0", 00:25:32.746 "nguid": "715061437D2B4638B16E6A968917D4D1", 00:25:32.746 "uuid": "71506143-7d2b-4638-b16e-6a968917d4d1" 00:25:32.746 }, 00:25:32.746 { 00:25:32.746 "nsid": 2, 00:25:32.746 "bdev_name": "Malloc1", 00:25:32.746 "name": "Malloc1", 00:25:32.746 "nguid": "5D9BFD5318E947E1A726E990FBB6F7AB", 00:25:32.746 "uuid": "5d9bfd53-18e9-47e1-a726-e990fbb6f7ab" 00:25:32.746 } 00:25:32.746 ] 00:25:32.746 } 00:25:32.746 ] 00:25:32.746 16:09:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:32.746 16:09:22 -- host/aer.sh@43 -- # wait 2500061 00:25:32.746 16:09:22 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:25:32.746 16:09:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:32.746 16:09:22 -- common/autotest_common.sh@10 -- # set +x 00:25:32.746 16:09:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:32.746 16:09:22 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:25:32.746 16:09:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:32.746 16:09:22 -- common/autotest_common.sh@10 -- # set +x 00:25:32.746 16:09:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:32.746 16:09:22 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:32.746 16:09:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:32.746 16:09:22 -- common/autotest_common.sh@10 -- # set +x 00:25:32.746 16:09:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:32.746 16:09:22 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:25:32.746 16:09:22 -- host/aer.sh@51 -- # nvmftestfini 00:25:32.746 16:09:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:32.746 16:09:22 -- nvmf/common.sh@116 -- # sync 00:25:32.746 16:09:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:32.746 16:09:22 -- nvmf/common.sh@119 -- # set +e 00:25:32.746 16:09:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:32.746 16:09:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:32.746 rmmod nvme_tcp 00:25:33.004 rmmod nvme_fabrics 00:25:33.004 rmmod nvme_keyring 00:25:33.004 16:09:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:33.004 16:09:22 -- nvmf/common.sh@123 -- # set -e 00:25:33.004 16:09:22 -- nvmf/common.sh@124 -- # return 0 00:25:33.004 16:09:22 -- nvmf/common.sh@477 -- # '[' -n 2499887 ']' 00:25:33.004 16:09:22 -- nvmf/common.sh@478 -- # killprocess 2499887 00:25:33.004 16:09:22 -- common/autotest_common.sh@926 -- # '[' -z 2499887 ']' 00:25:33.004 16:09:22 -- common/autotest_common.sh@930 -- # kill -0 2499887 00:25:33.004 16:09:22 -- common/autotest_common.sh@931 -- # uname 00:25:33.004 16:09:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:33.004 16:09:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2499887 00:25:33.004 16:09:22 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:33.005 16:09:22 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:33.005 16:09:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2499887' 00:25:33.005 killing process with pid 2499887 00:25:33.005 16:09:22 -- common/autotest_common.sh@945 -- # kill 2499887 00:25:33.005 [2024-10-30 16:09:22.701056] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:33.005 16:09:22 -- common/autotest_common.sh@950 -- # wait 2499887 00:25:33.264 16:09:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:33.264 16:09:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:33.264 16:09:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:33.264 16:09:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:33.264 16:09:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:33.264 16:09:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:33.264 16:09:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:33.264 16:09:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:35.169 16:09:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:35.169 00:25:35.169 real 0m6.230s 00:25:35.169 user 0m7.587s 00:25:35.169 sys 0m1.979s 00:25:35.169 16:09:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:35.169 16:09:24 -- common/autotest_common.sh@10 -- # set +x 00:25:35.169 ************************************ 00:25:35.169 END TEST nvmf_aer 00:25:35.169 ************************************ 00:25:35.169 16:09:24 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:35.169 16:09:24 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:35.169 16:09:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:35.169 16:09:24 -- common/autotest_common.sh@10 -- # set +x 00:25:35.169 ************************************ 00:25:35.169 START TEST nvmf_async_init 00:25:35.169 ************************************ 00:25:35.169 16:09:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:35.169 * Looking for test storage... 00:25:35.169 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:35.169 16:09:25 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:35.169 16:09:25 -- nvmf/common.sh@7 -- # uname -s 00:25:35.169 16:09:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:35.169 16:09:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:35.169 16:09:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:35.169 16:09:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:35.169 16:09:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:35.169 16:09:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:35.169 16:09:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:35.169 16:09:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:35.169 16:09:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:35.169 16:09:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:35.428 16:09:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:35.428 16:09:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:35.428 16:09:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:35.428 16:09:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:35.428 16:09:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:35.428 16:09:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:35.428 16:09:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:35.428 16:09:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:35.428 16:09:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:35.428 16:09:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:35.428 16:09:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:35.428 16:09:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:35.428 16:09:25 -- paths/export.sh@5 -- # export PATH 00:25:35.428 16:09:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:35.428 16:09:25 -- nvmf/common.sh@46 -- # : 0 00:25:35.428 16:09:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:35.428 16:09:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:35.428 16:09:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:35.428 16:09:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:35.428 16:09:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:35.428 16:09:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:35.428 16:09:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:35.428 16:09:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:35.428 16:09:25 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:35.428 16:09:25 -- host/async_init.sh@14 -- # null_block_size=512 00:25:35.428 16:09:25 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:35.428 16:09:25 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:35.428 16:09:25 -- host/async_init.sh@20 -- # uuidgen 00:25:35.428 16:09:25 -- host/async_init.sh@20 -- # tr -d - 00:25:35.428 16:09:25 -- host/async_init.sh@20 -- # nguid=52f0610b517444c1a8b7feaeda3ada02 00:25:35.428 16:09:25 -- host/async_init.sh@22 -- # nvmftestinit 00:25:35.428 16:09:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:35.428 16:09:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:35.428 16:09:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:35.428 16:09:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:35.428 16:09:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:35.428 16:09:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:35.428 16:09:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:35.428 16:09:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:35.428 16:09:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:35.428 16:09:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:35.428 16:09:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:35.428 16:09:25 -- common/autotest_common.sh@10 -- # set +x 00:25:37.329 16:09:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:37.329 16:09:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:37.329 16:09:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:37.329 16:09:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:37.329 16:09:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:37.329 16:09:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:37.329 16:09:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:37.329 16:09:27 -- nvmf/common.sh@294 -- # net_devs=() 00:25:37.329 16:09:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:37.329 16:09:27 -- nvmf/common.sh@295 -- # e810=() 00:25:37.329 16:09:27 -- nvmf/common.sh@295 -- # local -ga e810 00:25:37.329 16:09:27 -- nvmf/common.sh@296 -- # x722=() 00:25:37.329 16:09:27 -- nvmf/common.sh@296 -- # local -ga x722 00:25:37.329 16:09:27 -- nvmf/common.sh@297 -- # mlx=() 00:25:37.329 16:09:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:37.329 16:09:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:37.329 16:09:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:37.329 16:09:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:37.329 16:09:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:37.329 16:09:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:37.329 16:09:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:37.329 16:09:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:37.329 16:09:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:37.329 16:09:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:37.329 16:09:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:37.329 16:09:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:37.329 16:09:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:37.329 16:09:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:37.329 16:09:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:37.329 16:09:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:37.329 16:09:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:37.329 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:37.329 16:09:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:37.329 16:09:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:37.329 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:37.329 16:09:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:37.329 16:09:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:37.329 16:09:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:37.329 16:09:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:37.329 16:09:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:37.329 16:09:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:37.329 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:37.329 16:09:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:37.329 16:09:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:37.329 16:09:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:37.329 16:09:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:37.329 16:09:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:37.329 16:09:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:37.329 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:37.329 16:09:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:37.329 16:09:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:37.329 16:09:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:37.329 16:09:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:37.329 16:09:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:37.329 16:09:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:37.329 16:09:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:37.329 16:09:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:37.329 16:09:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:37.329 16:09:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:37.329 16:09:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:37.329 16:09:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:37.329 16:09:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:37.329 16:09:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:37.329 16:09:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:37.329 16:09:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:37.329 16:09:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:37.329 16:09:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:37.329 16:09:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:37.329 16:09:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:37.329 16:09:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:37.329 16:09:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:37.329 16:09:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:37.586 16:09:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:37.586 16:09:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:37.586 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:37.586 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:25:37.586 00:25:37.586 --- 10.0.0.2 ping statistics --- 00:25:37.586 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:37.586 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:25:37.586 16:09:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:37.586 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:37.586 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:25:37.586 00:25:37.586 --- 10.0.0.1 ping statistics --- 00:25:37.586 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:37.586 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:25:37.586 16:09:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:37.586 16:09:27 -- nvmf/common.sh@410 -- # return 0 00:25:37.586 16:09:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:37.586 16:09:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:37.586 16:09:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:37.586 16:09:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:37.586 16:09:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:37.586 16:09:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:37.586 16:09:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:37.586 16:09:27 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:37.586 16:09:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:37.586 16:09:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:37.586 16:09:27 -- common/autotest_common.sh@10 -- # set +x 00:25:37.586 16:09:27 -- nvmf/common.sh@469 -- # nvmfpid=2502102 00:25:37.586 16:09:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:37.586 16:09:27 -- nvmf/common.sh@470 -- # waitforlisten 2502102 00:25:37.586 16:09:27 -- common/autotest_common.sh@819 -- # '[' -z 2502102 ']' 00:25:37.586 16:09:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:37.586 16:09:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:37.586 16:09:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:37.586 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:37.586 16:09:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:37.586 16:09:27 -- common/autotest_common.sh@10 -- # set +x 00:25:37.586 [2024-10-30 16:09:27.296055] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:25:37.587 [2024-10-30 16:09:27.296139] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:37.587 EAL: No free 2048 kB hugepages reported on node 1 00:25:37.587 [2024-10-30 16:09:27.366124] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:37.587 [2024-10-30 16:09:27.453900] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:37.587 [2024-10-30 16:09:27.454073] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:37.587 [2024-10-30 16:09:27.454093] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:37.587 [2024-10-30 16:09:27.454108] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:37.587 [2024-10-30 16:09:27.454139] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:38.520 16:09:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:38.520 16:09:28 -- common/autotest_common.sh@852 -- # return 0 00:25:38.520 16:09:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:38.520 16:09:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:38.520 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:38.521 16:09:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:38.521 16:09:28 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:25:38.521 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.521 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:38.521 [2024-10-30 16:09:28.263112] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:38.521 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:38.521 16:09:28 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:25:38.521 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.521 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:38.521 null0 00:25:38.521 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:38.521 16:09:28 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:25:38.521 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.521 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:38.521 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:38.521 16:09:28 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:25:38.521 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.521 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:38.521 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:38.521 16:09:28 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 52f0610b517444c1a8b7feaeda3ada02 00:25:38.521 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.521 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:38.521 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:38.521 16:09:28 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:38.521 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.521 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:38.521 [2024-10-30 16:09:28.303394] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:38.521 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:38.521 16:09:28 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:25:38.521 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.521 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:38.779 nvme0n1 00:25:38.779 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:38.779 16:09:28 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:38.779 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.779 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:38.779 [ 00:25:38.779 { 00:25:38.779 "name": "nvme0n1", 00:25:38.779 "aliases": [ 00:25:38.779 "52f0610b-5174-44c1-a8b7-feaeda3ada02" 00:25:38.779 ], 00:25:38.779 "product_name": "NVMe disk", 00:25:38.779 "block_size": 512, 00:25:38.779 "num_blocks": 2097152, 00:25:38.779 "uuid": "52f0610b-5174-44c1-a8b7-feaeda3ada02", 00:25:38.779 "assigned_rate_limits": { 00:25:38.779 "rw_ios_per_sec": 0, 00:25:38.779 "rw_mbytes_per_sec": 0, 00:25:38.779 "r_mbytes_per_sec": 0, 00:25:38.779 "w_mbytes_per_sec": 0 00:25:38.779 }, 00:25:38.779 "claimed": false, 00:25:38.779 "zoned": false, 00:25:38.779 "supported_io_types": { 00:25:38.779 "read": true, 00:25:38.779 "write": true, 00:25:38.779 "unmap": false, 00:25:38.779 "write_zeroes": true, 00:25:38.779 "flush": true, 00:25:38.779 "reset": true, 00:25:38.779 "compare": true, 00:25:38.779 "compare_and_write": true, 00:25:38.779 "abort": true, 00:25:38.779 "nvme_admin": true, 00:25:38.779 "nvme_io": true 00:25:38.779 }, 00:25:38.779 "driver_specific": { 00:25:38.779 "nvme": [ 00:25:38.779 { 00:25:38.779 "trid": { 00:25:38.779 "trtype": "TCP", 00:25:38.779 "adrfam": "IPv4", 00:25:38.779 "traddr": "10.0.0.2", 00:25:38.779 "trsvcid": "4420", 00:25:38.779 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:38.779 }, 00:25:38.779 "ctrlr_data": { 00:25:38.779 "cntlid": 1, 00:25:38.779 "vendor_id": "0x8086", 00:25:38.779 "model_number": "SPDK bdev Controller", 00:25:38.779 "serial_number": "00000000000000000000", 00:25:38.779 "firmware_revision": "24.01.1", 00:25:38.779 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:38.779 "oacs": { 00:25:38.779 "security": 0, 00:25:38.779 "format": 0, 00:25:38.779 "firmware": 0, 00:25:38.779 "ns_manage": 0 00:25:38.779 }, 00:25:38.779 "multi_ctrlr": true, 00:25:38.779 "ana_reporting": false 00:25:38.779 }, 00:25:38.779 "vs": { 00:25:38.779 "nvme_version": "1.3" 00:25:38.779 }, 00:25:38.779 "ns_data": { 00:25:38.779 "id": 1, 00:25:38.779 "can_share": true 00:25:38.779 } 00:25:38.779 } 00:25:38.779 ], 00:25:38.779 "mp_policy": "active_passive" 00:25:38.779 } 00:25:38.779 } 00:25:38.779 ] 00:25:38.779 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:38.779 16:09:28 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:25:38.779 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.779 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:38.779 [2024-10-30 16:09:28.551999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:38.779 [2024-10-30 16:09:28.552087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x26703f0 (9): Bad file descriptor 00:25:39.038 [2024-10-30 16:09:28.684423] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:39.038 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.038 16:09:28 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:39.038 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.038 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:39.038 [ 00:25:39.038 { 00:25:39.038 "name": "nvme0n1", 00:25:39.038 "aliases": [ 00:25:39.038 "52f0610b-5174-44c1-a8b7-feaeda3ada02" 00:25:39.038 ], 00:25:39.038 "product_name": "NVMe disk", 00:25:39.038 "block_size": 512, 00:25:39.038 "num_blocks": 2097152, 00:25:39.038 "uuid": "52f0610b-5174-44c1-a8b7-feaeda3ada02", 00:25:39.038 "assigned_rate_limits": { 00:25:39.038 "rw_ios_per_sec": 0, 00:25:39.038 "rw_mbytes_per_sec": 0, 00:25:39.038 "r_mbytes_per_sec": 0, 00:25:39.038 "w_mbytes_per_sec": 0 00:25:39.038 }, 00:25:39.038 "claimed": false, 00:25:39.038 "zoned": false, 00:25:39.038 "supported_io_types": { 00:25:39.038 "read": true, 00:25:39.038 "write": true, 00:25:39.038 "unmap": false, 00:25:39.038 "write_zeroes": true, 00:25:39.038 "flush": true, 00:25:39.038 "reset": true, 00:25:39.038 "compare": true, 00:25:39.038 "compare_and_write": true, 00:25:39.038 "abort": true, 00:25:39.038 "nvme_admin": true, 00:25:39.038 "nvme_io": true 00:25:39.038 }, 00:25:39.038 "driver_specific": { 00:25:39.038 "nvme": [ 00:25:39.038 { 00:25:39.038 "trid": { 00:25:39.038 "trtype": "TCP", 00:25:39.038 "adrfam": "IPv4", 00:25:39.038 "traddr": "10.0.0.2", 00:25:39.038 "trsvcid": "4420", 00:25:39.038 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:39.038 }, 00:25:39.038 "ctrlr_data": { 00:25:39.038 "cntlid": 2, 00:25:39.038 "vendor_id": "0x8086", 00:25:39.038 "model_number": "SPDK bdev Controller", 00:25:39.038 "serial_number": "00000000000000000000", 00:25:39.038 "firmware_revision": "24.01.1", 00:25:39.038 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:39.038 "oacs": { 00:25:39.038 "security": 0, 00:25:39.038 "format": 0, 00:25:39.038 "firmware": 0, 00:25:39.038 "ns_manage": 0 00:25:39.038 }, 00:25:39.038 "multi_ctrlr": true, 00:25:39.038 "ana_reporting": false 00:25:39.038 }, 00:25:39.038 "vs": { 00:25:39.038 "nvme_version": "1.3" 00:25:39.038 }, 00:25:39.038 "ns_data": { 00:25:39.038 "id": 1, 00:25:39.038 "can_share": true 00:25:39.038 } 00:25:39.038 } 00:25:39.038 ], 00:25:39.038 "mp_policy": "active_passive" 00:25:39.038 } 00:25:39.038 } 00:25:39.038 ] 00:25:39.038 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.038 16:09:28 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:39.038 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.038 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:39.038 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.038 16:09:28 -- host/async_init.sh@53 -- # mktemp 00:25:39.038 16:09:28 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.p03gDPDPGN 00:25:39.038 16:09:28 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:25:39.038 16:09:28 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.p03gDPDPGN 00:25:39.038 16:09:28 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:25:39.038 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.038 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:39.038 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.038 16:09:28 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:25:39.038 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.038 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:39.038 [2024-10-30 16:09:28.732599] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:25:39.038 [2024-10-30 16:09:28.732733] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:39.038 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.038 16:09:28 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.p03gDPDPGN 00:25:39.038 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.038 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:39.038 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.038 16:09:28 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.p03gDPDPGN 00:25:39.038 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.038 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:39.038 [2024-10-30 16:09:28.748641] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:25:39.038 nvme0n1 00:25:39.038 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.038 16:09:28 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:39.038 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.038 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:39.038 [ 00:25:39.038 { 00:25:39.038 "name": "nvme0n1", 00:25:39.038 "aliases": [ 00:25:39.038 "52f0610b-5174-44c1-a8b7-feaeda3ada02" 00:25:39.038 ], 00:25:39.038 "product_name": "NVMe disk", 00:25:39.038 "block_size": 512, 00:25:39.038 "num_blocks": 2097152, 00:25:39.038 "uuid": "52f0610b-5174-44c1-a8b7-feaeda3ada02", 00:25:39.038 "assigned_rate_limits": { 00:25:39.038 "rw_ios_per_sec": 0, 00:25:39.038 "rw_mbytes_per_sec": 0, 00:25:39.038 "r_mbytes_per_sec": 0, 00:25:39.038 "w_mbytes_per_sec": 0 00:25:39.038 }, 00:25:39.038 "claimed": false, 00:25:39.038 "zoned": false, 00:25:39.038 "supported_io_types": { 00:25:39.038 "read": true, 00:25:39.038 "write": true, 00:25:39.038 "unmap": false, 00:25:39.038 "write_zeroes": true, 00:25:39.038 "flush": true, 00:25:39.038 "reset": true, 00:25:39.038 "compare": true, 00:25:39.038 "compare_and_write": true, 00:25:39.038 "abort": true, 00:25:39.038 "nvme_admin": true, 00:25:39.038 "nvme_io": true 00:25:39.038 }, 00:25:39.038 "driver_specific": { 00:25:39.038 "nvme": [ 00:25:39.038 { 00:25:39.038 "trid": { 00:25:39.038 "trtype": "TCP", 00:25:39.038 "adrfam": "IPv4", 00:25:39.038 "traddr": "10.0.0.2", 00:25:39.038 "trsvcid": "4421", 00:25:39.038 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:39.038 }, 00:25:39.038 "ctrlr_data": { 00:25:39.038 "cntlid": 3, 00:25:39.038 "vendor_id": "0x8086", 00:25:39.038 "model_number": "SPDK bdev Controller", 00:25:39.038 "serial_number": "00000000000000000000", 00:25:39.038 "firmware_revision": "24.01.1", 00:25:39.038 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:39.038 "oacs": { 00:25:39.038 "security": 0, 00:25:39.038 "format": 0, 00:25:39.038 "firmware": 0, 00:25:39.038 "ns_manage": 0 00:25:39.038 }, 00:25:39.038 "multi_ctrlr": true, 00:25:39.038 "ana_reporting": false 00:25:39.038 }, 00:25:39.038 "vs": { 00:25:39.038 "nvme_version": "1.3" 00:25:39.038 }, 00:25:39.038 "ns_data": { 00:25:39.038 "id": 1, 00:25:39.038 "can_share": true 00:25:39.038 } 00:25:39.038 } 00:25:39.038 ], 00:25:39.038 "mp_policy": "active_passive" 00:25:39.038 } 00:25:39.038 } 00:25:39.038 ] 00:25:39.038 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.038 16:09:28 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:39.038 16:09:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.038 16:09:28 -- common/autotest_common.sh@10 -- # set +x 00:25:39.038 16:09:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.038 16:09:28 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.p03gDPDPGN 00:25:39.038 16:09:28 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:25:39.038 16:09:28 -- host/async_init.sh@78 -- # nvmftestfini 00:25:39.038 16:09:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:39.038 16:09:28 -- nvmf/common.sh@116 -- # sync 00:25:39.038 16:09:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:39.038 16:09:28 -- nvmf/common.sh@119 -- # set +e 00:25:39.038 16:09:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:39.038 16:09:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:39.038 rmmod nvme_tcp 00:25:39.038 rmmod nvme_fabrics 00:25:39.038 rmmod nvme_keyring 00:25:39.297 16:09:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:39.297 16:09:28 -- nvmf/common.sh@123 -- # set -e 00:25:39.297 16:09:28 -- nvmf/common.sh@124 -- # return 0 00:25:39.297 16:09:28 -- nvmf/common.sh@477 -- # '[' -n 2502102 ']' 00:25:39.297 16:09:28 -- nvmf/common.sh@478 -- # killprocess 2502102 00:25:39.297 16:09:28 -- common/autotest_common.sh@926 -- # '[' -z 2502102 ']' 00:25:39.297 16:09:28 -- common/autotest_common.sh@930 -- # kill -0 2502102 00:25:39.297 16:09:28 -- common/autotest_common.sh@931 -- # uname 00:25:39.297 16:09:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:39.297 16:09:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2502102 00:25:39.297 16:09:28 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:39.297 16:09:28 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:39.297 16:09:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2502102' 00:25:39.297 killing process with pid 2502102 00:25:39.297 16:09:28 -- common/autotest_common.sh@945 -- # kill 2502102 00:25:39.297 16:09:28 -- common/autotest_common.sh@950 -- # wait 2502102 00:25:39.297 16:09:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:39.297 16:09:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:39.297 16:09:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:39.556 16:09:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:39.556 16:09:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:39.556 16:09:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:39.556 16:09:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:39.556 16:09:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:41.464 16:09:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:41.464 00:25:41.464 real 0m6.228s 00:25:41.464 user 0m2.986s 00:25:41.464 sys 0m1.851s 00:25:41.464 16:09:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:41.464 16:09:31 -- common/autotest_common.sh@10 -- # set +x 00:25:41.464 ************************************ 00:25:41.464 END TEST nvmf_async_init 00:25:41.464 ************************************ 00:25:41.464 16:09:31 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:41.464 16:09:31 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:41.464 16:09:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:41.464 16:09:31 -- common/autotest_common.sh@10 -- # set +x 00:25:41.464 ************************************ 00:25:41.464 START TEST dma 00:25:41.464 ************************************ 00:25:41.464 16:09:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:41.464 * Looking for test storage... 00:25:41.464 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:41.464 16:09:31 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:41.464 16:09:31 -- nvmf/common.sh@7 -- # uname -s 00:25:41.464 16:09:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:41.464 16:09:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:41.464 16:09:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:41.464 16:09:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:41.464 16:09:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:41.464 16:09:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:41.464 16:09:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:41.464 16:09:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:41.464 16:09:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:41.464 16:09:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:41.464 16:09:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:41.464 16:09:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:41.464 16:09:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:41.464 16:09:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:41.464 16:09:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:41.464 16:09:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:41.464 16:09:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:41.464 16:09:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:41.464 16:09:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:41.464 16:09:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.464 16:09:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.464 16:09:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.464 16:09:31 -- paths/export.sh@5 -- # export PATH 00:25:41.464 16:09:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.464 16:09:31 -- nvmf/common.sh@46 -- # : 0 00:25:41.464 16:09:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:41.464 16:09:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:41.464 16:09:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:41.464 16:09:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:41.464 16:09:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:41.464 16:09:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:41.464 16:09:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:41.464 16:09:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:41.464 16:09:31 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:25:41.464 16:09:31 -- host/dma.sh@13 -- # exit 0 00:25:41.464 00:25:41.464 real 0m0.063s 00:25:41.464 user 0m0.034s 00:25:41.464 sys 0m0.034s 00:25:41.464 16:09:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:41.464 16:09:31 -- common/autotest_common.sh@10 -- # set +x 00:25:41.464 ************************************ 00:25:41.464 END TEST dma 00:25:41.464 ************************************ 00:25:41.464 16:09:31 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:41.464 16:09:31 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:41.464 16:09:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:41.464 16:09:31 -- common/autotest_common.sh@10 -- # set +x 00:25:41.464 ************************************ 00:25:41.464 START TEST nvmf_identify 00:25:41.464 ************************************ 00:25:41.464 16:09:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:41.722 * Looking for test storage... 00:25:41.722 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:41.722 16:09:31 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:41.722 16:09:31 -- nvmf/common.sh@7 -- # uname -s 00:25:41.722 16:09:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:41.722 16:09:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:41.722 16:09:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:41.722 16:09:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:41.722 16:09:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:41.722 16:09:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:41.722 16:09:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:41.722 16:09:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:41.722 16:09:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:41.722 16:09:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:41.722 16:09:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:41.722 16:09:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:41.722 16:09:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:41.722 16:09:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:41.722 16:09:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:41.722 16:09:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:41.722 16:09:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:41.722 16:09:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:41.722 16:09:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:41.722 16:09:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.722 16:09:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.722 16:09:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.722 16:09:31 -- paths/export.sh@5 -- # export PATH 00:25:41.722 16:09:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:41.722 16:09:31 -- nvmf/common.sh@46 -- # : 0 00:25:41.722 16:09:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:41.722 16:09:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:41.722 16:09:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:41.722 16:09:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:41.722 16:09:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:41.722 16:09:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:41.722 16:09:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:41.722 16:09:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:41.722 16:09:31 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:41.722 16:09:31 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:41.722 16:09:31 -- host/identify.sh@14 -- # nvmftestinit 00:25:41.722 16:09:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:41.722 16:09:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:41.722 16:09:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:41.722 16:09:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:41.722 16:09:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:41.722 16:09:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:41.722 16:09:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:41.722 16:09:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:41.722 16:09:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:41.722 16:09:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:41.722 16:09:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:41.722 16:09:31 -- common/autotest_common.sh@10 -- # set +x 00:25:43.622 16:09:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:43.622 16:09:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:43.622 16:09:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:43.622 16:09:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:43.622 16:09:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:43.622 16:09:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:43.622 16:09:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:43.622 16:09:33 -- nvmf/common.sh@294 -- # net_devs=() 00:25:43.622 16:09:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:43.622 16:09:33 -- nvmf/common.sh@295 -- # e810=() 00:25:43.622 16:09:33 -- nvmf/common.sh@295 -- # local -ga e810 00:25:43.622 16:09:33 -- nvmf/common.sh@296 -- # x722=() 00:25:43.622 16:09:33 -- nvmf/common.sh@296 -- # local -ga x722 00:25:43.622 16:09:33 -- nvmf/common.sh@297 -- # mlx=() 00:25:43.622 16:09:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:43.622 16:09:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:43.622 16:09:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:43.622 16:09:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:43.622 16:09:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:43.622 16:09:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:43.622 16:09:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:43.622 16:09:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:43.622 16:09:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:43.622 16:09:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:43.622 16:09:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:43.622 16:09:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:43.622 16:09:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:43.622 16:09:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:43.622 16:09:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:43.622 16:09:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:43.622 16:09:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:43.622 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:43.622 16:09:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:43.622 16:09:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:43.622 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:43.622 16:09:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:43.622 16:09:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:43.622 16:09:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:43.622 16:09:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:43.622 16:09:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:43.622 16:09:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:43.622 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:43.622 16:09:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:43.622 16:09:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:43.622 16:09:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:43.622 16:09:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:43.622 16:09:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:43.622 16:09:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:43.622 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:43.622 16:09:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:43.622 16:09:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:43.622 16:09:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:43.622 16:09:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:43.622 16:09:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:43.622 16:09:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:43.622 16:09:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:43.622 16:09:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:43.622 16:09:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:43.622 16:09:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:43.622 16:09:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:43.622 16:09:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:43.622 16:09:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:43.622 16:09:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:43.622 16:09:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:43.622 16:09:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:43.622 16:09:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:43.622 16:09:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:43.622 16:09:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:43.622 16:09:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:43.622 16:09:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:43.622 16:09:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:43.622 16:09:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:43.622 16:09:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:43.622 16:09:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:43.622 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:43.622 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:25:43.622 00:25:43.622 --- 10.0.0.2 ping statistics --- 00:25:43.622 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.622 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:25:43.622 16:09:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:43.622 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:43.622 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:25:43.622 00:25:43.622 --- 10.0.0.1 ping statistics --- 00:25:43.622 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.622 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:25:43.622 16:09:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:43.622 16:09:33 -- nvmf/common.sh@410 -- # return 0 00:25:43.623 16:09:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:43.623 16:09:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:43.623 16:09:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:43.623 16:09:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:43.623 16:09:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:43.623 16:09:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:43.623 16:09:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:43.623 16:09:33 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:25:43.623 16:09:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:43.623 16:09:33 -- common/autotest_common.sh@10 -- # set +x 00:25:43.623 16:09:33 -- host/identify.sh@19 -- # nvmfpid=2504245 00:25:43.623 16:09:33 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:43.623 16:09:33 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:43.623 16:09:33 -- host/identify.sh@23 -- # waitforlisten 2504245 00:25:43.623 16:09:33 -- common/autotest_common.sh@819 -- # '[' -z 2504245 ']' 00:25:43.623 16:09:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:43.623 16:09:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:43.623 16:09:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:43.623 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:43.623 16:09:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:43.623 16:09:33 -- common/autotest_common.sh@10 -- # set +x 00:25:43.623 [2024-10-30 16:09:33.462503] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:25:43.623 [2024-10-30 16:09:33.462584] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:43.623 EAL: No free 2048 kB hugepages reported on node 1 00:25:43.881 [2024-10-30 16:09:33.534143] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:43.881 [2024-10-30 16:09:33.628416] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:43.881 [2024-10-30 16:09:33.628567] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:43.881 [2024-10-30 16:09:33.628586] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:43.881 [2024-10-30 16:09:33.628600] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:43.881 [2024-10-30 16:09:33.628655] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:43.881 [2024-10-30 16:09:33.628720] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:43.881 [2024-10-30 16:09:33.628697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:43.881 [2024-10-30 16:09:33.628723] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:44.815 16:09:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:44.815 16:09:34 -- common/autotest_common.sh@852 -- # return 0 00:25:44.815 16:09:34 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:44.815 16:09:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:44.815 16:09:34 -- common/autotest_common.sh@10 -- # set +x 00:25:44.815 [2024-10-30 16:09:34.478950] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:44.815 16:09:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:44.815 16:09:34 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:25:44.815 16:09:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:44.815 16:09:34 -- common/autotest_common.sh@10 -- # set +x 00:25:44.815 16:09:34 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:44.815 16:09:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:44.815 16:09:34 -- common/autotest_common.sh@10 -- # set +x 00:25:44.815 Malloc0 00:25:44.815 16:09:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:44.815 16:09:34 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:44.815 16:09:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:44.815 16:09:34 -- common/autotest_common.sh@10 -- # set +x 00:25:44.815 16:09:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:44.815 16:09:34 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:25:44.815 16:09:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:44.815 16:09:34 -- common/autotest_common.sh@10 -- # set +x 00:25:44.815 16:09:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:44.815 16:09:34 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:44.815 16:09:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:44.815 16:09:34 -- common/autotest_common.sh@10 -- # set +x 00:25:44.815 [2024-10-30 16:09:34.556781] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:44.815 16:09:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:44.815 16:09:34 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:44.815 16:09:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:44.815 16:09:34 -- common/autotest_common.sh@10 -- # set +x 00:25:44.815 16:09:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:44.815 16:09:34 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:25:44.815 16:09:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:44.815 16:09:34 -- common/autotest_common.sh@10 -- # set +x 00:25:44.815 [2024-10-30 16:09:34.572499] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:44.815 [ 00:25:44.815 { 00:25:44.815 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:44.815 "subtype": "Discovery", 00:25:44.815 "listen_addresses": [ 00:25:44.815 { 00:25:44.815 "transport": "TCP", 00:25:44.815 "trtype": "TCP", 00:25:44.815 "adrfam": "IPv4", 00:25:44.815 "traddr": "10.0.0.2", 00:25:44.815 "trsvcid": "4420" 00:25:44.815 } 00:25:44.815 ], 00:25:44.815 "allow_any_host": true, 00:25:44.815 "hosts": [] 00:25:44.815 }, 00:25:44.815 { 00:25:44.815 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:44.815 "subtype": "NVMe", 00:25:44.815 "listen_addresses": [ 00:25:44.815 { 00:25:44.815 "transport": "TCP", 00:25:44.815 "trtype": "TCP", 00:25:44.815 "adrfam": "IPv4", 00:25:44.815 "traddr": "10.0.0.2", 00:25:44.815 "trsvcid": "4420" 00:25:44.815 } 00:25:44.815 ], 00:25:44.815 "allow_any_host": true, 00:25:44.815 "hosts": [], 00:25:44.815 "serial_number": "SPDK00000000000001", 00:25:44.815 "model_number": "SPDK bdev Controller", 00:25:44.815 "max_namespaces": 32, 00:25:44.815 "min_cntlid": 1, 00:25:44.815 "max_cntlid": 65519, 00:25:44.815 "namespaces": [ 00:25:44.815 { 00:25:44.815 "nsid": 1, 00:25:44.815 "bdev_name": "Malloc0", 00:25:44.815 "name": "Malloc0", 00:25:44.815 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:25:44.815 "eui64": "ABCDEF0123456789", 00:25:44.815 "uuid": "55f4cf5b-68fb-42d9-a9d6-4db130ddc500" 00:25:44.815 } 00:25:44.815 ] 00:25:44.815 } 00:25:44.815 ] 00:25:44.815 16:09:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:44.815 16:09:34 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:25:44.815 [2024-10-30 16:09:34.597885] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:25:44.815 [2024-10-30 16:09:34.597927] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2504400 ] 00:25:44.815 EAL: No free 2048 kB hugepages reported on node 1 00:25:44.815 [2024-10-30 16:09:34.634687] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:25:44.815 [2024-10-30 16:09:34.634745] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:44.815 [2024-10-30 16:09:34.634754] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:44.815 [2024-10-30 16:09:34.634771] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:44.816 [2024-10-30 16:09:34.634786] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:44.816 [2024-10-30 16:09:34.635145] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:25:44.816 [2024-10-30 16:09:34.635208] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x2380420 0 00:25:44.816 [2024-10-30 16:09:34.641273] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:44.816 [2024-10-30 16:09:34.641295] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:44.816 [2024-10-30 16:09:34.641305] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:44.816 [2024-10-30 16:09:34.641311] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:44.816 [2024-10-30 16:09:34.641366] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.641380] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.641388] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2380420) 00:25:44.816 [2024-10-30 16:09:34.641415] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:44.816 [2024-10-30 16:09:34.641443] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5b00, cid 0, qid 0 00:25:44.816 [2024-10-30 16:09:34.648296] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.816 [2024-10-30 16:09:34.648315] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.816 [2024-10-30 16:09:34.648323] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.648330] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5b00) on tqpair=0x2380420 00:25:44.816 [2024-10-30 16:09:34.648363] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:44.816 [2024-10-30 16:09:34.648375] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:25:44.816 [2024-10-30 16:09:34.648385] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:25:44.816 [2024-10-30 16:09:34.648406] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.648415] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.648421] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2380420) 00:25:44.816 [2024-10-30 16:09:34.648433] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.816 [2024-10-30 16:09:34.648457] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5b00, cid 0, qid 0 00:25:44.816 [2024-10-30 16:09:34.648581] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.816 [2024-10-30 16:09:34.648596] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.816 [2024-10-30 16:09:34.648603] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.648610] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5b00) on tqpair=0x2380420 00:25:44.816 [2024-10-30 16:09:34.648622] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:25:44.816 [2024-10-30 16:09:34.648635] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:25:44.816 [2024-10-30 16:09:34.648647] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.648655] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.648661] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2380420) 00:25:44.816 [2024-10-30 16:09:34.648672] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.816 [2024-10-30 16:09:34.648693] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5b00, cid 0, qid 0 00:25:44.816 [2024-10-30 16:09:34.648772] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.816 [2024-10-30 16:09:34.648784] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.816 [2024-10-30 16:09:34.648791] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.648798] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5b00) on tqpair=0x2380420 00:25:44.816 [2024-10-30 16:09:34.648808] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:25:44.816 [2024-10-30 16:09:34.648822] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:25:44.816 [2024-10-30 16:09:34.648834] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.648841] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.648848] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2380420) 00:25:44.816 [2024-10-30 16:09:34.648863] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.816 [2024-10-30 16:09:34.648884] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5b00, cid 0, qid 0 00:25:44.816 [2024-10-30 16:09:34.648965] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.816 [2024-10-30 16:09:34.648979] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.816 [2024-10-30 16:09:34.648986] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.648992] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5b00) on tqpair=0x2380420 00:25:44.816 [2024-10-30 16:09:34.649003] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:44.816 [2024-10-30 16:09:34.649019] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.649028] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.649035] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2380420) 00:25:44.816 [2024-10-30 16:09:34.649045] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.816 [2024-10-30 16:09:34.649065] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5b00, cid 0, qid 0 00:25:44.816 [2024-10-30 16:09:34.649137] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.816 [2024-10-30 16:09:34.649149] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.816 [2024-10-30 16:09:34.649156] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.649162] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5b00) on tqpair=0x2380420 00:25:44.816 [2024-10-30 16:09:34.649172] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:25:44.816 [2024-10-30 16:09:34.649180] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:25:44.816 [2024-10-30 16:09:34.649193] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:44.816 [2024-10-30 16:09:34.649303] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:25:44.816 [2024-10-30 16:09:34.649313] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:44.816 [2024-10-30 16:09:34.649329] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.649336] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.649343] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2380420) 00:25:44.816 [2024-10-30 16:09:34.649353] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.816 [2024-10-30 16:09:34.649374] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5b00, cid 0, qid 0 00:25:44.816 [2024-10-30 16:09:34.649482] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.816 [2024-10-30 16:09:34.649494] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.816 [2024-10-30 16:09:34.649501] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.649507] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5b00) on tqpair=0x2380420 00:25:44.816 [2024-10-30 16:09:34.649517] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:44.816 [2024-10-30 16:09:34.649533] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.649545] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.649553] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2380420) 00:25:44.816 [2024-10-30 16:09:34.649563] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.816 [2024-10-30 16:09:34.649584] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5b00, cid 0, qid 0 00:25:44.816 [2024-10-30 16:09:34.649658] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.816 [2024-10-30 16:09:34.649670] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.816 [2024-10-30 16:09:34.649677] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.649684] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5b00) on tqpair=0x2380420 00:25:44.816 [2024-10-30 16:09:34.649693] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:44.816 [2024-10-30 16:09:34.649701] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:25:44.816 [2024-10-30 16:09:34.649714] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:25:44.816 [2024-10-30 16:09:34.649728] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:25:44.816 [2024-10-30 16:09:34.649743] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.649751] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.649757] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2380420) 00:25:44.816 [2024-10-30 16:09:34.649768] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.816 [2024-10-30 16:09:34.649789] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5b00, cid 0, qid 0 00:25:44.816 [2024-10-30 16:09:34.649910] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.816 [2024-10-30 16:09:34.649924] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.816 [2024-10-30 16:09:34.649931] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.649938] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2380420): datao=0, datal=4096, cccid=0 00:25:44.816 [2024-10-30 16:09:34.649946] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x23e5b00) on tqpair(0x2380420): expected_datao=0, payload_size=4096 00:25:44.816 [2024-10-30 16:09:34.649966] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.649977] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.650007] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.816 [2024-10-30 16:09:34.650018] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.816 [2024-10-30 16:09:34.650024] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.816 [2024-10-30 16:09:34.650031] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5b00) on tqpair=0x2380420 00:25:44.816 [2024-10-30 16:09:34.650045] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:25:44.817 [2024-10-30 16:09:34.650054] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:25:44.817 [2024-10-30 16:09:34.650061] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:25:44.817 [2024-10-30 16:09:34.650070] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:25:44.817 [2024-10-30 16:09:34.650077] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:25:44.817 [2024-10-30 16:09:34.650089] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:25:44.817 [2024-10-30 16:09:34.650109] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:25:44.817 [2024-10-30 16:09:34.650123] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650131] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650137] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2380420) 00:25:44.817 [2024-10-30 16:09:34.650148] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:44.817 [2024-10-30 16:09:34.650169] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5b00, cid 0, qid 0 00:25:44.817 [2024-10-30 16:09:34.650246] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.817 [2024-10-30 16:09:34.650268] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.817 [2024-10-30 16:09:34.650276] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650283] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5b00) on tqpair=0x2380420 00:25:44.817 [2024-10-30 16:09:34.650301] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650309] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650315] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2380420) 00:25:44.817 [2024-10-30 16:09:34.650325] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.817 [2024-10-30 16:09:34.650335] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650342] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650348] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x2380420) 00:25:44.817 [2024-10-30 16:09:34.650356] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.817 [2024-10-30 16:09:34.650366] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650372] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650379] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x2380420) 00:25:44.817 [2024-10-30 16:09:34.650387] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.817 [2024-10-30 16:09:34.650397] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650403] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650410] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:44.817 [2024-10-30 16:09:34.650418] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.817 [2024-10-30 16:09:34.650427] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:25:44.817 [2024-10-30 16:09:34.650447] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:44.817 [2024-10-30 16:09:34.650461] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650469] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650476] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2380420) 00:25:44.817 [2024-10-30 16:09:34.650487] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.817 [2024-10-30 16:09:34.650524] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5b00, cid 0, qid 0 00:25:44.817 [2024-10-30 16:09:34.650535] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5c60, cid 1, qid 0 00:25:44.817 [2024-10-30 16:09:34.650543] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5dc0, cid 2, qid 0 00:25:44.817 [2024-10-30 16:09:34.650551] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:44.817 [2024-10-30 16:09:34.650558] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e6080, cid 4, qid 0 00:25:44.817 [2024-10-30 16:09:34.650699] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.817 [2024-10-30 16:09:34.650714] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.817 [2024-10-30 16:09:34.650721] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650727] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e6080) on tqpair=0x2380420 00:25:44.817 [2024-10-30 16:09:34.650738] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:25:44.817 [2024-10-30 16:09:34.650747] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:25:44.817 [2024-10-30 16:09:34.650764] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650774] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650782] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2380420) 00:25:44.817 [2024-10-30 16:09:34.650793] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.817 [2024-10-30 16:09:34.650814] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e6080, cid 4, qid 0 00:25:44.817 [2024-10-30 16:09:34.650914] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.817 [2024-10-30 16:09:34.650926] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.817 [2024-10-30 16:09:34.650933] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650939] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2380420): datao=0, datal=4096, cccid=4 00:25:44.817 [2024-10-30 16:09:34.650946] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x23e6080) on tqpair(0x2380420): expected_datao=0, payload_size=4096 00:25:44.817 [2024-10-30 16:09:34.650957] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650965] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650976] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.817 [2024-10-30 16:09:34.650986] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.817 [2024-10-30 16:09:34.650992] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.650999] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e6080) on tqpair=0x2380420 00:25:44.817 [2024-10-30 16:09:34.651019] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:25:44.817 [2024-10-30 16:09:34.651060] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.651070] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.651077] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2380420) 00:25:44.817 [2024-10-30 16:09:34.651087] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.817 [2024-10-30 16:09:34.651099] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.651106] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.651112] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2380420) 00:25:44.817 [2024-10-30 16:09:34.651125] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.817 [2024-10-30 16:09:34.651153] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e6080, cid 4, qid 0 00:25:44.817 [2024-10-30 16:09:34.651165] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e61e0, cid 5, qid 0 00:25:44.817 [2024-10-30 16:09:34.651307] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.817 [2024-10-30 16:09:34.651323] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.817 [2024-10-30 16:09:34.651331] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.651337] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2380420): datao=0, datal=1024, cccid=4 00:25:44.817 [2024-10-30 16:09:34.651344] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x23e6080) on tqpair(0x2380420): expected_datao=0, payload_size=1024 00:25:44.817 [2024-10-30 16:09:34.651354] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.651362] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.651370] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.817 [2024-10-30 16:09:34.651379] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.817 [2024-10-30 16:09:34.651385] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.817 [2024-10-30 16:09:34.651392] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e61e0) on tqpair=0x2380420 00:25:45.079 [2024-10-30 16:09:34.695289] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.079 [2024-10-30 16:09:34.695307] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.079 [2024-10-30 16:09:34.695315] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.079 [2024-10-30 16:09:34.695321] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e6080) on tqpair=0x2380420 00:25:45.079 [2024-10-30 16:09:34.695340] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.079 [2024-10-30 16:09:34.695349] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.079 [2024-10-30 16:09:34.695356] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2380420) 00:25:45.079 [2024-10-30 16:09:34.695366] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.079 [2024-10-30 16:09:34.695410] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e6080, cid 4, qid 0 00:25:45.079 [2024-10-30 16:09:34.695538] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:45.079 [2024-10-30 16:09:34.695552] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:45.079 [2024-10-30 16:09:34.695559] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:45.079 [2024-10-30 16:09:34.695566] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2380420): datao=0, datal=3072, cccid=4 00:25:45.079 [2024-10-30 16:09:34.695573] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x23e6080) on tqpair(0x2380420): expected_datao=0, payload_size=3072 00:25:45.079 [2024-10-30 16:09:34.695602] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:45.079 [2024-10-30 16:09:34.695611] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:45.079 [2024-10-30 16:09:34.695650] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.079 [2024-10-30 16:09:34.695663] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.079 [2024-10-30 16:09:34.695670] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.079 [2024-10-30 16:09:34.695677] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e6080) on tqpair=0x2380420 00:25:45.079 [2024-10-30 16:09:34.695693] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.079 [2024-10-30 16:09:34.695701] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.079 [2024-10-30 16:09:34.695707] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2380420) 00:25:45.079 [2024-10-30 16:09:34.695722] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.079 [2024-10-30 16:09:34.695751] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e6080, cid 4, qid 0 00:25:45.079 [2024-10-30 16:09:34.695843] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:45.079 [2024-10-30 16:09:34.695855] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:45.079 [2024-10-30 16:09:34.695862] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:45.079 [2024-10-30 16:09:34.695868] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2380420): datao=0, datal=8, cccid=4 00:25:45.079 [2024-10-30 16:09:34.695875] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x23e6080) on tqpair(0x2380420): expected_datao=0, payload_size=8 00:25:45.079 [2024-10-30 16:09:34.695886] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:45.079 [2024-10-30 16:09:34.695893] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:45.079 [2024-10-30 16:09:34.737273] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.079 [2024-10-30 16:09:34.737317] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.079 [2024-10-30 16:09:34.737325] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.079 [2024-10-30 16:09:34.737332] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e6080) on tqpair=0x2380420 00:25:45.079 ===================================================== 00:25:45.079 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:25:45.079 ===================================================== 00:25:45.079 Controller Capabilities/Features 00:25:45.079 ================================ 00:25:45.079 Vendor ID: 0000 00:25:45.079 Subsystem Vendor ID: 0000 00:25:45.079 Serial Number: .................... 00:25:45.079 Model Number: ........................................ 00:25:45.079 Firmware Version: 24.01.1 00:25:45.079 Recommended Arb Burst: 0 00:25:45.079 IEEE OUI Identifier: 00 00 00 00:25:45.079 Multi-path I/O 00:25:45.079 May have multiple subsystem ports: No 00:25:45.079 May have multiple controllers: No 00:25:45.079 Associated with SR-IOV VF: No 00:25:45.079 Max Data Transfer Size: 131072 00:25:45.079 Max Number of Namespaces: 0 00:25:45.079 Max Number of I/O Queues: 1024 00:25:45.079 NVMe Specification Version (VS): 1.3 00:25:45.079 NVMe Specification Version (Identify): 1.3 00:25:45.079 Maximum Queue Entries: 128 00:25:45.079 Contiguous Queues Required: Yes 00:25:45.079 Arbitration Mechanisms Supported 00:25:45.079 Weighted Round Robin: Not Supported 00:25:45.079 Vendor Specific: Not Supported 00:25:45.079 Reset Timeout: 15000 ms 00:25:45.079 Doorbell Stride: 4 bytes 00:25:45.079 NVM Subsystem Reset: Not Supported 00:25:45.079 Command Sets Supported 00:25:45.079 NVM Command Set: Supported 00:25:45.079 Boot Partition: Not Supported 00:25:45.079 Memory Page Size Minimum: 4096 bytes 00:25:45.079 Memory Page Size Maximum: 4096 bytes 00:25:45.079 Persistent Memory Region: Not Supported 00:25:45.079 Optional Asynchronous Events Supported 00:25:45.079 Namespace Attribute Notices: Not Supported 00:25:45.079 Firmware Activation Notices: Not Supported 00:25:45.079 ANA Change Notices: Not Supported 00:25:45.079 PLE Aggregate Log Change Notices: Not Supported 00:25:45.079 LBA Status Info Alert Notices: Not Supported 00:25:45.079 EGE Aggregate Log Change Notices: Not Supported 00:25:45.079 Normal NVM Subsystem Shutdown event: Not Supported 00:25:45.079 Zone Descriptor Change Notices: Not Supported 00:25:45.079 Discovery Log Change Notices: Supported 00:25:45.079 Controller Attributes 00:25:45.079 128-bit Host Identifier: Not Supported 00:25:45.079 Non-Operational Permissive Mode: Not Supported 00:25:45.079 NVM Sets: Not Supported 00:25:45.079 Read Recovery Levels: Not Supported 00:25:45.079 Endurance Groups: Not Supported 00:25:45.079 Predictable Latency Mode: Not Supported 00:25:45.079 Traffic Based Keep ALive: Not Supported 00:25:45.079 Namespace Granularity: Not Supported 00:25:45.079 SQ Associations: Not Supported 00:25:45.079 UUID List: Not Supported 00:25:45.079 Multi-Domain Subsystem: Not Supported 00:25:45.079 Fixed Capacity Management: Not Supported 00:25:45.079 Variable Capacity Management: Not Supported 00:25:45.079 Delete Endurance Group: Not Supported 00:25:45.079 Delete NVM Set: Not Supported 00:25:45.079 Extended LBA Formats Supported: Not Supported 00:25:45.079 Flexible Data Placement Supported: Not Supported 00:25:45.079 00:25:45.079 Controller Memory Buffer Support 00:25:45.079 ================================ 00:25:45.079 Supported: No 00:25:45.079 00:25:45.079 Persistent Memory Region Support 00:25:45.079 ================================ 00:25:45.079 Supported: No 00:25:45.079 00:25:45.079 Admin Command Set Attributes 00:25:45.079 ============================ 00:25:45.079 Security Send/Receive: Not Supported 00:25:45.079 Format NVM: Not Supported 00:25:45.079 Firmware Activate/Download: Not Supported 00:25:45.079 Namespace Management: Not Supported 00:25:45.079 Device Self-Test: Not Supported 00:25:45.079 Directives: Not Supported 00:25:45.079 NVMe-MI: Not Supported 00:25:45.079 Virtualization Management: Not Supported 00:25:45.079 Doorbell Buffer Config: Not Supported 00:25:45.079 Get LBA Status Capability: Not Supported 00:25:45.079 Command & Feature Lockdown Capability: Not Supported 00:25:45.079 Abort Command Limit: 1 00:25:45.079 Async Event Request Limit: 4 00:25:45.079 Number of Firmware Slots: N/A 00:25:45.079 Firmware Slot 1 Read-Only: N/A 00:25:45.079 Firmware Activation Without Reset: N/A 00:25:45.079 Multiple Update Detection Support: N/A 00:25:45.080 Firmware Update Granularity: No Information Provided 00:25:45.080 Per-Namespace SMART Log: No 00:25:45.080 Asymmetric Namespace Access Log Page: Not Supported 00:25:45.080 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:25:45.080 Command Effects Log Page: Not Supported 00:25:45.080 Get Log Page Extended Data: Supported 00:25:45.080 Telemetry Log Pages: Not Supported 00:25:45.080 Persistent Event Log Pages: Not Supported 00:25:45.080 Supported Log Pages Log Page: May Support 00:25:45.080 Commands Supported & Effects Log Page: Not Supported 00:25:45.080 Feature Identifiers & Effects Log Page:May Support 00:25:45.080 NVMe-MI Commands & Effects Log Page: May Support 00:25:45.080 Data Area 4 for Telemetry Log: Not Supported 00:25:45.080 Error Log Page Entries Supported: 128 00:25:45.080 Keep Alive: Not Supported 00:25:45.080 00:25:45.080 NVM Command Set Attributes 00:25:45.080 ========================== 00:25:45.080 Submission Queue Entry Size 00:25:45.080 Max: 1 00:25:45.080 Min: 1 00:25:45.080 Completion Queue Entry Size 00:25:45.080 Max: 1 00:25:45.080 Min: 1 00:25:45.080 Number of Namespaces: 0 00:25:45.080 Compare Command: Not Supported 00:25:45.080 Write Uncorrectable Command: Not Supported 00:25:45.080 Dataset Management Command: Not Supported 00:25:45.080 Write Zeroes Command: Not Supported 00:25:45.080 Set Features Save Field: Not Supported 00:25:45.080 Reservations: Not Supported 00:25:45.080 Timestamp: Not Supported 00:25:45.080 Copy: Not Supported 00:25:45.080 Volatile Write Cache: Not Present 00:25:45.080 Atomic Write Unit (Normal): 1 00:25:45.080 Atomic Write Unit (PFail): 1 00:25:45.080 Atomic Compare & Write Unit: 1 00:25:45.080 Fused Compare & Write: Supported 00:25:45.080 Scatter-Gather List 00:25:45.080 SGL Command Set: Supported 00:25:45.080 SGL Keyed: Supported 00:25:45.080 SGL Bit Bucket Descriptor: Not Supported 00:25:45.080 SGL Metadata Pointer: Not Supported 00:25:45.080 Oversized SGL: Not Supported 00:25:45.080 SGL Metadata Address: Not Supported 00:25:45.080 SGL Offset: Supported 00:25:45.080 Transport SGL Data Block: Not Supported 00:25:45.080 Replay Protected Memory Block: Not Supported 00:25:45.080 00:25:45.080 Firmware Slot Information 00:25:45.080 ========================= 00:25:45.080 Active slot: 0 00:25:45.080 00:25:45.080 00:25:45.080 Error Log 00:25:45.080 ========= 00:25:45.080 00:25:45.080 Active Namespaces 00:25:45.080 ================= 00:25:45.080 Discovery Log Page 00:25:45.080 ================== 00:25:45.080 Generation Counter: 2 00:25:45.080 Number of Records: 2 00:25:45.080 Record Format: 0 00:25:45.080 00:25:45.080 Discovery Log Entry 0 00:25:45.080 ---------------------- 00:25:45.080 Transport Type: 3 (TCP) 00:25:45.080 Address Family: 1 (IPv4) 00:25:45.080 Subsystem Type: 3 (Current Discovery Subsystem) 00:25:45.080 Entry Flags: 00:25:45.080 Duplicate Returned Information: 1 00:25:45.080 Explicit Persistent Connection Support for Discovery: 1 00:25:45.080 Transport Requirements: 00:25:45.080 Secure Channel: Not Required 00:25:45.080 Port ID: 0 (0x0000) 00:25:45.080 Controller ID: 65535 (0xffff) 00:25:45.080 Admin Max SQ Size: 128 00:25:45.080 Transport Service Identifier: 4420 00:25:45.080 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:25:45.080 Transport Address: 10.0.0.2 00:25:45.080 Discovery Log Entry 1 00:25:45.080 ---------------------- 00:25:45.080 Transport Type: 3 (TCP) 00:25:45.080 Address Family: 1 (IPv4) 00:25:45.080 Subsystem Type: 2 (NVM Subsystem) 00:25:45.080 Entry Flags: 00:25:45.080 Duplicate Returned Information: 0 00:25:45.080 Explicit Persistent Connection Support for Discovery: 0 00:25:45.080 Transport Requirements: 00:25:45.080 Secure Channel: Not Required 00:25:45.080 Port ID: 0 (0x0000) 00:25:45.080 Controller ID: 65535 (0xffff) 00:25:45.080 Admin Max SQ Size: 128 00:25:45.080 Transport Service Identifier: 4420 00:25:45.080 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:25:45.080 Transport Address: 10.0.0.2 [2024-10-30 16:09:34.737456] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:25:45.080 [2024-10-30 16:09:34.737483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.080 [2024-10-30 16:09:34.737496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.080 [2024-10-30 16:09:34.737505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.080 [2024-10-30 16:09:34.737515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.080 [2024-10-30 16:09:34.737529] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.737537] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.737544] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.080 [2024-10-30 16:09:34.737555] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.080 [2024-10-30 16:09:34.737581] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.080 [2024-10-30 16:09:34.737656] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.080 [2024-10-30 16:09:34.737671] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.080 [2024-10-30 16:09:34.737677] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.737684] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.080 [2024-10-30 16:09:34.737697] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.737705] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.737711] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.080 [2024-10-30 16:09:34.737721] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.080 [2024-10-30 16:09:34.737747] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.080 [2024-10-30 16:09:34.737847] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.080 [2024-10-30 16:09:34.737859] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.080 [2024-10-30 16:09:34.737871] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.737878] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.080 [2024-10-30 16:09:34.737889] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:25:45.080 [2024-10-30 16:09:34.737897] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:25:45.080 [2024-10-30 16:09:34.737913] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.737922] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.737928] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.080 [2024-10-30 16:09:34.737939] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.080 [2024-10-30 16:09:34.737959] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.080 [2024-10-30 16:09:34.738049] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.080 [2024-10-30 16:09:34.738062] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.080 [2024-10-30 16:09:34.738068] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.738075] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.080 [2024-10-30 16:09:34.738093] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.738102] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.738109] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.080 [2024-10-30 16:09:34.738119] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.080 [2024-10-30 16:09:34.738139] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.080 [2024-10-30 16:09:34.738211] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.080 [2024-10-30 16:09:34.738222] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.080 [2024-10-30 16:09:34.738229] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.738236] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.080 [2024-10-30 16:09:34.738252] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.738273] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.738280] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.080 [2024-10-30 16:09:34.738290] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.080 [2024-10-30 16:09:34.738311] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.080 [2024-10-30 16:09:34.738391] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.080 [2024-10-30 16:09:34.738404] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.080 [2024-10-30 16:09:34.738411] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.738418] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.080 [2024-10-30 16:09:34.738435] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.738444] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.080 [2024-10-30 16:09:34.738450] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.080 [2024-10-30 16:09:34.738461] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.080 [2024-10-30 16:09:34.738481] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.080 [2024-10-30 16:09:34.738557] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.081 [2024-10-30 16:09:34.738570] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.081 [2024-10-30 16:09:34.738576] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.738583] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.081 [2024-10-30 16:09:34.738600] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.738609] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.738616] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.081 [2024-10-30 16:09:34.738626] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.081 [2024-10-30 16:09:34.738646] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.081 [2024-10-30 16:09:34.738718] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.081 [2024-10-30 16:09:34.738729] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.081 [2024-10-30 16:09:34.738736] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.738742] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.081 [2024-10-30 16:09:34.738759] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.738768] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.738774] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.081 [2024-10-30 16:09:34.738785] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.081 [2024-10-30 16:09:34.738804] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.081 [2024-10-30 16:09:34.738877] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.081 [2024-10-30 16:09:34.738889] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.081 [2024-10-30 16:09:34.738896] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.738902] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.081 [2024-10-30 16:09:34.738919] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.738928] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.738935] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.081 [2024-10-30 16:09:34.738945] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.081 [2024-10-30 16:09:34.738965] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.081 [2024-10-30 16:09:34.739057] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.081 [2024-10-30 16:09:34.739071] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.081 [2024-10-30 16:09:34.739077] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739084] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.081 [2024-10-30 16:09:34.739102] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739112] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739118] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.081 [2024-10-30 16:09:34.739129] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.081 [2024-10-30 16:09:34.739149] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.081 [2024-10-30 16:09:34.739227] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.081 [2024-10-30 16:09:34.739241] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.081 [2024-10-30 16:09:34.739248] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739263] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.081 [2024-10-30 16:09:34.739283] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739293] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739299] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.081 [2024-10-30 16:09:34.739310] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.081 [2024-10-30 16:09:34.739330] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.081 [2024-10-30 16:09:34.739411] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.081 [2024-10-30 16:09:34.739425] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.081 [2024-10-30 16:09:34.739432] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739438] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.081 [2024-10-30 16:09:34.739455] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739464] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739471] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.081 [2024-10-30 16:09:34.739481] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.081 [2024-10-30 16:09:34.739501] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.081 [2024-10-30 16:09:34.739582] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.081 [2024-10-30 16:09:34.739595] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.081 [2024-10-30 16:09:34.739602] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739609] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.081 [2024-10-30 16:09:34.739626] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739635] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739641] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.081 [2024-10-30 16:09:34.739652] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.081 [2024-10-30 16:09:34.739672] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.081 [2024-10-30 16:09:34.739747] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.081 [2024-10-30 16:09:34.739758] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.081 [2024-10-30 16:09:34.739765] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739771] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.081 [2024-10-30 16:09:34.739788] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739797] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739804] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.081 [2024-10-30 16:09:34.739814] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.081 [2024-10-30 16:09:34.739834] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.081 [2024-10-30 16:09:34.739907] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.081 [2024-10-30 16:09:34.739922] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.081 [2024-10-30 16:09:34.739930] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739936] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.081 [2024-10-30 16:09:34.739954] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739962] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.739969] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.081 [2024-10-30 16:09:34.739980] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.081 [2024-10-30 16:09:34.740000] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.081 [2024-10-30 16:09:34.740093] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.081 [2024-10-30 16:09:34.740111] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.081 [2024-10-30 16:09:34.740118] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.740124] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.081 [2024-10-30 16:09:34.740141] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.740150] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.740157] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.081 [2024-10-30 16:09:34.740167] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.081 [2024-10-30 16:09:34.740187] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.081 [2024-10-30 16:09:34.740266] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.081 [2024-10-30 16:09:34.740280] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.081 [2024-10-30 16:09:34.740286] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.740293] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.081 [2024-10-30 16:09:34.740310] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.740319] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.740325] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.081 [2024-10-30 16:09:34.740336] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.081 [2024-10-30 16:09:34.740356] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.081 [2024-10-30 16:09:34.740430] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.081 [2024-10-30 16:09:34.740444] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.081 [2024-10-30 16:09:34.740450] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.740457] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.081 [2024-10-30 16:09:34.740474] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.740483] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.740490] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.081 [2024-10-30 16:09:34.740500] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.081 [2024-10-30 16:09:34.740520] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.081 [2024-10-30 16:09:34.740594] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.081 [2024-10-30 16:09:34.740607] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.081 [2024-10-30 16:09:34.740618] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.081 [2024-10-30 16:09:34.740625] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.081 [2024-10-30 16:09:34.740643] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.740652] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.740658] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.082 [2024-10-30 16:09:34.740669] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.082 [2024-10-30 16:09:34.740689] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.082 [2024-10-30 16:09:34.740766] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.082 [2024-10-30 16:09:34.740781] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.082 [2024-10-30 16:09:34.740788] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.740796] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.082 [2024-10-30 16:09:34.740813] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.740822] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.740829] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.082 [2024-10-30 16:09:34.740840] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.082 [2024-10-30 16:09:34.740860] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.082 [2024-10-30 16:09:34.740936] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.082 [2024-10-30 16:09:34.740949] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.082 [2024-10-30 16:09:34.740956] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.740963] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.082 [2024-10-30 16:09:34.740980] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.740989] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.740995] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.082 [2024-10-30 16:09:34.741006] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.082 [2024-10-30 16:09:34.741026] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.082 [2024-10-30 16:09:34.741103] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.082 [2024-10-30 16:09:34.741117] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.082 [2024-10-30 16:09:34.741123] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.741130] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.082 [2024-10-30 16:09:34.741147] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.741156] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.741163] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.082 [2024-10-30 16:09:34.741173] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.082 [2024-10-30 16:09:34.741193] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.082 [2024-10-30 16:09:34.745268] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.082 [2024-10-30 16:09:34.745286] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.082 [2024-10-30 16:09:34.745293] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.745304] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.082 [2024-10-30 16:09:34.745323] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.745348] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.745355] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2380420) 00:25:45.082 [2024-10-30 16:09:34.745365] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.082 [2024-10-30 16:09:34.745387] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x23e5f20, cid 3, qid 0 00:25:45.082 [2024-10-30 16:09:34.745495] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.082 [2024-10-30 16:09:34.745509] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.082 [2024-10-30 16:09:34.745516] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.745522] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x23e5f20) on tqpair=0x2380420 00:25:45.082 [2024-10-30 16:09:34.745537] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 7 milliseconds 00:25:45.082 00:25:45.082 16:09:34 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:25:45.082 [2024-10-30 16:09:34.777898] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:25:45.082 [2024-10-30 16:09:34.777943] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2504492 ] 00:25:45.082 EAL: No free 2048 kB hugepages reported on node 1 00:25:45.082 [2024-10-30 16:09:34.811017] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:25:45.082 [2024-10-30 16:09:34.811063] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:45.082 [2024-10-30 16:09:34.811073] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:45.082 [2024-10-30 16:09:34.811091] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:45.082 [2024-10-30 16:09:34.811102] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:45.082 [2024-10-30 16:09:34.814306] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:25:45.082 [2024-10-30 16:09:34.814362] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x857420 0 00:25:45.082 [2024-10-30 16:09:34.822286] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:45.082 [2024-10-30 16:09:34.822304] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:45.082 [2024-10-30 16:09:34.822312] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:45.082 [2024-10-30 16:09:34.822318] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:45.082 [2024-10-30 16:09:34.822354] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.822366] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.822373] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857420) 00:25:45.082 [2024-10-30 16:09:34.822386] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:45.082 [2024-10-30 16:09:34.822411] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcb00, cid 0, qid 0 00:25:45.082 [2024-10-30 16:09:34.830268] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.082 [2024-10-30 16:09:34.830286] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.082 [2024-10-30 16:09:34.830294] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.830301] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcb00) on tqpair=0x857420 00:25:45.082 [2024-10-30 16:09:34.830314] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:45.082 [2024-10-30 16:09:34.830325] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:25:45.082 [2024-10-30 16:09:34.830333] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:25:45.082 [2024-10-30 16:09:34.830350] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.830359] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.830365] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857420) 00:25:45.082 [2024-10-30 16:09:34.830376] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.082 [2024-10-30 16:09:34.830399] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcb00, cid 0, qid 0 00:25:45.082 [2024-10-30 16:09:34.830527] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.082 [2024-10-30 16:09:34.830539] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.082 [2024-10-30 16:09:34.830546] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.830553] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcb00) on tqpair=0x857420 00:25:45.082 [2024-10-30 16:09:34.830561] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:25:45.082 [2024-10-30 16:09:34.830575] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:25:45.082 [2024-10-30 16:09:34.830587] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.830594] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.830601] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857420) 00:25:45.082 [2024-10-30 16:09:34.830611] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.082 [2024-10-30 16:09:34.830632] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcb00, cid 0, qid 0 00:25:45.082 [2024-10-30 16:09:34.830726] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.082 [2024-10-30 16:09:34.830738] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.082 [2024-10-30 16:09:34.830745] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.830752] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcb00) on tqpair=0x857420 00:25:45.082 [2024-10-30 16:09:34.830760] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:25:45.082 [2024-10-30 16:09:34.830773] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:25:45.082 [2024-10-30 16:09:34.830785] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.830793] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.830799] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857420) 00:25:45.082 [2024-10-30 16:09:34.830809] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.082 [2024-10-30 16:09:34.830830] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcb00, cid 0, qid 0 00:25:45.082 [2024-10-30 16:09:34.830914] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.082 [2024-10-30 16:09:34.830932] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.082 [2024-10-30 16:09:34.830940] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.082 [2024-10-30 16:09:34.830947] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcb00) on tqpair=0x857420 00:25:45.082 [2024-10-30 16:09:34.830956] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:45.082 [2024-10-30 16:09:34.830973] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.830982] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.830988] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857420) 00:25:45.083 [2024-10-30 16:09:34.830998] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.083 [2024-10-30 16:09:34.831019] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcb00, cid 0, qid 0 00:25:45.083 [2024-10-30 16:09:34.831113] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.083 [2024-10-30 16:09:34.831125] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.083 [2024-10-30 16:09:34.831132] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.831138] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcb00) on tqpair=0x857420 00:25:45.083 [2024-10-30 16:09:34.831146] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:25:45.083 [2024-10-30 16:09:34.831154] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:25:45.083 [2024-10-30 16:09:34.831166] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:45.083 [2024-10-30 16:09:34.831276] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:25:45.083 [2024-10-30 16:09:34.831285] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:45.083 [2024-10-30 16:09:34.831297] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.831304] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.831311] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857420) 00:25:45.083 [2024-10-30 16:09:34.831321] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.083 [2024-10-30 16:09:34.831342] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcb00, cid 0, qid 0 00:25:45.083 [2024-10-30 16:09:34.831461] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.083 [2024-10-30 16:09:34.831475] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.083 [2024-10-30 16:09:34.831482] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.831489] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcb00) on tqpair=0x857420 00:25:45.083 [2024-10-30 16:09:34.831497] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:45.083 [2024-10-30 16:09:34.831514] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.831523] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.831529] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857420) 00:25:45.083 [2024-10-30 16:09:34.831539] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.083 [2024-10-30 16:09:34.831560] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcb00, cid 0, qid 0 00:25:45.083 [2024-10-30 16:09:34.831639] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.083 [2024-10-30 16:09:34.831656] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.083 [2024-10-30 16:09:34.831664] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.831671] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcb00) on tqpair=0x857420 00:25:45.083 [2024-10-30 16:09:34.831678] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:45.083 [2024-10-30 16:09:34.831687] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:25:45.083 [2024-10-30 16:09:34.831700] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:25:45.083 [2024-10-30 16:09:34.831714] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:25:45.083 [2024-10-30 16:09:34.831727] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.831734] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.831741] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857420) 00:25:45.083 [2024-10-30 16:09:34.831751] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.083 [2024-10-30 16:09:34.831772] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcb00, cid 0, qid 0 00:25:45.083 [2024-10-30 16:09:34.831899] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:45.083 [2024-10-30 16:09:34.831914] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:45.083 [2024-10-30 16:09:34.831921] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.831927] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x857420): datao=0, datal=4096, cccid=0 00:25:45.083 [2024-10-30 16:09:34.831935] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x8bcb00) on tqpair(0x857420): expected_datao=0, payload_size=4096 00:25:45.083 [2024-10-30 16:09:34.831953] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.831962] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.872385] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.083 [2024-10-30 16:09:34.872403] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.083 [2024-10-30 16:09:34.872411] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.872418] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcb00) on tqpair=0x857420 00:25:45.083 [2024-10-30 16:09:34.872429] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:25:45.083 [2024-10-30 16:09:34.872438] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:25:45.083 [2024-10-30 16:09:34.872446] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:25:45.083 [2024-10-30 16:09:34.872452] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:25:45.083 [2024-10-30 16:09:34.872459] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:25:45.083 [2024-10-30 16:09:34.872467] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:25:45.083 [2024-10-30 16:09:34.872486] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:25:45.083 [2024-10-30 16:09:34.872500] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.872507] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.872514] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857420) 00:25:45.083 [2024-10-30 16:09:34.872529] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:45.083 [2024-10-30 16:09:34.872553] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcb00, cid 0, qid 0 00:25:45.083 [2024-10-30 16:09:34.872631] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.083 [2024-10-30 16:09:34.872646] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.083 [2024-10-30 16:09:34.872653] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.872659] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcb00) on tqpair=0x857420 00:25:45.083 [2024-10-30 16:09:34.872670] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.872677] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.872684] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x857420) 00:25:45.083 [2024-10-30 16:09:34.872694] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.083 [2024-10-30 16:09:34.872704] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.872710] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.872717] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x857420) 00:25:45.083 [2024-10-30 16:09:34.872725] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.083 [2024-10-30 16:09:34.872735] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.872742] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.872748] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x857420) 00:25:45.083 [2024-10-30 16:09:34.872756] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.083 [2024-10-30 16:09:34.872766] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.872772] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.083 [2024-10-30 16:09:34.872779] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.083 [2024-10-30 16:09:34.872787] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.083 [2024-10-30 16:09:34.872796] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:25:45.084 [2024-10-30 16:09:34.872814] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:45.084 [2024-10-30 16:09:34.872827] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.872849] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.872855] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x857420) 00:25:45.084 [2024-10-30 16:09:34.872865] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.084 [2024-10-30 16:09:34.872888] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcb00, cid 0, qid 0 00:25:45.084 [2024-10-30 16:09:34.872914] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcc60, cid 1, qid 0 00:25:45.084 [2024-10-30 16:09:34.872923] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcdc0, cid 2, qid 0 00:25:45.084 [2024-10-30 16:09:34.872931] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.084 [2024-10-30 16:09:34.872938] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd080, cid 4, qid 0 00:25:45.084 [2024-10-30 16:09:34.873086] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.084 [2024-10-30 16:09:34.873100] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.084 [2024-10-30 16:09:34.873107] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.873114] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd080) on tqpair=0x857420 00:25:45.084 [2024-10-30 16:09:34.873122] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:25:45.084 [2024-10-30 16:09:34.873130] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:25:45.084 [2024-10-30 16:09:34.873144] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:25:45.084 [2024-10-30 16:09:34.873160] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:25:45.084 [2024-10-30 16:09:34.873172] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.873179] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.873185] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x857420) 00:25:45.084 [2024-10-30 16:09:34.873196] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:45.084 [2024-10-30 16:09:34.873232] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd080, cid 4, qid 0 00:25:45.084 [2024-10-30 16:09:34.873401] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.084 [2024-10-30 16:09:34.873416] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.084 [2024-10-30 16:09:34.873423] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.873430] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd080) on tqpair=0x857420 00:25:45.084 [2024-10-30 16:09:34.873495] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:25:45.084 [2024-10-30 16:09:34.873513] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:25:45.084 [2024-10-30 16:09:34.873527] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.873535] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.873541] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x857420) 00:25:45.084 [2024-10-30 16:09:34.873552] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.084 [2024-10-30 16:09:34.873573] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd080, cid 4, qid 0 00:25:45.084 [2024-10-30 16:09:34.873714] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:45.084 [2024-10-30 16:09:34.873729] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:45.084 [2024-10-30 16:09:34.873736] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.873742] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x857420): datao=0, datal=4096, cccid=4 00:25:45.084 [2024-10-30 16:09:34.873749] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x8bd080) on tqpair(0x857420): expected_datao=0, payload_size=4096 00:25:45.084 [2024-10-30 16:09:34.873767] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.873776] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.918272] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.084 [2024-10-30 16:09:34.918291] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.084 [2024-10-30 16:09:34.918299] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.918311] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd080) on tqpair=0x857420 00:25:45.084 [2024-10-30 16:09:34.918333] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:25:45.084 [2024-10-30 16:09:34.918350] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:25:45.084 [2024-10-30 16:09:34.918369] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:25:45.084 [2024-10-30 16:09:34.918383] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.918390] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.918397] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x857420) 00:25:45.084 [2024-10-30 16:09:34.918408] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.084 [2024-10-30 16:09:34.918431] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd080, cid 4, qid 0 00:25:45.084 [2024-10-30 16:09:34.918580] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:45.084 [2024-10-30 16:09:34.918595] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:45.084 [2024-10-30 16:09:34.918602] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.918608] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x857420): datao=0, datal=4096, cccid=4 00:25:45.084 [2024-10-30 16:09:34.918616] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x8bd080) on tqpair(0x857420): expected_datao=0, payload_size=4096 00:25:45.084 [2024-10-30 16:09:34.918635] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:45.084 [2024-10-30 16:09:34.918644] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:34.960398] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.345 [2024-10-30 16:09:34.960417] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.345 [2024-10-30 16:09:34.960424] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:34.960431] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd080) on tqpair=0x857420 00:25:45.345 [2024-10-30 16:09:34.960457] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:25:45.345 [2024-10-30 16:09:34.960477] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:25:45.345 [2024-10-30 16:09:34.960491] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:34.960499] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:34.960505] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x857420) 00:25:45.345 [2024-10-30 16:09:34.960516] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.345 [2024-10-30 16:09:34.960540] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd080, cid 4, qid 0 00:25:45.345 [2024-10-30 16:09:34.960641] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:45.345 [2024-10-30 16:09:34.960656] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:45.345 [2024-10-30 16:09:34.960663] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:34.960669] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x857420): datao=0, datal=4096, cccid=4 00:25:45.345 [2024-10-30 16:09:34.960676] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x8bd080) on tqpair(0x857420): expected_datao=0, payload_size=4096 00:25:45.345 [2024-10-30 16:09:34.960694] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:34.960703] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.001410] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.345 [2024-10-30 16:09:35.001430] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.345 [2024-10-30 16:09:35.001438] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.001444] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd080) on tqpair=0x857420 00:25:45.345 [2024-10-30 16:09:35.001458] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:25:45.345 [2024-10-30 16:09:35.001474] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:25:45.345 [2024-10-30 16:09:35.001491] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:25:45.345 [2024-10-30 16:09:35.001502] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:25:45.345 [2024-10-30 16:09:35.001511] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:25:45.345 [2024-10-30 16:09:35.001519] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:25:45.345 [2024-10-30 16:09:35.001527] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:25:45.345 [2024-10-30 16:09:35.001536] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:25:45.345 [2024-10-30 16:09:35.001559] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.001568] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.001575] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x857420) 00:25:45.345 [2024-10-30 16:09:35.001585] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.345 [2024-10-30 16:09:35.001597] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.001604] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.001610] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x857420) 00:25:45.345 [2024-10-30 16:09:35.001619] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:45.345 [2024-10-30 16:09:35.001646] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd080, cid 4, qid 0 00:25:45.345 [2024-10-30 16:09:35.001658] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd1e0, cid 5, qid 0 00:25:45.345 [2024-10-30 16:09:35.001754] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.345 [2024-10-30 16:09:35.001766] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.345 [2024-10-30 16:09:35.001773] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.001780] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd080) on tqpair=0x857420 00:25:45.345 [2024-10-30 16:09:35.001790] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.345 [2024-10-30 16:09:35.001799] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.345 [2024-10-30 16:09:35.001806] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.001812] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd1e0) on tqpair=0x857420 00:25:45.345 [2024-10-30 16:09:35.001827] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.001836] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.001843] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x857420) 00:25:45.345 [2024-10-30 16:09:35.001857] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.345 [2024-10-30 16:09:35.001880] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd1e0, cid 5, qid 0 00:25:45.345 [2024-10-30 16:09:35.001969] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.345 [2024-10-30 16:09:35.001983] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.345 [2024-10-30 16:09:35.001990] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.001996] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd1e0) on tqpair=0x857420 00:25:45.345 [2024-10-30 16:09:35.002012] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.002021] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.002028] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x857420) 00:25:45.345 [2024-10-30 16:09:35.002038] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.345 [2024-10-30 16:09:35.002059] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd1e0, cid 5, qid 0 00:25:45.345 [2024-10-30 16:09:35.002152] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.345 [2024-10-30 16:09:35.002164] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.345 [2024-10-30 16:09:35.002171] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.002177] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd1e0) on tqpair=0x857420 00:25:45.345 [2024-10-30 16:09:35.002192] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.002201] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.002208] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x857420) 00:25:45.345 [2024-10-30 16:09:35.002218] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.345 [2024-10-30 16:09:35.002248] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd1e0, cid 5, qid 0 00:25:45.345 [2024-10-30 16:09:35.006274] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.345 [2024-10-30 16:09:35.006289] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.345 [2024-10-30 16:09:35.006296] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.006302] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd1e0) on tqpair=0x857420 00:25:45.345 [2024-10-30 16:09:35.006323] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.006333] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.006340] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x857420) 00:25:45.345 [2024-10-30 16:09:35.006350] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.345 [2024-10-30 16:09:35.006362] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.006370] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.006376] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x857420) 00:25:45.345 [2024-10-30 16:09:35.006385] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.345 [2024-10-30 16:09:35.006411] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.006419] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.345 [2024-10-30 16:09:35.006425] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x857420) 00:25:45.345 [2024-10-30 16:09:35.006434] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.346 [2024-10-30 16:09:35.006450] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006458] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006464] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x857420) 00:25:45.346 [2024-10-30 16:09:35.006473] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.346 [2024-10-30 16:09:35.006496] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd1e0, cid 5, qid 0 00:25:45.346 [2024-10-30 16:09:35.006522] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd080, cid 4, qid 0 00:25:45.346 [2024-10-30 16:09:35.006530] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd340, cid 6, qid 0 00:25:45.346 [2024-10-30 16:09:35.006537] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd4a0, cid 7, qid 0 00:25:45.346 [2024-10-30 16:09:35.006719] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:45.346 [2024-10-30 16:09:35.006731] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:45.346 [2024-10-30 16:09:35.006738] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006745] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x857420): datao=0, datal=8192, cccid=5 00:25:45.346 [2024-10-30 16:09:35.006752] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x8bd1e0) on tqpair(0x857420): expected_datao=0, payload_size=8192 00:25:45.346 [2024-10-30 16:09:35.006770] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006780] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006792] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:45.346 [2024-10-30 16:09:35.006802] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:45.346 [2024-10-30 16:09:35.006809] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006815] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x857420): datao=0, datal=512, cccid=4 00:25:45.346 [2024-10-30 16:09:35.006822] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x8bd080) on tqpair(0x857420): expected_datao=0, payload_size=512 00:25:45.346 [2024-10-30 16:09:35.006832] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006839] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006847] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:45.346 [2024-10-30 16:09:35.006856] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:45.346 [2024-10-30 16:09:35.006862] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006868] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x857420): datao=0, datal=512, cccid=6 00:25:45.346 [2024-10-30 16:09:35.006876] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x8bd340) on tqpair(0x857420): expected_datao=0, payload_size=512 00:25:45.346 [2024-10-30 16:09:35.006885] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006892] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006900] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:45.346 [2024-10-30 16:09:35.006909] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:45.346 [2024-10-30 16:09:35.006916] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006922] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x857420): datao=0, datal=4096, cccid=7 00:25:45.346 [2024-10-30 16:09:35.006929] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x8bd4a0) on tqpair(0x857420): expected_datao=0, payload_size=4096 00:25:45.346 [2024-10-30 16:09:35.006939] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006950] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006962] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.346 [2024-10-30 16:09:35.006971] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.346 [2024-10-30 16:09:35.006978] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.006984] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd1e0) on tqpair=0x857420 00:25:45.346 [2024-10-30 16:09:35.007004] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.346 [2024-10-30 16:09:35.007016] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.346 [2024-10-30 16:09:35.007038] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.007044] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd080) on tqpair=0x857420 00:25:45.346 [2024-10-30 16:09:35.007058] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.346 [2024-10-30 16:09:35.007069] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.346 [2024-10-30 16:09:35.007075] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.007081] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd340) on tqpair=0x857420 00:25:45.346 [2024-10-30 16:09:35.007106] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.346 [2024-10-30 16:09:35.007115] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.346 [2024-10-30 16:09:35.007121] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.346 [2024-10-30 16:09:35.007127] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd4a0) on tqpair=0x857420 00:25:45.346 ===================================================== 00:25:45.346 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:45.346 ===================================================== 00:25:45.346 Controller Capabilities/Features 00:25:45.346 ================================ 00:25:45.346 Vendor ID: 8086 00:25:45.346 Subsystem Vendor ID: 8086 00:25:45.346 Serial Number: SPDK00000000000001 00:25:45.346 Model Number: SPDK bdev Controller 00:25:45.346 Firmware Version: 24.01.1 00:25:45.346 Recommended Arb Burst: 6 00:25:45.346 IEEE OUI Identifier: e4 d2 5c 00:25:45.346 Multi-path I/O 00:25:45.346 May have multiple subsystem ports: Yes 00:25:45.346 May have multiple controllers: Yes 00:25:45.346 Associated with SR-IOV VF: No 00:25:45.346 Max Data Transfer Size: 131072 00:25:45.346 Max Number of Namespaces: 32 00:25:45.346 Max Number of I/O Queues: 127 00:25:45.346 NVMe Specification Version (VS): 1.3 00:25:45.346 NVMe Specification Version (Identify): 1.3 00:25:45.346 Maximum Queue Entries: 128 00:25:45.346 Contiguous Queues Required: Yes 00:25:45.346 Arbitration Mechanisms Supported 00:25:45.346 Weighted Round Robin: Not Supported 00:25:45.346 Vendor Specific: Not Supported 00:25:45.346 Reset Timeout: 15000 ms 00:25:45.346 Doorbell Stride: 4 bytes 00:25:45.346 NVM Subsystem Reset: Not Supported 00:25:45.346 Command Sets Supported 00:25:45.346 NVM Command Set: Supported 00:25:45.346 Boot Partition: Not Supported 00:25:45.346 Memory Page Size Minimum: 4096 bytes 00:25:45.346 Memory Page Size Maximum: 4096 bytes 00:25:45.346 Persistent Memory Region: Not Supported 00:25:45.346 Optional Asynchronous Events Supported 00:25:45.346 Namespace Attribute Notices: Supported 00:25:45.346 Firmware Activation Notices: Not Supported 00:25:45.346 ANA Change Notices: Not Supported 00:25:45.346 PLE Aggregate Log Change Notices: Not Supported 00:25:45.346 LBA Status Info Alert Notices: Not Supported 00:25:45.346 EGE Aggregate Log Change Notices: Not Supported 00:25:45.346 Normal NVM Subsystem Shutdown event: Not Supported 00:25:45.346 Zone Descriptor Change Notices: Not Supported 00:25:45.346 Discovery Log Change Notices: Not Supported 00:25:45.346 Controller Attributes 00:25:45.346 128-bit Host Identifier: Supported 00:25:45.346 Non-Operational Permissive Mode: Not Supported 00:25:45.346 NVM Sets: Not Supported 00:25:45.346 Read Recovery Levels: Not Supported 00:25:45.346 Endurance Groups: Not Supported 00:25:45.346 Predictable Latency Mode: Not Supported 00:25:45.346 Traffic Based Keep ALive: Not Supported 00:25:45.346 Namespace Granularity: Not Supported 00:25:45.346 SQ Associations: Not Supported 00:25:45.346 UUID List: Not Supported 00:25:45.346 Multi-Domain Subsystem: Not Supported 00:25:45.346 Fixed Capacity Management: Not Supported 00:25:45.346 Variable Capacity Management: Not Supported 00:25:45.346 Delete Endurance Group: Not Supported 00:25:45.346 Delete NVM Set: Not Supported 00:25:45.346 Extended LBA Formats Supported: Not Supported 00:25:45.346 Flexible Data Placement Supported: Not Supported 00:25:45.346 00:25:45.346 Controller Memory Buffer Support 00:25:45.346 ================================ 00:25:45.346 Supported: No 00:25:45.346 00:25:45.346 Persistent Memory Region Support 00:25:45.346 ================================ 00:25:45.346 Supported: No 00:25:45.346 00:25:45.346 Admin Command Set Attributes 00:25:45.346 ============================ 00:25:45.346 Security Send/Receive: Not Supported 00:25:45.346 Format NVM: Not Supported 00:25:45.346 Firmware Activate/Download: Not Supported 00:25:45.346 Namespace Management: Not Supported 00:25:45.346 Device Self-Test: Not Supported 00:25:45.346 Directives: Not Supported 00:25:45.346 NVMe-MI: Not Supported 00:25:45.346 Virtualization Management: Not Supported 00:25:45.346 Doorbell Buffer Config: Not Supported 00:25:45.346 Get LBA Status Capability: Not Supported 00:25:45.346 Command & Feature Lockdown Capability: Not Supported 00:25:45.346 Abort Command Limit: 4 00:25:45.346 Async Event Request Limit: 4 00:25:45.346 Number of Firmware Slots: N/A 00:25:45.346 Firmware Slot 1 Read-Only: N/A 00:25:45.346 Firmware Activation Without Reset: N/A 00:25:45.346 Multiple Update Detection Support: N/A 00:25:45.346 Firmware Update Granularity: No Information Provided 00:25:45.346 Per-Namespace SMART Log: No 00:25:45.346 Asymmetric Namespace Access Log Page: Not Supported 00:25:45.346 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:25:45.346 Command Effects Log Page: Supported 00:25:45.346 Get Log Page Extended Data: Supported 00:25:45.346 Telemetry Log Pages: Not Supported 00:25:45.346 Persistent Event Log Pages: Not Supported 00:25:45.346 Supported Log Pages Log Page: May Support 00:25:45.346 Commands Supported & Effects Log Page: Not Supported 00:25:45.346 Feature Identifiers & Effects Log Page:May Support 00:25:45.346 NVMe-MI Commands & Effects Log Page: May Support 00:25:45.346 Data Area 4 for Telemetry Log: Not Supported 00:25:45.346 Error Log Page Entries Supported: 128 00:25:45.347 Keep Alive: Supported 00:25:45.347 Keep Alive Granularity: 10000 ms 00:25:45.347 00:25:45.347 NVM Command Set Attributes 00:25:45.347 ========================== 00:25:45.347 Submission Queue Entry Size 00:25:45.347 Max: 64 00:25:45.347 Min: 64 00:25:45.347 Completion Queue Entry Size 00:25:45.347 Max: 16 00:25:45.347 Min: 16 00:25:45.347 Number of Namespaces: 32 00:25:45.347 Compare Command: Supported 00:25:45.347 Write Uncorrectable Command: Not Supported 00:25:45.347 Dataset Management Command: Supported 00:25:45.347 Write Zeroes Command: Supported 00:25:45.347 Set Features Save Field: Not Supported 00:25:45.347 Reservations: Supported 00:25:45.347 Timestamp: Not Supported 00:25:45.347 Copy: Supported 00:25:45.347 Volatile Write Cache: Present 00:25:45.347 Atomic Write Unit (Normal): 1 00:25:45.347 Atomic Write Unit (PFail): 1 00:25:45.347 Atomic Compare & Write Unit: 1 00:25:45.347 Fused Compare & Write: Supported 00:25:45.347 Scatter-Gather List 00:25:45.347 SGL Command Set: Supported 00:25:45.347 SGL Keyed: Supported 00:25:45.347 SGL Bit Bucket Descriptor: Not Supported 00:25:45.347 SGL Metadata Pointer: Not Supported 00:25:45.347 Oversized SGL: Not Supported 00:25:45.347 SGL Metadata Address: Not Supported 00:25:45.347 SGL Offset: Supported 00:25:45.347 Transport SGL Data Block: Not Supported 00:25:45.347 Replay Protected Memory Block: Not Supported 00:25:45.347 00:25:45.347 Firmware Slot Information 00:25:45.347 ========================= 00:25:45.347 Active slot: 1 00:25:45.347 Slot 1 Firmware Revision: 24.01.1 00:25:45.347 00:25:45.347 00:25:45.347 Commands Supported and Effects 00:25:45.347 ============================== 00:25:45.347 Admin Commands 00:25:45.347 -------------- 00:25:45.347 Get Log Page (02h): Supported 00:25:45.347 Identify (06h): Supported 00:25:45.347 Abort (08h): Supported 00:25:45.347 Set Features (09h): Supported 00:25:45.347 Get Features (0Ah): Supported 00:25:45.347 Asynchronous Event Request (0Ch): Supported 00:25:45.347 Keep Alive (18h): Supported 00:25:45.347 I/O Commands 00:25:45.347 ------------ 00:25:45.347 Flush (00h): Supported LBA-Change 00:25:45.347 Write (01h): Supported LBA-Change 00:25:45.347 Read (02h): Supported 00:25:45.347 Compare (05h): Supported 00:25:45.347 Write Zeroes (08h): Supported LBA-Change 00:25:45.347 Dataset Management (09h): Supported LBA-Change 00:25:45.347 Copy (19h): Supported LBA-Change 00:25:45.347 Unknown (79h): Supported LBA-Change 00:25:45.347 Unknown (7Ah): Supported 00:25:45.347 00:25:45.347 Error Log 00:25:45.347 ========= 00:25:45.347 00:25:45.347 Arbitration 00:25:45.347 =========== 00:25:45.347 Arbitration Burst: 1 00:25:45.347 00:25:45.347 Power Management 00:25:45.347 ================ 00:25:45.347 Number of Power States: 1 00:25:45.347 Current Power State: Power State #0 00:25:45.347 Power State #0: 00:25:45.347 Max Power: 0.00 W 00:25:45.347 Non-Operational State: Operational 00:25:45.347 Entry Latency: Not Reported 00:25:45.347 Exit Latency: Not Reported 00:25:45.347 Relative Read Throughput: 0 00:25:45.347 Relative Read Latency: 0 00:25:45.347 Relative Write Throughput: 0 00:25:45.347 Relative Write Latency: 0 00:25:45.347 Idle Power: Not Reported 00:25:45.347 Active Power: Not Reported 00:25:45.347 Non-Operational Permissive Mode: Not Supported 00:25:45.347 00:25:45.347 Health Information 00:25:45.347 ================== 00:25:45.347 Critical Warnings: 00:25:45.347 Available Spare Space: OK 00:25:45.347 Temperature: OK 00:25:45.347 Device Reliability: OK 00:25:45.347 Read Only: No 00:25:45.347 Volatile Memory Backup: OK 00:25:45.347 Current Temperature: 0 Kelvin (-273 Celsius) 00:25:45.347 Temperature Threshold: [2024-10-30 16:09:35.007274] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.007287] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.007294] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x857420) 00:25:45.347 [2024-10-30 16:09:35.007305] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.347 [2024-10-30 16:09:35.007327] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bd4a0, cid 7, qid 0 00:25:45.347 [2024-10-30 16:09:35.007455] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.347 [2024-10-30 16:09:35.007470] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.347 [2024-10-30 16:09:35.007477] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.007483] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bd4a0) on tqpair=0x857420 00:25:45.347 [2024-10-30 16:09:35.007524] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:25:45.347 [2024-10-30 16:09:35.007555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.347 [2024-10-30 16:09:35.007567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.347 [2024-10-30 16:09:35.007577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.347 [2024-10-30 16:09:35.007587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:45.347 [2024-10-30 16:09:35.007599] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.007607] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.007614] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.347 [2024-10-30 16:09:35.007624] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.347 [2024-10-30 16:09:35.007661] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.347 [2024-10-30 16:09:35.007815] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.347 [2024-10-30 16:09:35.007829] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.347 [2024-10-30 16:09:35.007835] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.007842] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.347 [2024-10-30 16:09:35.007853] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.007861] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.007867] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.347 [2024-10-30 16:09:35.007877] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.347 [2024-10-30 16:09:35.007903] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.347 [2024-10-30 16:09:35.007999] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.347 [2024-10-30 16:09:35.008013] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.347 [2024-10-30 16:09:35.008020] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.008026] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.347 [2024-10-30 16:09:35.008034] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:25:45.347 [2024-10-30 16:09:35.008042] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:25:45.347 [2024-10-30 16:09:35.008058] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.008067] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.008073] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.347 [2024-10-30 16:09:35.008084] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.347 [2024-10-30 16:09:35.008104] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.347 [2024-10-30 16:09:35.008185] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.347 [2024-10-30 16:09:35.008199] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.347 [2024-10-30 16:09:35.008206] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.008213] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.347 [2024-10-30 16:09:35.008229] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.008238] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.008245] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.347 [2024-10-30 16:09:35.008263] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.347 [2024-10-30 16:09:35.008285] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.347 [2024-10-30 16:09:35.008369] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.347 [2024-10-30 16:09:35.008381] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.347 [2024-10-30 16:09:35.008388] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.008394] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.347 [2024-10-30 16:09:35.008410] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.008419] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.008426] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.347 [2024-10-30 16:09:35.008436] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.347 [2024-10-30 16:09:35.008460] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.347 [2024-10-30 16:09:35.008558] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.347 [2024-10-30 16:09:35.008570] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.347 [2024-10-30 16:09:35.008577] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.008583] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.347 [2024-10-30 16:09:35.008599] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.347 [2024-10-30 16:09:35.008609] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.008615] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.348 [2024-10-30 16:09:35.008626] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.348 [2024-10-30 16:09:35.008646] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.348 [2024-10-30 16:09:35.008732] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.348 [2024-10-30 16:09:35.008746] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.348 [2024-10-30 16:09:35.008753] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.008759] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.348 [2024-10-30 16:09:35.008776] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.008785] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.008791] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.348 [2024-10-30 16:09:35.008802] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.348 [2024-10-30 16:09:35.008822] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.348 [2024-10-30 16:09:35.008914] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.348 [2024-10-30 16:09:35.008928] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.348 [2024-10-30 16:09:35.008935] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.008941] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.348 [2024-10-30 16:09:35.008957] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.008967] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.008973] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.348 [2024-10-30 16:09:35.008983] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.348 [2024-10-30 16:09:35.009004] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.348 [2024-10-30 16:09:35.009096] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.348 [2024-10-30 16:09:35.009108] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.348 [2024-10-30 16:09:35.009115] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009121] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.348 [2024-10-30 16:09:35.009137] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009146] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009153] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.348 [2024-10-30 16:09:35.009163] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.348 [2024-10-30 16:09:35.009187] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.348 [2024-10-30 16:09:35.009282] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.348 [2024-10-30 16:09:35.009296] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.348 [2024-10-30 16:09:35.009303] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009309] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.348 [2024-10-30 16:09:35.009325] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009334] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009341] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.348 [2024-10-30 16:09:35.009351] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.348 [2024-10-30 16:09:35.009372] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.348 [2024-10-30 16:09:35.009459] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.348 [2024-10-30 16:09:35.009472] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.348 [2024-10-30 16:09:35.009479] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009486] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.348 [2024-10-30 16:09:35.009502] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009511] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009518] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.348 [2024-10-30 16:09:35.009528] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.348 [2024-10-30 16:09:35.009548] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.348 [2024-10-30 16:09:35.009633] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.348 [2024-10-30 16:09:35.009646] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.348 [2024-10-30 16:09:35.009653] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009660] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.348 [2024-10-30 16:09:35.009676] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009685] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009692] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.348 [2024-10-30 16:09:35.009702] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.348 [2024-10-30 16:09:35.009723] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.348 [2024-10-30 16:09:35.009801] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.348 [2024-10-30 16:09:35.009813] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.348 [2024-10-30 16:09:35.009820] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009826] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.348 [2024-10-30 16:09:35.009842] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009851] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009858] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.348 [2024-10-30 16:09:35.009868] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.348 [2024-10-30 16:09:35.009888] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.348 [2024-10-30 16:09:35.009966] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.348 [2024-10-30 16:09:35.009978] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.348 [2024-10-30 16:09:35.009985] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.009992] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.348 [2024-10-30 16:09:35.010008] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.010017] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.010023] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.348 [2024-10-30 16:09:35.010034] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.348 [2024-10-30 16:09:35.010054] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.348 [2024-10-30 16:09:35.010134] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.348 [2024-10-30 16:09:35.010148] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.348 [2024-10-30 16:09:35.010155] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.010161] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.348 [2024-10-30 16:09:35.010178] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.010187] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.010193] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.348 [2024-10-30 16:09:35.010204] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.348 [2024-10-30 16:09:35.010224] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.348 [2024-10-30 16:09:35.014271] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.348 [2024-10-30 16:09:35.014297] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.348 [2024-10-30 16:09:35.014304] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.014311] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.348 [2024-10-30 16:09:35.014328] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.014338] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.014344] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x857420) 00:25:45.348 [2024-10-30 16:09:35.014354] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:45.348 [2024-10-30 16:09:35.014376] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x8bcf20, cid 3, qid 0 00:25:45.348 [2024-10-30 16:09:35.014501] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:45.348 [2024-10-30 16:09:35.014515] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:45.348 [2024-10-30 16:09:35.014522] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:45.348 [2024-10-30 16:09:35.014529] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x8bcf20) on tqpair=0x857420 00:25:45.348 [2024-10-30 16:09:35.014541] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 6 milliseconds 00:25:45.348 0 Kelvin (-273 Celsius) 00:25:45.348 Available Spare: 0% 00:25:45.348 Available Spare Threshold: 0% 00:25:45.348 Life Percentage Used: 0% 00:25:45.348 Data Units Read: 0 00:25:45.348 Data Units Written: 0 00:25:45.348 Host Read Commands: 0 00:25:45.348 Host Write Commands: 0 00:25:45.348 Controller Busy Time: 0 minutes 00:25:45.348 Power Cycles: 0 00:25:45.348 Power On Hours: 0 hours 00:25:45.348 Unsafe Shutdowns: 0 00:25:45.348 Unrecoverable Media Errors: 0 00:25:45.348 Lifetime Error Log Entries: 0 00:25:45.348 Warning Temperature Time: 0 minutes 00:25:45.348 Critical Temperature Time: 0 minutes 00:25:45.348 00:25:45.348 Number of Queues 00:25:45.348 ================ 00:25:45.348 Number of I/O Submission Queues: 127 00:25:45.348 Number of I/O Completion Queues: 127 00:25:45.348 00:25:45.348 Active Namespaces 00:25:45.348 ================= 00:25:45.348 Namespace ID:1 00:25:45.348 Error Recovery Timeout: Unlimited 00:25:45.348 Command Set Identifier: NVM (00h) 00:25:45.348 Deallocate: Supported 00:25:45.348 Deallocated/Unwritten Error: Not Supported 00:25:45.348 Deallocated Read Value: Unknown 00:25:45.349 Deallocate in Write Zeroes: Not Supported 00:25:45.349 Deallocated Guard Field: 0xFFFF 00:25:45.349 Flush: Supported 00:25:45.349 Reservation: Supported 00:25:45.349 Namespace Sharing Capabilities: Multiple Controllers 00:25:45.349 Size (in LBAs): 131072 (0GiB) 00:25:45.349 Capacity (in LBAs): 131072 (0GiB) 00:25:45.349 Utilization (in LBAs): 131072 (0GiB) 00:25:45.349 NGUID: ABCDEF0123456789ABCDEF0123456789 00:25:45.349 EUI64: ABCDEF0123456789 00:25:45.349 UUID: 55f4cf5b-68fb-42d9-a9d6-4db130ddc500 00:25:45.349 Thin Provisioning: Not Supported 00:25:45.349 Per-NS Atomic Units: Yes 00:25:45.349 Atomic Boundary Size (Normal): 0 00:25:45.349 Atomic Boundary Size (PFail): 0 00:25:45.349 Atomic Boundary Offset: 0 00:25:45.349 Maximum Single Source Range Length: 65535 00:25:45.349 Maximum Copy Length: 65535 00:25:45.349 Maximum Source Range Count: 1 00:25:45.349 NGUID/EUI64 Never Reused: No 00:25:45.349 Namespace Write Protected: No 00:25:45.349 Number of LBA Formats: 1 00:25:45.349 Current LBA Format: LBA Format #00 00:25:45.349 LBA Format #00: Data Size: 512 Metadata Size: 0 00:25:45.349 00:25:45.349 16:09:35 -- host/identify.sh@51 -- # sync 00:25:45.349 16:09:35 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:45.349 16:09:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:45.349 16:09:35 -- common/autotest_common.sh@10 -- # set +x 00:25:45.349 16:09:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:45.349 16:09:35 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:25:45.349 16:09:35 -- host/identify.sh@56 -- # nvmftestfini 00:25:45.349 16:09:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:45.349 16:09:35 -- nvmf/common.sh@116 -- # sync 00:25:45.349 16:09:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:45.349 16:09:35 -- nvmf/common.sh@119 -- # set +e 00:25:45.349 16:09:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:45.349 16:09:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:45.349 rmmod nvme_tcp 00:25:45.349 rmmod nvme_fabrics 00:25:45.349 rmmod nvme_keyring 00:25:45.349 16:09:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:45.349 16:09:35 -- nvmf/common.sh@123 -- # set -e 00:25:45.349 16:09:35 -- nvmf/common.sh@124 -- # return 0 00:25:45.349 16:09:35 -- nvmf/common.sh@477 -- # '[' -n 2504245 ']' 00:25:45.349 16:09:35 -- nvmf/common.sh@478 -- # killprocess 2504245 00:25:45.349 16:09:35 -- common/autotest_common.sh@926 -- # '[' -z 2504245 ']' 00:25:45.349 16:09:35 -- common/autotest_common.sh@930 -- # kill -0 2504245 00:25:45.349 16:09:35 -- common/autotest_common.sh@931 -- # uname 00:25:45.349 16:09:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:45.349 16:09:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2504245 00:25:45.349 16:09:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:45.349 16:09:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:45.349 16:09:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2504245' 00:25:45.349 killing process with pid 2504245 00:25:45.349 16:09:35 -- common/autotest_common.sh@945 -- # kill 2504245 00:25:45.349 [2024-10-30 16:09:35.149212] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:45.349 16:09:35 -- common/autotest_common.sh@950 -- # wait 2504245 00:25:45.608 16:09:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:45.608 16:09:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:45.608 16:09:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:45.608 16:09:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:45.608 16:09:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:45.608 16:09:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:45.608 16:09:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:45.608 16:09:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:48.148 16:09:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:48.148 00:25:48.148 real 0m6.090s 00:25:48.148 user 0m7.843s 00:25:48.148 sys 0m1.854s 00:25:48.148 16:09:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:48.148 16:09:37 -- common/autotest_common.sh@10 -- # set +x 00:25:48.148 ************************************ 00:25:48.148 END TEST nvmf_identify 00:25:48.148 ************************************ 00:25:48.148 16:09:37 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:48.148 16:09:37 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:48.148 16:09:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:48.148 16:09:37 -- common/autotest_common.sh@10 -- # set +x 00:25:48.148 ************************************ 00:25:48.148 START TEST nvmf_perf 00:25:48.148 ************************************ 00:25:48.148 16:09:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:48.148 * Looking for test storage... 00:25:48.148 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:48.148 16:09:37 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:48.148 16:09:37 -- nvmf/common.sh@7 -- # uname -s 00:25:48.148 16:09:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:48.148 16:09:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:48.148 16:09:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:48.148 16:09:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:48.148 16:09:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:48.148 16:09:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:48.148 16:09:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:48.148 16:09:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:48.148 16:09:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:48.148 16:09:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:48.148 16:09:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:48.148 16:09:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:48.148 16:09:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:48.148 16:09:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:48.148 16:09:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:48.148 16:09:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:48.148 16:09:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:48.148 16:09:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:48.148 16:09:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:48.148 16:09:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:48.148 16:09:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:48.148 16:09:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:48.148 16:09:37 -- paths/export.sh@5 -- # export PATH 00:25:48.148 16:09:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:48.148 16:09:37 -- nvmf/common.sh@46 -- # : 0 00:25:48.148 16:09:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:48.148 16:09:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:48.148 16:09:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:48.148 16:09:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:48.148 16:09:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:48.148 16:09:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:48.148 16:09:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:48.148 16:09:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:48.148 16:09:37 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:25:48.148 16:09:37 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:25:48.148 16:09:37 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:48.148 16:09:37 -- host/perf.sh@17 -- # nvmftestinit 00:25:48.148 16:09:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:48.148 16:09:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:48.148 16:09:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:48.148 16:09:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:48.148 16:09:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:48.148 16:09:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:48.148 16:09:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:48.148 16:09:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:48.148 16:09:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:48.148 16:09:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:48.148 16:09:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:48.148 16:09:37 -- common/autotest_common.sh@10 -- # set +x 00:25:50.051 16:09:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:50.051 16:09:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:50.051 16:09:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:50.051 16:09:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:50.051 16:09:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:50.051 16:09:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:50.051 16:09:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:50.051 16:09:39 -- nvmf/common.sh@294 -- # net_devs=() 00:25:50.051 16:09:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:50.051 16:09:39 -- nvmf/common.sh@295 -- # e810=() 00:25:50.051 16:09:39 -- nvmf/common.sh@295 -- # local -ga e810 00:25:50.051 16:09:39 -- nvmf/common.sh@296 -- # x722=() 00:25:50.051 16:09:39 -- nvmf/common.sh@296 -- # local -ga x722 00:25:50.051 16:09:39 -- nvmf/common.sh@297 -- # mlx=() 00:25:50.051 16:09:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:50.051 16:09:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:50.051 16:09:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:50.051 16:09:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:50.051 16:09:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:50.051 16:09:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:50.051 16:09:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:50.051 16:09:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:50.051 16:09:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:50.051 16:09:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:50.051 16:09:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:50.051 16:09:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:50.051 16:09:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:50.051 16:09:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:50.051 16:09:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:50.051 16:09:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:50.051 16:09:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:50.051 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:50.051 16:09:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:50.051 16:09:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:50.051 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:50.051 16:09:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:50.051 16:09:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:50.051 16:09:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:50.051 16:09:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:50.051 16:09:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:50.051 16:09:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:50.051 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:50.051 16:09:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:50.051 16:09:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:50.051 16:09:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:50.051 16:09:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:50.051 16:09:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:50.051 16:09:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:50.051 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:50.051 16:09:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:50.051 16:09:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:50.051 16:09:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:50.051 16:09:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:50.051 16:09:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:50.051 16:09:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:50.051 16:09:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:50.051 16:09:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:50.051 16:09:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:50.051 16:09:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:50.051 16:09:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:50.051 16:09:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:50.051 16:09:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:50.051 16:09:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:50.051 16:09:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:50.051 16:09:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:50.051 16:09:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:50.051 16:09:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:50.051 16:09:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:50.051 16:09:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:50.051 16:09:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:50.051 16:09:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:50.051 16:09:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:50.051 16:09:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:50.051 16:09:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:50.051 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:50.051 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.256 ms 00:25:50.051 00:25:50.051 --- 10.0.0.2 ping statistics --- 00:25:50.052 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:50.052 rtt min/avg/max/mdev = 0.256/0.256/0.256/0.000 ms 00:25:50.052 16:09:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:50.052 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:50.052 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:25:50.052 00:25:50.052 --- 10.0.0.1 ping statistics --- 00:25:50.052 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:50.052 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:25:50.052 16:09:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:50.052 16:09:39 -- nvmf/common.sh@410 -- # return 0 00:25:50.052 16:09:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:50.052 16:09:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:50.052 16:09:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:50.052 16:09:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:50.052 16:09:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:50.052 16:09:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:50.052 16:09:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:50.052 16:09:39 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:25:50.052 16:09:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:50.052 16:09:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:50.052 16:09:39 -- common/autotest_common.sh@10 -- # set +x 00:25:50.052 16:09:39 -- nvmf/common.sh@469 -- # nvmfpid=2506468 00:25:50.052 16:09:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:50.052 16:09:39 -- nvmf/common.sh@470 -- # waitforlisten 2506468 00:25:50.052 16:09:39 -- common/autotest_common.sh@819 -- # '[' -z 2506468 ']' 00:25:50.052 16:09:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:50.052 16:09:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:50.052 16:09:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:50.052 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:50.052 16:09:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:50.052 16:09:39 -- common/autotest_common.sh@10 -- # set +x 00:25:50.052 [2024-10-30 16:09:39.710028] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:25:50.052 [2024-10-30 16:09:39.710110] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:50.052 EAL: No free 2048 kB hugepages reported on node 1 00:25:50.052 [2024-10-30 16:09:39.780303] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:50.052 [2024-10-30 16:09:39.868947] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:50.052 [2024-10-30 16:09:39.869117] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:50.052 [2024-10-30 16:09:39.869136] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:50.052 [2024-10-30 16:09:39.869151] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:50.052 [2024-10-30 16:09:39.869270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:50.052 [2024-10-30 16:09:39.869309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:50.052 [2024-10-30 16:09:39.869427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:50.052 [2024-10-30 16:09:39.869430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:50.983 16:09:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:50.983 16:09:40 -- common/autotest_common.sh@852 -- # return 0 00:25:50.983 16:09:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:50.983 16:09:40 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:50.983 16:09:40 -- common/autotest_common.sh@10 -- # set +x 00:25:50.983 16:09:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:50.983 16:09:40 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:50.983 16:09:40 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:25:54.263 16:09:43 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:25:54.263 16:09:43 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:25:54.263 16:09:44 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:25:54.263 16:09:44 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:25:54.521 16:09:44 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:25:54.521 16:09:44 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:25:54.521 16:09:44 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:25:54.521 16:09:44 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:25:54.521 16:09:44 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:25:54.779 [2024-10-30 16:09:44.557907] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:54.779 16:09:44 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:55.036 16:09:44 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:55.036 16:09:44 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:55.293 16:09:45 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:55.293 16:09:45 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:25:55.551 16:09:45 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:55.808 [2024-10-30 16:09:45.585715] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:55.809 16:09:45 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:56.066 16:09:45 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:25:56.066 16:09:45 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:25:56.066 16:09:45 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:25:56.066 16:09:45 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:25:57.471 Initializing NVMe Controllers 00:25:57.471 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:25:57.471 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:25:57.471 Initialization complete. Launching workers. 00:25:57.471 ======================================================== 00:25:57.471 Latency(us) 00:25:57.471 Device Information : IOPS MiB/s Average min max 00:25:57.471 PCIE (0000:88:00.0) NSID 1 from core 0: 86576.45 338.19 369.10 37.18 4374.58 00:25:57.471 ======================================================== 00:25:57.471 Total : 86576.45 338.19 369.10 37.18 4374.58 00:25:57.471 00:25:57.471 16:09:47 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:57.471 EAL: No free 2048 kB hugepages reported on node 1 00:25:58.914 Initializing NVMe Controllers 00:25:58.914 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:58.914 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:58.914 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:58.914 Initialization complete. Launching workers. 00:25:58.914 ======================================================== 00:25:58.914 Latency(us) 00:25:58.914 Device Information : IOPS MiB/s Average min max 00:25:58.914 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 99.95 0.39 10255.64 141.14 46774.53 00:25:58.914 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 62.97 0.25 16007.50 5997.80 63843.43 00:25:58.914 ======================================================== 00:25:58.914 Total : 162.91 0.64 12478.75 141.14 63843.43 00:25:58.914 00:25:58.914 16:09:48 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:58.914 EAL: No free 2048 kB hugepages reported on node 1 00:25:59.860 Initializing NVMe Controllers 00:25:59.860 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:59.860 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:59.860 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:59.860 Initialization complete. Launching workers. 00:25:59.860 ======================================================== 00:25:59.860 Latency(us) 00:25:59.861 Device Information : IOPS MiB/s Average min max 00:25:59.861 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8572.21 33.49 3733.44 535.12 10636.92 00:25:59.861 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3871.93 15.12 8277.62 4378.63 16067.23 00:25:59.861 ======================================================== 00:25:59.861 Total : 12444.14 48.61 5147.34 535.12 16067.23 00:25:59.861 00:25:59.861 16:09:49 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:25:59.861 16:09:49 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:25:59.861 16:09:49 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:59.861 EAL: No free 2048 kB hugepages reported on node 1 00:26:02.399 Initializing NVMe Controllers 00:26:02.399 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:02.399 Controller IO queue size 128, less than required. 00:26:02.399 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:02.399 Controller IO queue size 128, less than required. 00:26:02.399 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:02.399 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:02.399 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:02.399 Initialization complete. Launching workers. 00:26:02.399 ======================================================== 00:26:02.399 Latency(us) 00:26:02.399 Device Information : IOPS MiB/s Average min max 00:26:02.399 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1765.18 441.30 73920.62 50636.19 129216.96 00:26:02.399 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 573.75 143.44 236378.42 70519.76 373318.94 00:26:02.399 ======================================================== 00:26:02.399 Total : 2338.93 584.73 113772.03 50636.19 373318.94 00:26:02.399 00:26:02.399 16:09:52 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:26:02.399 EAL: No free 2048 kB hugepages reported on node 1 00:26:02.399 No valid NVMe controllers or AIO or URING devices found 00:26:02.399 Initializing NVMe Controllers 00:26:02.399 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:02.399 Controller IO queue size 128, less than required. 00:26:02.399 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:02.399 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:26:02.399 Controller IO queue size 128, less than required. 00:26:02.399 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:02.399 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:26:02.399 WARNING: Some requested NVMe devices were skipped 00:26:02.399 16:09:52 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:26:02.655 EAL: No free 2048 kB hugepages reported on node 1 00:26:05.190 Initializing NVMe Controllers 00:26:05.190 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:05.190 Controller IO queue size 128, less than required. 00:26:05.190 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:05.190 Controller IO queue size 128, less than required. 00:26:05.190 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:05.190 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:05.190 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:05.190 Initialization complete. Launching workers. 00:26:05.190 00:26:05.190 ==================== 00:26:05.190 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:05.190 TCP transport: 00:26:05.190 polls: 8546 00:26:05.191 idle_polls: 5785 00:26:05.191 sock_completions: 2761 00:26:05.191 nvme_completions: 5203 00:26:05.191 submitted_requests: 7971 00:26:05.191 queued_requests: 1 00:26:05.191 00:26:05.191 ==================== 00:26:05.191 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:05.191 TCP transport: 00:26:05.191 polls: 11745 00:26:05.191 idle_polls: 8958 00:26:05.191 sock_completions: 2787 00:26:05.191 nvme_completions: 5385 00:26:05.191 submitted_requests: 8249 00:26:05.191 queued_requests: 1 00:26:05.191 ======================================================== 00:26:05.191 Latency(us) 00:26:05.191 Device Information : IOPS MiB/s Average min max 00:26:05.191 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1364.50 341.12 95774.18 64472.06 158744.36 00:26:05.191 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1410.00 352.50 92124.98 40587.13 128266.30 00:26:05.191 ======================================================== 00:26:05.191 Total : 2774.49 693.62 93919.66 40587.13 158744.36 00:26:05.191 00:26:05.191 16:09:54 -- host/perf.sh@66 -- # sync 00:26:05.191 16:09:54 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:05.191 16:09:54 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:05.191 16:09:54 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:05.191 16:09:54 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:08.484 16:09:58 -- host/perf.sh@72 -- # ls_guid=4f995c23-758b-4318-8ce1-4d8fd3c1d09e 00:26:08.484 16:09:58 -- host/perf.sh@73 -- # get_lvs_free_mb 4f995c23-758b-4318-8ce1-4d8fd3c1d09e 00:26:08.484 16:09:58 -- common/autotest_common.sh@1343 -- # local lvs_uuid=4f995c23-758b-4318-8ce1-4d8fd3c1d09e 00:26:08.484 16:09:58 -- common/autotest_common.sh@1344 -- # local lvs_info 00:26:08.484 16:09:58 -- common/autotest_common.sh@1345 -- # local fc 00:26:08.484 16:09:58 -- common/autotest_common.sh@1346 -- # local cs 00:26:08.484 16:09:58 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:09.054 16:09:58 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:26:09.054 { 00:26:09.054 "uuid": "4f995c23-758b-4318-8ce1-4d8fd3c1d09e", 00:26:09.054 "name": "lvs_0", 00:26:09.054 "base_bdev": "Nvme0n1", 00:26:09.054 "total_data_clusters": 238234, 00:26:09.054 "free_clusters": 238234, 00:26:09.054 "block_size": 512, 00:26:09.054 "cluster_size": 4194304 00:26:09.054 } 00:26:09.054 ]' 00:26:09.054 16:09:58 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="4f995c23-758b-4318-8ce1-4d8fd3c1d09e") .free_clusters' 00:26:09.054 16:09:58 -- common/autotest_common.sh@1348 -- # fc=238234 00:26:09.054 16:09:58 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="4f995c23-758b-4318-8ce1-4d8fd3c1d09e") .cluster_size' 00:26:09.054 16:09:58 -- common/autotest_common.sh@1349 -- # cs=4194304 00:26:09.054 16:09:58 -- common/autotest_common.sh@1352 -- # free_mb=952936 00:26:09.054 16:09:58 -- common/autotest_common.sh@1353 -- # echo 952936 00:26:09.054 952936 00:26:09.054 16:09:58 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:09.054 16:09:58 -- host/perf.sh@78 -- # free_mb=20480 00:26:09.054 16:09:58 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 4f995c23-758b-4318-8ce1-4d8fd3c1d09e lbd_0 20480 00:26:09.312 16:09:59 -- host/perf.sh@80 -- # lb_guid=643ea53f-f28a-41ac-8491-fb84ece00c95 00:26:09.312 16:09:59 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 643ea53f-f28a-41ac-8491-fb84ece00c95 lvs_n_0 00:26:10.247 16:09:59 -- host/perf.sh@83 -- # ls_nested_guid=9fff2f5c-cc9c-44f8-9b8c-983824c79762 00:26:10.247 16:09:59 -- host/perf.sh@84 -- # get_lvs_free_mb 9fff2f5c-cc9c-44f8-9b8c-983824c79762 00:26:10.247 16:09:59 -- common/autotest_common.sh@1343 -- # local lvs_uuid=9fff2f5c-cc9c-44f8-9b8c-983824c79762 00:26:10.247 16:09:59 -- common/autotest_common.sh@1344 -- # local lvs_info 00:26:10.247 16:09:59 -- common/autotest_common.sh@1345 -- # local fc 00:26:10.247 16:09:59 -- common/autotest_common.sh@1346 -- # local cs 00:26:10.247 16:09:59 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:10.505 16:10:00 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:26:10.505 { 00:26:10.505 "uuid": "4f995c23-758b-4318-8ce1-4d8fd3c1d09e", 00:26:10.505 "name": "lvs_0", 00:26:10.505 "base_bdev": "Nvme0n1", 00:26:10.505 "total_data_clusters": 238234, 00:26:10.505 "free_clusters": 233114, 00:26:10.505 "block_size": 512, 00:26:10.505 "cluster_size": 4194304 00:26:10.505 }, 00:26:10.505 { 00:26:10.505 "uuid": "9fff2f5c-cc9c-44f8-9b8c-983824c79762", 00:26:10.505 "name": "lvs_n_0", 00:26:10.505 "base_bdev": "643ea53f-f28a-41ac-8491-fb84ece00c95", 00:26:10.505 "total_data_clusters": 5114, 00:26:10.505 "free_clusters": 5114, 00:26:10.505 "block_size": 512, 00:26:10.505 "cluster_size": 4194304 00:26:10.505 } 00:26:10.505 ]' 00:26:10.505 16:10:00 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="9fff2f5c-cc9c-44f8-9b8c-983824c79762") .free_clusters' 00:26:10.505 16:10:00 -- common/autotest_common.sh@1348 -- # fc=5114 00:26:10.505 16:10:00 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="9fff2f5c-cc9c-44f8-9b8c-983824c79762") .cluster_size' 00:26:10.505 16:10:00 -- common/autotest_common.sh@1349 -- # cs=4194304 00:26:10.505 16:10:00 -- common/autotest_common.sh@1352 -- # free_mb=20456 00:26:10.505 16:10:00 -- common/autotest_common.sh@1353 -- # echo 20456 00:26:10.505 20456 00:26:10.505 16:10:00 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:10.505 16:10:00 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 9fff2f5c-cc9c-44f8-9b8c-983824c79762 lbd_nest_0 20456 00:26:10.763 16:10:00 -- host/perf.sh@88 -- # lb_nested_guid=c17d135b-0c39-4d68-a6b7-3e1a8afc6c14 00:26:10.763 16:10:00 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:11.021 16:10:00 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:11.021 16:10:00 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 c17d135b-0c39-4d68-a6b7-3e1a8afc6c14 00:26:11.280 16:10:01 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:11.537 16:10:01 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:11.537 16:10:01 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:11.537 16:10:01 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:11.537 16:10:01 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:11.537 16:10:01 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:11.537 EAL: No free 2048 kB hugepages reported on node 1 00:26:23.755 Initializing NVMe Controllers 00:26:23.755 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:23.755 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:23.755 Initialization complete. Launching workers. 00:26:23.755 ======================================================== 00:26:23.755 Latency(us) 00:26:23.755 Device Information : IOPS MiB/s Average min max 00:26:23.755 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 50.38 0.02 19911.08 167.68 45066.56 00:26:23.755 ======================================================== 00:26:23.755 Total : 50.38 0.02 19911.08 167.68 45066.56 00:26:23.755 00:26:23.755 16:10:11 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:23.755 16:10:11 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:23.755 EAL: No free 2048 kB hugepages reported on node 1 00:26:33.740 Initializing NVMe Controllers 00:26:33.740 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:33.740 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:33.740 Initialization complete. Launching workers. 00:26:33.740 ======================================================== 00:26:33.740 Latency(us) 00:26:33.740 Device Information : IOPS MiB/s Average min max 00:26:33.740 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 80.80 10.10 12387.50 4133.92 55868.11 00:26:33.740 ======================================================== 00:26:33.740 Total : 80.80 10.10 12387.50 4133.92 55868.11 00:26:33.740 00:26:33.740 16:10:21 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:33.740 16:10:21 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:33.740 16:10:21 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:33.740 EAL: No free 2048 kB hugepages reported on node 1 00:26:43.725 Initializing NVMe Controllers 00:26:43.725 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:43.725 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:43.725 Initialization complete. Launching workers. 00:26:43.725 ======================================================== 00:26:43.725 Latency(us) 00:26:43.725 Device Information : IOPS MiB/s Average min max 00:26:43.725 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7766.00 3.79 4120.29 353.01 12059.93 00:26:43.725 ======================================================== 00:26:43.725 Total : 7766.00 3.79 4120.29 353.01 12059.93 00:26:43.725 00:26:43.725 16:10:32 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:43.725 16:10:32 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:43.725 EAL: No free 2048 kB hugepages reported on node 1 00:26:53.744 Initializing NVMe Controllers 00:26:53.744 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:53.744 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:53.744 Initialization complete. Launching workers. 00:26:53.744 ======================================================== 00:26:53.744 Latency(us) 00:26:53.744 Device Information : IOPS MiB/s Average min max 00:26:53.744 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4056.60 507.07 7889.16 569.65 17218.02 00:26:53.744 ======================================================== 00:26:53.744 Total : 4056.60 507.07 7889.16 569.65 17218.02 00:26:53.744 00:26:53.744 16:10:42 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:53.744 16:10:42 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:53.744 16:10:42 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:53.744 EAL: No free 2048 kB hugepages reported on node 1 00:27:03.725 Initializing NVMe Controllers 00:27:03.725 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:03.725 Controller IO queue size 128, less than required. 00:27:03.725 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:03.725 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:03.725 Initialization complete. Launching workers. 00:27:03.725 ======================================================== 00:27:03.725 Latency(us) 00:27:03.725 Device Information : IOPS MiB/s Average min max 00:27:03.725 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12119.85 5.92 10562.88 1827.65 30020.93 00:27:03.725 ======================================================== 00:27:03.725 Total : 12119.85 5.92 10562.88 1827.65 30020.93 00:27:03.725 00:27:03.725 16:10:52 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:03.725 16:10:52 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:03.725 EAL: No free 2048 kB hugepages reported on node 1 00:27:13.779 Initializing NVMe Controllers 00:27:13.779 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:13.779 Controller IO queue size 128, less than required. 00:27:13.779 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:13.779 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:13.779 Initialization complete. Launching workers. 00:27:13.779 ======================================================== 00:27:13.779 Latency(us) 00:27:13.779 Device Information : IOPS MiB/s Average min max 00:27:13.779 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1197.20 149.65 107295.41 16116.07 215710.27 00:27:13.779 ======================================================== 00:27:13.779 Total : 1197.20 149.65 107295.41 16116.07 215710.27 00:27:13.779 00:27:13.779 16:11:03 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:13.779 16:11:03 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete c17d135b-0c39-4d68-a6b7-3e1a8afc6c14 00:27:14.369 16:11:04 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:14.627 16:11:04 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 643ea53f-f28a-41ac-8491-fb84ece00c95 00:27:14.884 16:11:04 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:15.142 16:11:04 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:15.142 16:11:04 -- host/perf.sh@114 -- # nvmftestfini 00:27:15.142 16:11:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:15.142 16:11:04 -- nvmf/common.sh@116 -- # sync 00:27:15.142 16:11:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:15.142 16:11:04 -- nvmf/common.sh@119 -- # set +e 00:27:15.142 16:11:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:15.142 16:11:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:15.142 rmmod nvme_tcp 00:27:15.142 rmmod nvme_fabrics 00:27:15.142 rmmod nvme_keyring 00:27:15.142 16:11:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:15.142 16:11:04 -- nvmf/common.sh@123 -- # set -e 00:27:15.142 16:11:04 -- nvmf/common.sh@124 -- # return 0 00:27:15.142 16:11:04 -- nvmf/common.sh@477 -- # '[' -n 2506468 ']' 00:27:15.142 16:11:04 -- nvmf/common.sh@478 -- # killprocess 2506468 00:27:15.142 16:11:04 -- common/autotest_common.sh@926 -- # '[' -z 2506468 ']' 00:27:15.142 16:11:04 -- common/autotest_common.sh@930 -- # kill -0 2506468 00:27:15.142 16:11:04 -- common/autotest_common.sh@931 -- # uname 00:27:15.142 16:11:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:15.142 16:11:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2506468 00:27:15.142 16:11:05 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:27:15.142 16:11:05 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:27:15.142 16:11:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2506468' 00:27:15.142 killing process with pid 2506468 00:27:15.142 16:11:05 -- common/autotest_common.sh@945 -- # kill 2506468 00:27:15.142 16:11:05 -- common/autotest_common.sh@950 -- # wait 2506468 00:27:17.048 16:11:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:17.048 16:11:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:17.048 16:11:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:17.048 16:11:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:17.048 16:11:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:17.048 16:11:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:17.048 16:11:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:17.048 16:11:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:18.954 16:11:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:18.954 00:27:18.954 real 1m31.170s 00:27:18.954 user 5m37.162s 00:27:18.954 sys 0m15.842s 00:27:18.954 16:11:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:18.954 16:11:08 -- common/autotest_common.sh@10 -- # set +x 00:27:18.954 ************************************ 00:27:18.954 END TEST nvmf_perf 00:27:18.954 ************************************ 00:27:18.954 16:11:08 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:18.954 16:11:08 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:18.954 16:11:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:18.954 16:11:08 -- common/autotest_common.sh@10 -- # set +x 00:27:18.954 ************************************ 00:27:18.954 START TEST nvmf_fio_host 00:27:18.954 ************************************ 00:27:18.954 16:11:08 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:18.955 * Looking for test storage... 00:27:18.955 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:18.955 16:11:08 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:18.955 16:11:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:18.955 16:11:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:18.955 16:11:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:18.955 16:11:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:18.955 16:11:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:18.955 16:11:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:18.955 16:11:08 -- paths/export.sh@5 -- # export PATH 00:27:18.955 16:11:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:18.955 16:11:08 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:18.955 16:11:08 -- nvmf/common.sh@7 -- # uname -s 00:27:18.955 16:11:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:18.955 16:11:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:18.955 16:11:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:18.955 16:11:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:18.955 16:11:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:18.955 16:11:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:18.955 16:11:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:18.955 16:11:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:18.955 16:11:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:18.955 16:11:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:18.955 16:11:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:18.955 16:11:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:18.955 16:11:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:18.955 16:11:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:18.955 16:11:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:18.955 16:11:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:18.955 16:11:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:18.955 16:11:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:18.955 16:11:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:18.955 16:11:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:18.955 16:11:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:18.955 16:11:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:18.955 16:11:08 -- paths/export.sh@5 -- # export PATH 00:27:18.955 16:11:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:18.955 16:11:08 -- nvmf/common.sh@46 -- # : 0 00:27:18.955 16:11:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:18.955 16:11:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:18.955 16:11:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:18.955 16:11:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:18.955 16:11:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:18.955 16:11:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:18.955 16:11:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:18.955 16:11:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:18.955 16:11:08 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:18.955 16:11:08 -- host/fio.sh@14 -- # nvmftestinit 00:27:18.955 16:11:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:18.955 16:11:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:18.955 16:11:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:18.955 16:11:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:18.955 16:11:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:18.955 16:11:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:18.955 16:11:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:18.955 16:11:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:18.955 16:11:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:18.955 16:11:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:18.955 16:11:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:18.955 16:11:08 -- common/autotest_common.sh@10 -- # set +x 00:27:21.490 16:11:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:21.490 16:11:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:21.490 16:11:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:21.490 16:11:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:21.490 16:11:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:21.490 16:11:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:21.490 16:11:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:21.490 16:11:10 -- nvmf/common.sh@294 -- # net_devs=() 00:27:21.490 16:11:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:21.490 16:11:10 -- nvmf/common.sh@295 -- # e810=() 00:27:21.490 16:11:10 -- nvmf/common.sh@295 -- # local -ga e810 00:27:21.490 16:11:10 -- nvmf/common.sh@296 -- # x722=() 00:27:21.490 16:11:10 -- nvmf/common.sh@296 -- # local -ga x722 00:27:21.490 16:11:10 -- nvmf/common.sh@297 -- # mlx=() 00:27:21.490 16:11:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:21.490 16:11:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:21.490 16:11:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:21.490 16:11:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:21.490 16:11:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:21.490 16:11:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:21.490 16:11:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:21.490 16:11:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:21.490 16:11:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:21.491 16:11:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:21.491 16:11:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:21.491 16:11:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:21.491 16:11:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:21.491 16:11:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:21.491 16:11:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:21.491 16:11:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:21.491 16:11:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:21.491 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:21.491 16:11:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:21.491 16:11:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:21.491 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:21.491 16:11:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:21.491 16:11:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:21.491 16:11:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:21.491 16:11:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:21.491 16:11:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:21.491 16:11:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:21.491 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:21.491 16:11:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:21.491 16:11:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:21.491 16:11:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:21.491 16:11:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:21.491 16:11:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:21.491 16:11:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:21.491 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:21.491 16:11:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:21.491 16:11:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:21.491 16:11:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:21.491 16:11:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:21.491 16:11:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:21.491 16:11:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:21.491 16:11:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:21.491 16:11:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:21.491 16:11:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:21.491 16:11:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:21.491 16:11:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:21.491 16:11:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:21.491 16:11:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:21.491 16:11:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:21.491 16:11:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:21.491 16:11:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:21.491 16:11:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:21.491 16:11:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:21.491 16:11:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:21.491 16:11:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:21.491 16:11:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:21.491 16:11:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:21.491 16:11:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:21.491 16:11:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:21.491 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:21.491 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.327 ms 00:27:21.491 00:27:21.491 --- 10.0.0.2 ping statistics --- 00:27:21.491 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:21.491 rtt min/avg/max/mdev = 0.327/0.327/0.327/0.000 ms 00:27:21.491 16:11:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:21.491 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:21.491 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:27:21.491 00:27:21.491 --- 10.0.0.1 ping statistics --- 00:27:21.491 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:21.491 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:27:21.491 16:11:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:21.491 16:11:10 -- nvmf/common.sh@410 -- # return 0 00:27:21.491 16:11:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:21.491 16:11:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:21.491 16:11:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:21.491 16:11:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:21.491 16:11:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:21.491 16:11:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:21.491 16:11:11 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:21.491 16:11:11 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:21.491 16:11:11 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:21.491 16:11:11 -- common/autotest_common.sh@10 -- # set +x 00:27:21.491 16:11:11 -- host/fio.sh@24 -- # nvmfpid=2518788 00:27:21.491 16:11:11 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:21.491 16:11:11 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:21.491 16:11:11 -- host/fio.sh@28 -- # waitforlisten 2518788 00:27:21.491 16:11:11 -- common/autotest_common.sh@819 -- # '[' -z 2518788 ']' 00:27:21.491 16:11:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:21.491 16:11:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:21.491 16:11:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:21.491 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:21.491 16:11:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:21.491 16:11:11 -- common/autotest_common.sh@10 -- # set +x 00:27:21.491 [2024-10-30 16:11:11.072770] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:27:21.491 [2024-10-30 16:11:11.072864] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:21.491 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.491 [2024-10-30 16:11:11.142175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:21.491 [2024-10-30 16:11:11.229774] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:21.491 [2024-10-30 16:11:11.229934] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:21.491 [2024-10-30 16:11:11.229951] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:21.491 [2024-10-30 16:11:11.229963] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:21.491 [2024-10-30 16:11:11.230016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:21.491 [2024-10-30 16:11:11.230052] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:21.491 [2024-10-30 16:11:11.230111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:21.491 [2024-10-30 16:11:11.230113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:22.428 16:11:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:22.428 16:11:12 -- common/autotest_common.sh@852 -- # return 0 00:27:22.428 16:11:12 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:22.428 [2024-10-30 16:11:12.295749] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:22.686 16:11:12 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:22.686 16:11:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:22.686 16:11:12 -- common/autotest_common.sh@10 -- # set +x 00:27:22.686 16:11:12 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:22.945 Malloc1 00:27:22.945 16:11:12 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:23.203 16:11:12 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:23.462 16:11:13 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:23.720 [2024-10-30 16:11:13.343558] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:23.720 16:11:13 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:23.979 16:11:13 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:23.979 16:11:13 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:23.979 16:11:13 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:23.979 16:11:13 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:23.979 16:11:13 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:23.979 16:11:13 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:23.979 16:11:13 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:23.979 16:11:13 -- common/autotest_common.sh@1320 -- # shift 00:27:23.979 16:11:13 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:23.979 16:11:13 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:23.979 16:11:13 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:23.979 16:11:13 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:23.979 16:11:13 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:23.979 16:11:13 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:23.979 16:11:13 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:23.979 16:11:13 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:23.979 16:11:13 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:23.979 16:11:13 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:23.979 16:11:13 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:23.979 16:11:13 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:23.979 16:11:13 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:23.979 16:11:13 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:23.979 16:11:13 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:24.239 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:24.239 fio-3.35 00:27:24.239 Starting 1 thread 00:27:24.239 EAL: No free 2048 kB hugepages reported on node 1 00:27:26.770 00:27:26.770 test: (groupid=0, jobs=1): err= 0: pid=2519285: Wed Oct 30 16:11:16 2024 00:27:26.770 read: IOPS=9663, BW=37.7MiB/s (39.6MB/s)(75.8MiB/2007msec) 00:27:26.770 slat (nsec): min=1885, max=274558, avg=2472.43, stdev=2905.73 00:27:26.770 clat (usec): min=3297, max=11967, avg=7302.40, stdev=532.01 00:27:26.770 lat (usec): min=3337, max=11969, avg=7304.87, stdev=531.87 00:27:26.770 clat percentiles (usec): 00:27:26.770 | 1.00th=[ 6063], 5.00th=[ 6456], 10.00th=[ 6652], 20.00th=[ 6915], 00:27:26.770 | 30.00th=[ 7046], 40.00th=[ 7177], 50.00th=[ 7308], 60.00th=[ 7439], 00:27:26.770 | 70.00th=[ 7570], 80.00th=[ 7701], 90.00th=[ 7963], 95.00th=[ 8094], 00:27:26.770 | 99.00th=[ 8455], 99.50th=[ 8586], 99.90th=[10552], 99.95th=[11076], 00:27:26.770 | 99.99th=[11994] 00:27:26.770 bw ( KiB/s): min=37456, max=39296, per=100.00%, avg=38652.00, stdev=840.74, samples=4 00:27:26.770 iops : min= 9364, max= 9824, avg=9663.00, stdev=210.18, samples=4 00:27:26.770 write: IOPS=9671, BW=37.8MiB/s (39.6MB/s)(75.8MiB/2007msec); 0 zone resets 00:27:26.770 slat (nsec): min=1983, max=237143, avg=2571.66, stdev=2066.47 00:27:26.770 clat (usec): min=2505, max=11067, avg=5881.90, stdev=468.32 00:27:26.770 lat (usec): min=2528, max=11070, avg=5884.48, stdev=468.31 00:27:26.770 clat percentiles (usec): 00:27:26.770 | 1.00th=[ 4883], 5.00th=[ 5145], 10.00th=[ 5342], 20.00th=[ 5538], 00:27:26.770 | 30.00th=[ 5669], 40.00th=[ 5800], 50.00th=[ 5866], 60.00th=[ 5997], 00:27:26.770 | 70.00th=[ 6128], 80.00th=[ 6259], 90.00th=[ 6390], 95.00th=[ 6587], 00:27:26.770 | 99.00th=[ 6915], 99.50th=[ 7111], 99.90th=[10028], 99.95th=[10552], 00:27:26.770 | 99.99th=[10945] 00:27:26.770 bw ( KiB/s): min=38208, max=39360, per=100.00%, avg=38704.00, stdev=485.66, samples=4 00:27:26.770 iops : min= 9552, max= 9840, avg=9676.00, stdev=121.41, samples=4 00:27:26.770 lat (msec) : 4=0.05%, 10=99.83%, 20=0.12% 00:27:26.770 cpu : usr=66.70%, sys=31.61%, ctx=57, majf=0, minf=41 00:27:26.770 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:26.770 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:26.770 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:26.770 issued rwts: total=19394,19411,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:26.770 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:26.770 00:27:26.770 Run status group 0 (all jobs): 00:27:26.770 READ: bw=37.7MiB/s (39.6MB/s), 37.7MiB/s-37.7MiB/s (39.6MB/s-39.6MB/s), io=75.8MiB (79.4MB), run=2007-2007msec 00:27:26.770 WRITE: bw=37.8MiB/s (39.6MB/s), 37.8MiB/s-37.8MiB/s (39.6MB/s-39.6MB/s), io=75.8MiB (79.5MB), run=2007-2007msec 00:27:26.770 16:11:16 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:26.770 16:11:16 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:26.770 16:11:16 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:26.770 16:11:16 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:26.770 16:11:16 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:26.770 16:11:16 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:26.770 16:11:16 -- common/autotest_common.sh@1320 -- # shift 00:27:26.770 16:11:16 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:26.770 16:11:16 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:26.770 16:11:16 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:26.770 16:11:16 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:26.770 16:11:16 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:26.770 16:11:16 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:26.770 16:11:16 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:26.770 16:11:16 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:26.770 16:11:16 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:26.770 16:11:16 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:26.770 16:11:16 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:26.770 16:11:16 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:26.770 16:11:16 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:26.770 16:11:16 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:26.770 16:11:16 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:26.770 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:26.770 fio-3.35 00:27:26.770 Starting 1 thread 00:27:26.770 EAL: No free 2048 kB hugepages reported on node 1 00:27:29.300 00:27:29.300 test: (groupid=0, jobs=1): err= 0: pid=2519663: Wed Oct 30 16:11:18 2024 00:27:29.300 read: IOPS=8432, BW=132MiB/s (138MB/s)(264MiB/2007msec) 00:27:29.300 slat (nsec): min=2776, max=94356, avg=3587.11, stdev=1671.71 00:27:29.300 clat (usec): min=2310, max=17990, avg=8669.92, stdev=2198.22 00:27:29.300 lat (usec): min=2313, max=17994, avg=8673.51, stdev=2198.22 00:27:29.300 clat percentiles (usec): 00:27:29.300 | 1.00th=[ 4555], 5.00th=[ 5342], 10.00th=[ 5932], 20.00th=[ 6783], 00:27:29.300 | 30.00th=[ 7439], 40.00th=[ 7963], 50.00th=[ 8586], 60.00th=[ 9110], 00:27:29.300 | 70.00th=[ 9634], 80.00th=[10290], 90.00th=[11338], 95.00th=[12780], 00:27:29.300 | 99.00th=[14877], 99.50th=[15270], 99.90th=[16319], 99.95th=[16450], 00:27:29.300 | 99.99th=[17695] 00:27:29.300 bw ( KiB/s): min=64768, max=84864, per=52.35%, avg=70624.00, stdev=9588.69, samples=4 00:27:29.300 iops : min= 4048, max= 5304, avg=4414.00, stdev=599.29, samples=4 00:27:29.300 write: IOPS=4987, BW=77.9MiB/s (81.7MB/s)(144MiB/1854msec); 0 zone resets 00:27:29.300 slat (usec): min=30, max=138, avg=33.28, stdev= 4.95 00:27:29.300 clat (usec): min=6194, max=20441, avg=11346.13, stdev=2169.56 00:27:29.300 lat (usec): min=6225, max=20473, avg=11379.42, stdev=2169.28 00:27:29.300 clat percentiles (usec): 00:27:29.300 | 1.00th=[ 7439], 5.00th=[ 8291], 10.00th=[ 8717], 20.00th=[ 9372], 00:27:29.300 | 30.00th=[10028], 40.00th=[10552], 50.00th=[11076], 60.00th=[11600], 00:27:29.300 | 70.00th=[12387], 80.00th=[13173], 90.00th=[14222], 95.00th=[15270], 00:27:29.300 | 99.00th=[16909], 99.50th=[17695], 99.90th=[19792], 99.95th=[20055], 00:27:29.300 | 99.99th=[20317] 00:27:29.300 bw ( KiB/s): min=67264, max=86912, per=91.83%, avg=73280.00, stdev=9280.77, samples=4 00:27:29.300 iops : min= 4204, max= 5432, avg=4580.00, stdev=580.05, samples=4 00:27:29.300 lat (msec) : 4=0.24%, 10=59.22%, 20=40.51%, 50=0.03% 00:27:29.300 cpu : usr=77.02%, sys=21.73%, ctx=40, majf=0, minf=63 00:27:29.300 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:27:29.300 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:29.300 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:29.300 issued rwts: total=16924,9247,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:29.300 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:29.300 00:27:29.300 Run status group 0 (all jobs): 00:27:29.300 READ: bw=132MiB/s (138MB/s), 132MiB/s-132MiB/s (138MB/s-138MB/s), io=264MiB (277MB), run=2007-2007msec 00:27:29.300 WRITE: bw=77.9MiB/s (81.7MB/s), 77.9MiB/s-77.9MiB/s (81.7MB/s-81.7MB/s), io=144MiB (152MB), run=1854-1854msec 00:27:29.300 16:11:18 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:29.301 16:11:19 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:27:29.301 16:11:19 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:27:29.301 16:11:19 -- host/fio.sh@51 -- # get_nvme_bdfs 00:27:29.301 16:11:19 -- common/autotest_common.sh@1498 -- # bdfs=() 00:27:29.301 16:11:19 -- common/autotest_common.sh@1498 -- # local bdfs 00:27:29.301 16:11:19 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:29.301 16:11:19 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:29.301 16:11:19 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:27:29.558 16:11:19 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:27:29.558 16:11:19 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:27:29.558 16:11:19 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:27:32.836 Nvme0n1 00:27:32.836 16:11:22 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:35.361 16:11:25 -- host/fio.sh@53 -- # ls_guid=b9991b30-67f2-455c-8e06-c179c9575766 00:27:35.361 16:11:25 -- host/fio.sh@54 -- # get_lvs_free_mb b9991b30-67f2-455c-8e06-c179c9575766 00:27:35.361 16:11:25 -- common/autotest_common.sh@1343 -- # local lvs_uuid=b9991b30-67f2-455c-8e06-c179c9575766 00:27:35.361 16:11:25 -- common/autotest_common.sh@1344 -- # local lvs_info 00:27:35.361 16:11:25 -- common/autotest_common.sh@1345 -- # local fc 00:27:35.361 16:11:25 -- common/autotest_common.sh@1346 -- # local cs 00:27:35.361 16:11:25 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:35.926 16:11:25 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:27:35.926 { 00:27:35.926 "uuid": "b9991b30-67f2-455c-8e06-c179c9575766", 00:27:35.926 "name": "lvs_0", 00:27:35.926 "base_bdev": "Nvme0n1", 00:27:35.926 "total_data_clusters": 930, 00:27:35.926 "free_clusters": 930, 00:27:35.926 "block_size": 512, 00:27:35.926 "cluster_size": 1073741824 00:27:35.926 } 00:27:35.926 ]' 00:27:35.926 16:11:25 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="b9991b30-67f2-455c-8e06-c179c9575766") .free_clusters' 00:27:35.926 16:11:25 -- common/autotest_common.sh@1348 -- # fc=930 00:27:35.926 16:11:25 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="b9991b30-67f2-455c-8e06-c179c9575766") .cluster_size' 00:27:35.926 16:11:25 -- common/autotest_common.sh@1349 -- # cs=1073741824 00:27:35.926 16:11:25 -- common/autotest_common.sh@1352 -- # free_mb=952320 00:27:35.926 16:11:25 -- common/autotest_common.sh@1353 -- # echo 952320 00:27:35.926 952320 00:27:35.926 16:11:25 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:36.184 f6958787-4c04-4bc3-8d9e-4cadd020ccb0 00:27:36.184 16:11:26 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:36.441 16:11:26 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:36.699 16:11:26 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:36.957 16:11:26 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:36.957 16:11:26 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:36.957 16:11:26 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:36.957 16:11:26 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:36.957 16:11:26 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:36.957 16:11:26 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:36.957 16:11:26 -- common/autotest_common.sh@1320 -- # shift 00:27:36.957 16:11:26 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:36.957 16:11:26 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:36.957 16:11:26 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:36.957 16:11:26 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:36.957 16:11:26 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:36.957 16:11:26 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:36.957 16:11:26 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:36.957 16:11:26 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:36.957 16:11:26 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:36.957 16:11:26 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:36.957 16:11:26 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:36.957 16:11:26 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:36.957 16:11:26 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:36.957 16:11:26 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:36.957 16:11:26 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:37.215 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:37.215 fio-3.35 00:27:37.215 Starting 1 thread 00:27:37.215 EAL: No free 2048 kB hugepages reported on node 1 00:27:39.740 00:27:39.740 test: (groupid=0, jobs=1): err= 0: pid=2521067: Wed Oct 30 16:11:29 2024 00:27:39.740 read: IOPS=6377, BW=24.9MiB/s (26.1MB/s)(50.0MiB/2007msec) 00:27:39.740 slat (nsec): min=1834, max=297318, avg=2468.91, stdev=3161.33 00:27:39.740 clat (usec): min=1070, max=170742, avg=10978.88, stdev=11324.09 00:27:39.740 lat (usec): min=1072, max=170785, avg=10981.35, stdev=11324.36 00:27:39.740 clat percentiles (msec): 00:27:39.740 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 10], 00:27:39.740 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:27:39.740 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:27:39.740 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:27:39.740 | 99.99th=[ 171] 00:27:39.740 bw ( KiB/s): min=17944, max=28072, per=99.82%, avg=25466.00, stdev=5015.54, samples=4 00:27:39.740 iops : min= 4486, max= 7018, avg=6366.50, stdev=1253.88, samples=4 00:27:39.740 write: IOPS=6377, BW=24.9MiB/s (26.1MB/s)(50.0MiB/2007msec); 0 zone resets 00:27:39.740 slat (nsec): min=1970, max=90746, avg=2587.96, stdev=1592.06 00:27:39.740 clat (usec): min=451, max=169033, avg=8974.11, stdev=10611.90 00:27:39.740 lat (usec): min=454, max=169037, avg=8976.69, stdev=10612.09 00:27:39.740 clat percentiles (msec): 00:27:39.740 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], 00:27:39.740 | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:27:39.740 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:27:39.740 | 99.00th=[ 11], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:27:39.740 | 99.99th=[ 169] 00:27:39.740 bw ( KiB/s): min=18984, max=27768, per=99.88%, avg=25480.00, stdev=4331.85, samples=4 00:27:39.740 iops : min= 4746, max= 6942, avg=6370.00, stdev=1082.96, samples=4 00:27:39.740 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:27:39.740 lat (msec) : 2=0.04%, 4=0.14%, 10=70.46%, 20=28.85%, 250=0.50% 00:27:39.740 cpu : usr=58.28%, sys=40.33%, ctx=103, majf=0, minf=41 00:27:39.740 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:39.740 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:39.740 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:39.740 issued rwts: total=12800,12800,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:39.740 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:39.740 00:27:39.740 Run status group 0 (all jobs): 00:27:39.740 READ: bw=24.9MiB/s (26.1MB/s), 24.9MiB/s-24.9MiB/s (26.1MB/s-26.1MB/s), io=50.0MiB (52.4MB), run=2007-2007msec 00:27:39.740 WRITE: bw=24.9MiB/s (26.1MB/s), 24.9MiB/s-24.9MiB/s (26.1MB/s-26.1MB/s), io=50.0MiB (52.4MB), run=2007-2007msec 00:27:39.740 16:11:29 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:27:39.996 16:11:29 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:27:41.367 16:11:30 -- host/fio.sh@64 -- # ls_nested_guid=e027a704-1168-49ae-b9d1-f5b7e1e90bae 00:27:41.367 16:11:30 -- host/fio.sh@65 -- # get_lvs_free_mb e027a704-1168-49ae-b9d1-f5b7e1e90bae 00:27:41.367 16:11:30 -- common/autotest_common.sh@1343 -- # local lvs_uuid=e027a704-1168-49ae-b9d1-f5b7e1e90bae 00:27:41.367 16:11:30 -- common/autotest_common.sh@1344 -- # local lvs_info 00:27:41.367 16:11:30 -- common/autotest_common.sh@1345 -- # local fc 00:27:41.367 16:11:30 -- common/autotest_common.sh@1346 -- # local cs 00:27:41.367 16:11:30 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:41.367 16:11:31 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:27:41.367 { 00:27:41.367 "uuid": "b9991b30-67f2-455c-8e06-c179c9575766", 00:27:41.367 "name": "lvs_0", 00:27:41.367 "base_bdev": "Nvme0n1", 00:27:41.367 "total_data_clusters": 930, 00:27:41.367 "free_clusters": 0, 00:27:41.367 "block_size": 512, 00:27:41.367 "cluster_size": 1073741824 00:27:41.367 }, 00:27:41.367 { 00:27:41.367 "uuid": "e027a704-1168-49ae-b9d1-f5b7e1e90bae", 00:27:41.367 "name": "lvs_n_0", 00:27:41.367 "base_bdev": "f6958787-4c04-4bc3-8d9e-4cadd020ccb0", 00:27:41.367 "total_data_clusters": 237847, 00:27:41.367 "free_clusters": 237847, 00:27:41.367 "block_size": 512, 00:27:41.367 "cluster_size": 4194304 00:27:41.367 } 00:27:41.367 ]' 00:27:41.367 16:11:31 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="e027a704-1168-49ae-b9d1-f5b7e1e90bae") .free_clusters' 00:27:41.367 16:11:31 -- common/autotest_common.sh@1348 -- # fc=237847 00:27:41.367 16:11:31 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="e027a704-1168-49ae-b9d1-f5b7e1e90bae") .cluster_size' 00:27:41.367 16:11:31 -- common/autotest_common.sh@1349 -- # cs=4194304 00:27:41.367 16:11:31 -- common/autotest_common.sh@1352 -- # free_mb=951388 00:27:41.367 16:11:31 -- common/autotest_common.sh@1353 -- # echo 951388 00:27:41.367 951388 00:27:41.367 16:11:31 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:27:42.300 570fa0b7-ccca-46aa-b629-a76cc1afd0d0 00:27:42.300 16:11:31 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:27:42.300 16:11:32 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:27:42.558 16:11:32 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:27:42.816 16:11:32 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:42.816 16:11:32 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:42.816 16:11:32 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:27:42.816 16:11:32 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:42.816 16:11:32 -- common/autotest_common.sh@1318 -- # local sanitizers 00:27:42.816 16:11:32 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:42.816 16:11:32 -- common/autotest_common.sh@1320 -- # shift 00:27:42.816 16:11:32 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:27:42.816 16:11:32 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:42.816 16:11:32 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:42.816 16:11:32 -- common/autotest_common.sh@1324 -- # grep libasan 00:27:42.816 16:11:32 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:42.816 16:11:32 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:42.816 16:11:32 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:42.816 16:11:32 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:27:42.816 16:11:32 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:42.816 16:11:32 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:27:42.816 16:11:32 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:27:42.816 16:11:32 -- common/autotest_common.sh@1324 -- # asan_lib= 00:27:42.816 16:11:32 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:27:42.816 16:11:32 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:42.816 16:11:32 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:43.075 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:43.075 fio-3.35 00:27:43.075 Starting 1 thread 00:27:43.075 EAL: No free 2048 kB hugepages reported on node 1 00:27:45.601 00:27:45.601 test: (groupid=0, jobs=1): err= 0: pid=2521828: Wed Oct 30 16:11:35 2024 00:27:45.601 read: IOPS=6129, BW=23.9MiB/s (25.1MB/s)(48.1MiB/2009msec) 00:27:45.601 slat (nsec): min=1806, max=125475, avg=2413.35, stdev=1758.80 00:27:45.601 clat (usec): min=3857, max=19486, avg=11468.04, stdev=1025.71 00:27:45.601 lat (usec): min=3877, max=19488, avg=11470.45, stdev=1025.61 00:27:45.601 clat percentiles (usec): 00:27:45.601 | 1.00th=[ 9110], 5.00th=[ 9765], 10.00th=[10159], 20.00th=[10683], 00:27:45.601 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11469], 60.00th=[11731], 00:27:45.601 | 70.00th=[11994], 80.00th=[12256], 90.00th=[12649], 95.00th=[13042], 00:27:45.601 | 99.00th=[13698], 99.50th=[13960], 99.90th=[15664], 99.95th=[17957], 00:27:45.601 | 99.99th=[19530] 00:27:45.601 bw ( KiB/s): min=23256, max=25024, per=99.94%, avg=24504.00, stdev=835.40, samples=4 00:27:45.601 iops : min= 5814, max= 6256, avg=6126.00, stdev=208.85, samples=4 00:27:45.601 write: IOPS=6113, BW=23.9MiB/s (25.0MB/s)(48.0MiB/2009msec); 0 zone resets 00:27:45.601 slat (nsec): min=1990, max=90046, avg=2567.56, stdev=1372.97 00:27:45.601 clat (usec): min=2722, max=16824, avg=9297.89, stdev=878.78 00:27:45.601 lat (usec): min=2730, max=16826, avg=9300.45, stdev=878.77 00:27:45.601 clat percentiles (usec): 00:27:45.601 | 1.00th=[ 7242], 5.00th=[ 8029], 10.00th=[ 8291], 20.00th=[ 8586], 00:27:45.601 | 30.00th=[ 8848], 40.00th=[ 9110], 50.00th=[ 9241], 60.00th=[ 9503], 00:27:45.601 | 70.00th=[ 9765], 80.00th=[ 9896], 90.00th=[10290], 95.00th=[10683], 00:27:45.601 | 99.00th=[11207], 99.50th=[11469], 99.90th=[15533], 99.95th=[16581], 00:27:45.601 | 99.99th=[16712] 00:27:45.601 bw ( KiB/s): min=24264, max=24552, per=99.92%, avg=24434.00, stdev=121.39, samples=4 00:27:45.601 iops : min= 6066, max= 6138, avg=6108.50, stdev=30.35, samples=4 00:27:45.601 lat (msec) : 4=0.08%, 10=44.12%, 20=55.80% 00:27:45.601 cpu : usr=64.54%, sys=34.16%, ctx=86, majf=0, minf=41 00:27:45.601 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:27:45.601 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:45.601 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:45.601 issued rwts: total=12314,12282,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:45.601 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:45.601 00:27:45.601 Run status group 0 (all jobs): 00:27:45.601 READ: bw=23.9MiB/s (25.1MB/s), 23.9MiB/s-23.9MiB/s (25.1MB/s-25.1MB/s), io=48.1MiB (50.4MB), run=2009-2009msec 00:27:45.601 WRITE: bw=23.9MiB/s (25.0MB/s), 23.9MiB/s-23.9MiB/s (25.0MB/s-25.0MB/s), io=48.0MiB (50.3MB), run=2009-2009msec 00:27:45.601 16:11:35 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:27:45.859 16:11:35 -- host/fio.sh@74 -- # sync 00:27:45.859 16:11:35 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:27:50.038 16:11:39 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:50.038 16:11:39 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:27:53.314 16:11:42 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:53.314 16:11:42 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:27:55.264 16:11:44 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:27:55.264 16:11:44 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:27:55.264 16:11:44 -- host/fio.sh@86 -- # nvmftestfini 00:27:55.264 16:11:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:55.264 16:11:44 -- nvmf/common.sh@116 -- # sync 00:27:55.264 16:11:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:55.264 16:11:44 -- nvmf/common.sh@119 -- # set +e 00:27:55.264 16:11:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:55.264 16:11:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:55.264 rmmod nvme_tcp 00:27:55.264 rmmod nvme_fabrics 00:27:55.264 rmmod nvme_keyring 00:27:55.264 16:11:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:55.264 16:11:44 -- nvmf/common.sh@123 -- # set -e 00:27:55.264 16:11:44 -- nvmf/common.sh@124 -- # return 0 00:27:55.264 16:11:44 -- nvmf/common.sh@477 -- # '[' -n 2518788 ']' 00:27:55.264 16:11:44 -- nvmf/common.sh@478 -- # killprocess 2518788 00:27:55.264 16:11:44 -- common/autotest_common.sh@926 -- # '[' -z 2518788 ']' 00:27:55.264 16:11:44 -- common/autotest_common.sh@930 -- # kill -0 2518788 00:27:55.264 16:11:44 -- common/autotest_common.sh@931 -- # uname 00:27:55.264 16:11:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:55.264 16:11:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2518788 00:27:55.264 16:11:44 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:27:55.264 16:11:44 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:27:55.264 16:11:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2518788' 00:27:55.264 killing process with pid 2518788 00:27:55.264 16:11:44 -- common/autotest_common.sh@945 -- # kill 2518788 00:27:55.264 16:11:44 -- common/autotest_common.sh@950 -- # wait 2518788 00:27:55.264 16:11:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:55.264 16:11:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:55.264 16:11:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:55.264 16:11:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:55.264 16:11:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:55.264 16:11:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:55.264 16:11:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:55.264 16:11:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:57.798 16:11:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:57.798 00:27:57.798 real 0m38.514s 00:27:57.798 user 2m28.102s 00:27:57.798 sys 0m7.122s 00:27:57.798 16:11:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:57.798 16:11:47 -- common/autotest_common.sh@10 -- # set +x 00:27:57.798 ************************************ 00:27:57.798 END TEST nvmf_fio_host 00:27:57.798 ************************************ 00:27:57.798 16:11:47 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:57.798 16:11:47 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:57.798 16:11:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:57.798 16:11:47 -- common/autotest_common.sh@10 -- # set +x 00:27:57.798 ************************************ 00:27:57.798 START TEST nvmf_failover 00:27:57.798 ************************************ 00:27:57.798 16:11:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:57.798 * Looking for test storage... 00:27:57.798 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:57.798 16:11:47 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:57.798 16:11:47 -- nvmf/common.sh@7 -- # uname -s 00:27:57.798 16:11:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:57.798 16:11:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:57.798 16:11:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:57.798 16:11:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:57.798 16:11:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:57.798 16:11:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:57.798 16:11:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:57.798 16:11:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:57.798 16:11:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:57.798 16:11:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:57.798 16:11:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:57.798 16:11:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:57.798 16:11:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:57.798 16:11:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:57.798 16:11:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:57.798 16:11:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:57.798 16:11:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:57.798 16:11:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:57.798 16:11:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:57.798 16:11:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.798 16:11:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.798 16:11:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.798 16:11:47 -- paths/export.sh@5 -- # export PATH 00:27:57.798 16:11:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.798 16:11:47 -- nvmf/common.sh@46 -- # : 0 00:27:57.798 16:11:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:57.798 16:11:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:57.798 16:11:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:57.798 16:11:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:57.798 16:11:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:57.798 16:11:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:57.798 16:11:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:57.798 16:11:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:57.798 16:11:47 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:57.798 16:11:47 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:57.798 16:11:47 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:57.798 16:11:47 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:27:57.798 16:11:47 -- host/failover.sh@18 -- # nvmftestinit 00:27:57.798 16:11:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:57.799 16:11:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:57.799 16:11:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:57.799 16:11:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:57.799 16:11:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:57.799 16:11:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:57.799 16:11:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:57.799 16:11:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:57.799 16:11:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:57.799 16:11:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:57.799 16:11:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:57.799 16:11:47 -- common/autotest_common.sh@10 -- # set +x 00:27:59.699 16:11:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:59.699 16:11:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:59.699 16:11:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:59.699 16:11:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:59.699 16:11:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:59.699 16:11:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:59.699 16:11:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:59.699 16:11:49 -- nvmf/common.sh@294 -- # net_devs=() 00:27:59.699 16:11:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:59.699 16:11:49 -- nvmf/common.sh@295 -- # e810=() 00:27:59.699 16:11:49 -- nvmf/common.sh@295 -- # local -ga e810 00:27:59.699 16:11:49 -- nvmf/common.sh@296 -- # x722=() 00:27:59.699 16:11:49 -- nvmf/common.sh@296 -- # local -ga x722 00:27:59.699 16:11:49 -- nvmf/common.sh@297 -- # mlx=() 00:27:59.699 16:11:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:59.699 16:11:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:59.699 16:11:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:59.699 16:11:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:59.699 16:11:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:59.699 16:11:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:59.699 16:11:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:59.699 16:11:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:59.699 16:11:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:59.699 16:11:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:59.699 16:11:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:59.699 16:11:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:59.699 16:11:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:59.699 16:11:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:59.699 16:11:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:59.699 16:11:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:59.699 16:11:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:59.699 16:11:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:59.699 16:11:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:59.700 16:11:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:59.700 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:59.700 16:11:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:59.700 16:11:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:59.700 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:59.700 16:11:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:59.700 16:11:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:59.700 16:11:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:59.700 16:11:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:59.700 16:11:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:59.700 16:11:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:59.700 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:59.700 16:11:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:59.700 16:11:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:59.700 16:11:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:59.700 16:11:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:59.700 16:11:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:59.700 16:11:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:59.700 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:59.700 16:11:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:59.700 16:11:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:59.700 16:11:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:59.700 16:11:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:59.700 16:11:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:59.700 16:11:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:59.700 16:11:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:59.700 16:11:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:59.700 16:11:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:59.700 16:11:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:59.700 16:11:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:59.700 16:11:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:59.700 16:11:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:59.700 16:11:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:59.700 16:11:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:59.700 16:11:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:59.700 16:11:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:59.700 16:11:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:59.700 16:11:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:59.700 16:11:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:59.700 16:11:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:59.700 16:11:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:59.700 16:11:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:59.700 16:11:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:59.700 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:59.700 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.339 ms 00:27:59.700 00:27:59.700 --- 10.0.0.2 ping statistics --- 00:27:59.700 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:59.700 rtt min/avg/max/mdev = 0.339/0.339/0.339/0.000 ms 00:27:59.700 16:11:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:59.700 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:59.700 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.180 ms 00:27:59.700 00:27:59.700 --- 10.0.0.1 ping statistics --- 00:27:59.700 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:59.700 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:27:59.700 16:11:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:59.700 16:11:49 -- nvmf/common.sh@410 -- # return 0 00:27:59.700 16:11:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:59.700 16:11:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:59.700 16:11:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:59.700 16:11:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:59.700 16:11:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:59.700 16:11:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:59.700 16:11:49 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:27:59.700 16:11:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:59.700 16:11:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:59.700 16:11:49 -- common/autotest_common.sh@10 -- # set +x 00:27:59.700 16:11:49 -- nvmf/common.sh@469 -- # nvmfpid=2525138 00:27:59.700 16:11:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:59.700 16:11:49 -- nvmf/common.sh@470 -- # waitforlisten 2525138 00:27:59.700 16:11:49 -- common/autotest_common.sh@819 -- # '[' -z 2525138 ']' 00:27:59.700 16:11:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:59.700 16:11:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:59.700 16:11:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:59.700 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:59.700 16:11:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:59.700 16:11:49 -- common/autotest_common.sh@10 -- # set +x 00:27:59.700 [2024-10-30 16:11:49.439864] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:27:59.700 [2024-10-30 16:11:49.439938] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:59.700 EAL: No free 2048 kB hugepages reported on node 1 00:27:59.700 [2024-10-30 16:11:49.515806] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:59.964 [2024-10-30 16:11:49.608429] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:59.965 [2024-10-30 16:11:49.608595] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:59.965 [2024-10-30 16:11:49.608621] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:59.965 [2024-10-30 16:11:49.608640] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:59.965 [2024-10-30 16:11:49.608703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:59.965 [2024-10-30 16:11:49.608786] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:59.965 [2024-10-30 16:11:49.608770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:00.900 16:11:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:00.900 16:11:50 -- common/autotest_common.sh@852 -- # return 0 00:28:00.900 16:11:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:00.900 16:11:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:00.900 16:11:50 -- common/autotest_common.sh@10 -- # set +x 00:28:00.900 16:11:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:00.900 16:11:50 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:00.900 [2024-10-30 16:11:50.775536] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:01.158 16:11:50 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:01.415 Malloc0 00:28:01.415 16:11:51 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:01.673 16:11:51 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:01.930 16:11:51 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:02.189 [2024-10-30 16:11:51.822507] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:02.189 16:11:51 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:02.446 [2024-10-30 16:11:52.079324] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:02.446 16:11:52 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:02.704 [2024-10-30 16:11:52.328146] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:02.704 16:11:52 -- host/failover.sh@31 -- # bdevperf_pid=2525555 00:28:02.704 16:11:52 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:02.704 16:11:52 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:02.704 16:11:52 -- host/failover.sh@34 -- # waitforlisten 2525555 /var/tmp/bdevperf.sock 00:28:02.704 16:11:52 -- common/autotest_common.sh@819 -- # '[' -z 2525555 ']' 00:28:02.704 16:11:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:02.704 16:11:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:02.704 16:11:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:02.704 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:02.704 16:11:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:02.704 16:11:52 -- common/autotest_common.sh@10 -- # set +x 00:28:03.638 16:11:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:03.638 16:11:53 -- common/autotest_common.sh@852 -- # return 0 00:28:03.638 16:11:53 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:03.895 NVMe0n1 00:28:03.896 16:11:53 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:04.461 00:28:04.461 16:11:54 -- host/failover.sh@39 -- # run_test_pid=2525824 00:28:04.461 16:11:54 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:04.461 16:11:54 -- host/failover.sh@41 -- # sleep 1 00:28:05.395 16:11:55 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:05.655 [2024-10-30 16:11:55.369141] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369234] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369250] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369289] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369302] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369315] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369327] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369339] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369351] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369363] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369375] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369386] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369398] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369410] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369422] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369434] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369445] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369457] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369469] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369481] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369492] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369504] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369516] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369527] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369540] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369560] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369588] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369599] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369611] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369623] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369635] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369646] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369658] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369669] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369682] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369693] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369715] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369727] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 [2024-10-30 16:11:55.369738] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd46930 is same with the state(5) to be set 00:28:05.655 16:11:55 -- host/failover.sh@45 -- # sleep 3 00:28:08.936 16:11:58 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:08.936 00:28:08.936 16:11:58 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:09.195 [2024-10-30 16:11:58.983106] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983184] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983208] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983226] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983245] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983286] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983307] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983325] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983358] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983382] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983415] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983436] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983456] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983476] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983496] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983514] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983535] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983555] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983577] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983597] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983616] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983636] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983654] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983673] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983694] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983713] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983733] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983751] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983770] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983789] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983807] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983839] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983856] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983875] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983897] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 [2024-10-30 16:11:58.983918] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd477c0 is same with the state(5) to be set 00:28:09.195 16:11:59 -- host/failover.sh@50 -- # sleep 3 00:28:12.476 16:12:02 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:12.476 [2024-10-30 16:12:02.252715] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:12.476 16:12:02 -- host/failover.sh@55 -- # sleep 1 00:28:13.412 16:12:03 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:13.671 [2024-10-30 16:12:03.541988] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542049] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542071] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542090] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542108] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542125] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542143] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542161] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542180] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542197] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542216] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542268] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542290] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542310] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542330] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.671 [2024-10-30 16:12:03.542349] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd48310 is same with the state(5) to be set 00:28:13.929 16:12:03 -- host/failover.sh@59 -- # wait 2525824 00:28:20.489 0 00:28:20.489 16:12:09 -- host/failover.sh@61 -- # killprocess 2525555 00:28:20.489 16:12:09 -- common/autotest_common.sh@926 -- # '[' -z 2525555 ']' 00:28:20.489 16:12:09 -- common/autotest_common.sh@930 -- # kill -0 2525555 00:28:20.489 16:12:09 -- common/autotest_common.sh@931 -- # uname 00:28:20.489 16:12:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:20.489 16:12:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2525555 00:28:20.489 16:12:09 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:20.489 16:12:09 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:20.489 16:12:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2525555' 00:28:20.489 killing process with pid 2525555 00:28:20.489 16:12:09 -- common/autotest_common.sh@945 -- # kill 2525555 00:28:20.489 16:12:09 -- common/autotest_common.sh@950 -- # wait 2525555 00:28:20.489 16:12:09 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:20.489 [2024-10-30 16:11:52.389132] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:28:20.489 [2024-10-30 16:11:52.389212] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2525555 ] 00:28:20.489 EAL: No free 2048 kB hugepages reported on node 1 00:28:20.489 [2024-10-30 16:11:52.448547] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:20.489 [2024-10-30 16:11:52.531746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:20.489 Running I/O for 15 seconds... 00:28:20.489 [2024-10-30 16:11:55.370024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:115936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.489 [2024-10-30 16:11:55.370067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.489 [2024-10-30 16:11:55.370096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:115952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.489 [2024-10-30 16:11:55.370113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.489 [2024-10-30 16:11:55.370131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:115960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.489 [2024-10-30 16:11:55.370145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.489 [2024-10-30 16:11:55.370162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:115304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.489 [2024-10-30 16:11:55.370176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:115312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:115320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:115336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:115344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:115352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:115368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:115376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:115984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:116000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:116016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:116048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:116056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:116080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:116096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:116104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:116120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:116128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:115392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:115408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:115416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:115424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:115456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:115488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:115504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:115512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:116144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.370980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:115520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.370993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:115536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:115552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:115624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:115632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:115640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:115648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:115656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:116160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:116168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:116184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:116192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.490 [2024-10-30 16:11:55.371343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:116200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.490 [2024-10-30 16:11:55.371372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:116216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.490 [2024-10-30 16:11:55.371429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:116224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:116232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:116240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.490 [2024-10-30 16:11:55.371515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:116248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.490 [2024-10-30 16:11:55.371552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:116256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:116264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.490 [2024-10-30 16:11:55.371627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.490 [2024-10-30 16:11:55.371641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:116272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.371654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.371668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:116280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.371682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.371697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:115688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.371709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.371724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:115696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.371738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.371753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:115704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.371766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.371780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:115728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.371794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.371809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:115744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.371822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.371837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:115784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.371850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.371864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:115800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.371877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.371892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:115808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.371905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.371924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:116288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.371938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.371952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:116296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.371966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.371981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:116304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.371994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:116312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:116320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:116328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:116336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:116344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:116352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:116360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:116368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:116376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:116384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:116392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:116400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:116408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:116416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:116424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:116432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:116440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:116448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:115832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:115840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:115848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:115856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:115872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:115880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:115896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:115920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:116456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:116464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:116472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:116480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:116488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.372921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:116496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:116504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.491 [2024-10-30 16:11:55.372975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.372989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:116512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.491 [2024-10-30 16:11:55.373002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.491 [2024-10-30 16:11:55.373016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:116520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.492 [2024-10-30 16:11:55.373029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:116528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.492 [2024-10-30 16:11:55.373061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:115928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:115944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:115968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:115976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:115992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:116008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:116024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:116032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:116536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:116544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.492 [2024-10-30 16:11:55.373579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:116552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.492 [2024-10-30 16:11:55.373607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:116560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:116568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:116576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:116584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.492 [2024-10-30 16:11:55.373745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:116592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:116600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.492 [2024-10-30 16:11:55.373800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:116608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.492 [2024-10-30 16:11:55.373827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:116616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:116624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.492 [2024-10-30 16:11:55.373882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:116040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:116064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:116072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.373977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:116088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.373991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.374009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:116112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.374022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.374036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:116136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.374048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.374063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:116152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:55.374076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.374090] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1155c60 is same with the state(5) to be set 00:28:20.492 [2024-10-30 16:11:55.374107] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:20.492 [2024-10-30 16:11:55.374118] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:20.492 [2024-10-30 16:11:55.374134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116176 len:8 PRP1 0x0 PRP2 0x0 00:28:20.492 [2024-10-30 16:11:55.374147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.374208] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1155c60 was disconnected and freed. reset controller. 00:28:20.492 [2024-10-30 16:11:55.374232] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:20.492 [2024-10-30 16:11:55.374289] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.492 [2024-10-30 16:11:55.374309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.374324] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.492 [2024-10-30 16:11:55.374338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.374351] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.492 [2024-10-30 16:11:55.374364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.374378] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.492 [2024-10-30 16:11:55.374391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:55.374404] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:20.492 [2024-10-30 16:11:55.374444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1137000 (9): Bad file descriptor 00:28:20.492 [2024-10-30 16:11:55.376686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:20.492 [2024-10-30 16:11:55.451801] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:20.492 [2024-10-30 16:11:58.984069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:120296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:58.984114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:58.984152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:120312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:58.984169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:58.984187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:119680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:58.984202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:58.984218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:119688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:58.984232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:58.984247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:119704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:58.984269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:58.984287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:119752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:58.984301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:58.984317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:119784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:58.984331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:58.984345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:119792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.492 [2024-10-30 16:11:58.984359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.492 [2024-10-30 16:11:58.984375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:119808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:119816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:120320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:120336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:120352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:120368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:120376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:120384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:120392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:120400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:120408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:120416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:120424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.493 [2024-10-30 16:11:58.984762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:120432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.493 [2024-10-30 16:11:58.984788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:120440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.493 [2024-10-30 16:11:58.984815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:120448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:120456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.493 [2024-10-30 16:11:58.984869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:120464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:120472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.493 [2024-10-30 16:11:58.984926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:120480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.493 [2024-10-30 16:11:58.984953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:120488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.984980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.984994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:120496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.493 [2024-10-30 16:11:58.985007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:120504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:120512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.493 [2024-10-30 16:11:58.985062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:120520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.493 [2024-10-30 16:11:58.985088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:119824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:119832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:119872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:119904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:119920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:119944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:119952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:119960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:119968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:119984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:120016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:120040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:120056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:120072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:120080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:120104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:120528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.493 [2024-10-30 16:11:58.985603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:120536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.493 [2024-10-30 16:11:58.985630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.493 [2024-10-30 16:11:58.985644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:120544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.985661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.985675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:120552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.985689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.985703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:120560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.985716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.985729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:120568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.985742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.985756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:120576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.985769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.985783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:120584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.985796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.985809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:120592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.985822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.985836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:120600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.985848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.985862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:120608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.985875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.985889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:120616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.985902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.985916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:120624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.985929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.985943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:120632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.985955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.985970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:120640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.985982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:120648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:120656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:120664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:120672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:120680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:120688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:120696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:120704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:120712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:120720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:120728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:120736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:120744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:120752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:120760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:120768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:120776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:120784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:120792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:120800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:120808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:120816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:120824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:120832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:120840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:120848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:120856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:120864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:120872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:120880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:120888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:120896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:120904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.494 [2024-10-30 16:11:58.986935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.494 [2024-10-30 16:11:58.986950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:120912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.494 [2024-10-30 16:11:58.986963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.986976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:120920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.986989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:120928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:120936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.495 [2024-10-30 16:11:58.987042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:120944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.495 [2024-10-30 16:11:58.987072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:120952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:120128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:120136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:120144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:120160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:120184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:120208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:120240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:120256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:120960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:120968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:120976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.495 [2024-10-30 16:11:58.987430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:120984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.495 [2024-10-30 16:11:58.987462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:120992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:121000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.495 [2024-10-30 16:11:58.987517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:121008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:121016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:121024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:120264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:120272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:120280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:120288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:120304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:120328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:120344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:11:58.987805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11434b0 is same with the state(5) to be set 00:28:20.495 [2024-10-30 16:11:58.987836] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:20.495 [2024-10-30 16:11:58.987846] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:20.495 [2024-10-30 16:11:58.987863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:120360 len:8 PRP1 0x0 PRP2 0x0 00:28:20.495 [2024-10-30 16:11:58.987875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.987937] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x11434b0 was disconnected and freed. reset controller. 00:28:20.495 [2024-10-30 16:11:58.987954] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:20.495 [2024-10-30 16:11:58.987988] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.495 [2024-10-30 16:11:58.988020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.988036] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.495 [2024-10-30 16:11:58.988049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.988062] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.495 [2024-10-30 16:11:58.988075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.988088] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.495 [2024-10-30 16:11:58.988101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:11:58.988115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:20.495 [2024-10-30 16:11:58.990384] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:20.495 [2024-10-30 16:11:58.990426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1137000 (9): Bad file descriptor 00:28:20.495 [2024-10-30 16:11:59.022712] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:20.495 [2024-10-30 16:12:03.542479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:43360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:12:03.542521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:12:03.542577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:43368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:12:03.542594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:12:03.542611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:43376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:12:03.542625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:12:03.542640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:43384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:12:03.542653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:12:03.542679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:43400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:12:03.542693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:12:03.542708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:43408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:12:03.542736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:12:03.542751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:43416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:12:03.542764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:12:03.542778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:43432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:12:03.542791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:12:03.542805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:44008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:12:03.542818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:12:03.542832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:44016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.495 [2024-10-30 16:12:03.542845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.495 [2024-10-30 16:12:03.542860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:44024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.542872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.542887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:44032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.542899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.542914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:44056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.542927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.542942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:44064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.542955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.542970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:44088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.542983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.542997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:44096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:44104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:44128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.543078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:44136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:44144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.543132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:44152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.543160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:44160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.543187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:44168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.543214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:44176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:43480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:43496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:43520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:43528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:43536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:43544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:43584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:43600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:43608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:43616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:43632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:43664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:43744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:43768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:43816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:44184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:44192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:44200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:44208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.543844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:44216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.543870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:44224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:44232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.543924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:44240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:44248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.543978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.543993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:44256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.544005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.544019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:44264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.544031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.544046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:44272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.496 [2024-10-30 16:12:03.544058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.544072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:44280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.544085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.544099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:44288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.544112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.544130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:44296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.544143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.544157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:44304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.544170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.544184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:44312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.496 [2024-10-30 16:12:03.544197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.496 [2024-10-30 16:12:03.544212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:44320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.544225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:44328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:44336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:44344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:44352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:44360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:44368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:44376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.544453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:44384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.544481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:44392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:44400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:44408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:44416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.544597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:44424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:44432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:44440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:44448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:44456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:44464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.544771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:44472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:44480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:44488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.544850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:44496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.544880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:44504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.544909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:44512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.544937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:44520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.544964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.544978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:43824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.544991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:43832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.545017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:43848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.545044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:43856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.545070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:43872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.545096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:43912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.545123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:43936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.545149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:43968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.545175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:44528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.545202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:44536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.545249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:44544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.545288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:44552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.545316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:44560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.545343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:44568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.545377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:44576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.545406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:44584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.497 [2024-10-30 16:12:03.545433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.497 [2024-10-30 16:12:03.545448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:44592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.497 [2024-10-30 16:12:03.545461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:44600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.498 [2024-10-30 16:12:03.545488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:44608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.498 [2024-10-30 16:12:03.545516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:44616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.498 [2024-10-30 16:12:03.545543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:44624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.545586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:44632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.498 [2024-10-30 16:12:03.545620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:44640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.498 [2024-10-30 16:12:03.545665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:44648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.545693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:44656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.545737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:44664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.545765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:44672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.498 [2024-10-30 16:12:03.545794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:44680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.545822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:44688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.498 [2024-10-30 16:12:03.545851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:44696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.545885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:44704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.498 [2024-10-30 16:12:03.545914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:44712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.545943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:44720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.545971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.545987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:44728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.498 [2024-10-30 16:12:03.546000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:44736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.546032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:44744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.546061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:44752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.546090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:43992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.546119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:44000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.546147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:44040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.546175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:44048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.546204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:44072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.546233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:44080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.546270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:44112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.498 [2024-10-30 16:12:03.546299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546314] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11594b0 is same with the state(5) to be set 00:28:20.498 [2024-10-30 16:12:03.546331] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:20.498 [2024-10-30 16:12:03.546343] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:20.498 [2024-10-30 16:12:03.546360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:44120 len:8 PRP1 0x0 PRP2 0x0 00:28:20.498 [2024-10-30 16:12:03.546373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546436] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x11594b0 was disconnected and freed. reset controller. 00:28:20.498 [2024-10-30 16:12:03.546454] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:20.498 [2024-10-30 16:12:03.546494] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.498 [2024-10-30 16:12:03.546512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546527] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.498 [2024-10-30 16:12:03.546540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546553] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.498 [2024-10-30 16:12:03.546566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546580] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.498 [2024-10-30 16:12:03.546593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.498 [2024-10-30 16:12:03.546606] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:20.498 [2024-10-30 16:12:03.546656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1137000 (9): Bad file descriptor 00:28:20.498 [2024-10-30 16:12:03.548913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:20.498 [2024-10-30 16:12:03.580531] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:20.498 00:28:20.498 Latency(us) 00:28:20.498 [2024-10-30T15:12:10.374Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:20.498 [2024-10-30T15:12:10.374Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:20.498 Verification LBA range: start 0x0 length 0x4000 00:28:20.498 NVMe0n1 : 15.01 12187.70 47.61 523.82 0.00 10052.39 682.67 15534.46 00:28:20.498 [2024-10-30T15:12:10.374Z] =================================================================================================================== 00:28:20.498 [2024-10-30T15:12:10.374Z] Total : 12187.70 47.61 523.82 0.00 10052.39 682.67 15534.46 00:28:20.498 Received shutdown signal, test time was about 15.000000 seconds 00:28:20.498 00:28:20.498 Latency(us) 00:28:20.498 [2024-10-30T15:12:10.374Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:20.498 [2024-10-30T15:12:10.374Z] =================================================================================================================== 00:28:20.498 [2024-10-30T15:12:10.374Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:20.498 16:12:09 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:20.498 16:12:09 -- host/failover.sh@65 -- # count=3 00:28:20.498 16:12:09 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:20.498 16:12:09 -- host/failover.sh@73 -- # bdevperf_pid=2528222 00:28:20.498 16:12:09 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:20.498 16:12:09 -- host/failover.sh@75 -- # waitforlisten 2528222 /var/tmp/bdevperf.sock 00:28:20.498 16:12:09 -- common/autotest_common.sh@819 -- # '[' -z 2528222 ']' 00:28:20.498 16:12:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:20.498 16:12:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:20.498 16:12:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:20.498 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:20.498 16:12:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:20.498 16:12:09 -- common/autotest_common.sh@10 -- # set +x 00:28:20.755 16:12:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:20.755 16:12:10 -- common/autotest_common.sh@852 -- # return 0 00:28:20.755 16:12:10 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:21.013 [2024-10-30 16:12:10.798139] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:21.013 16:12:10 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:21.271 [2024-10-30 16:12:11.058861] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:21.271 16:12:11 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:21.836 NVMe0n1 00:28:21.836 16:12:11 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:22.094 00:28:22.094 16:12:11 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:22.351 00:28:22.609 16:12:12 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:22.609 16:12:12 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:22.609 16:12:12 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:22.867 16:12:12 -- host/failover.sh@87 -- # sleep 3 00:28:26.144 16:12:15 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:26.145 16:12:15 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:26.402 16:12:16 -- host/failover.sh@90 -- # run_test_pid=2529039 00:28:26.402 16:12:16 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:26.402 16:12:16 -- host/failover.sh@92 -- # wait 2529039 00:28:27.333 0 00:28:27.333 16:12:17 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:27.333 [2024-10-30 16:12:09.583800] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:28:27.333 [2024-10-30 16:12:09.583886] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2528222 ] 00:28:27.334 EAL: No free 2048 kB hugepages reported on node 1 00:28:27.334 [2024-10-30 16:12:09.643885] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:27.334 [2024-10-30 16:12:09.725727] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:27.334 [2024-10-30 16:12:12.700357] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:27.334 [2024-10-30 16:12:12.700445] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:27.334 [2024-10-30 16:12:12.700469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:27.334 [2024-10-30 16:12:12.700487] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:27.334 [2024-10-30 16:12:12.700501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:27.334 [2024-10-30 16:12:12.700516] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:27.334 [2024-10-30 16:12:12.700529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:27.334 [2024-10-30 16:12:12.700543] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:27.334 [2024-10-30 16:12:12.700556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:27.334 [2024-10-30 16:12:12.700570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:27.334 [2024-10-30 16:12:12.700608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:27.334 [2024-10-30 16:12:12.700639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2000000 (9): Bad file descriptor 00:28:27.334 [2024-10-30 16:12:12.753532] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:27.334 Running I/O for 1 seconds... 00:28:27.334 00:28:27.334 Latency(us) 00:28:27.334 [2024-10-30T15:12:17.210Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:27.334 [2024-10-30T15:12:17.210Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:27.334 Verification LBA range: start 0x0 length 0x4000 00:28:27.334 NVMe0n1 : 1.01 11982.35 46.81 0.00 0.00 10629.98 1953.94 11650.84 00:28:27.334 [2024-10-30T15:12:17.210Z] =================================================================================================================== 00:28:27.334 [2024-10-30T15:12:17.210Z] Total : 11982.35 46.81 0.00 0.00 10629.98 1953.94 11650.84 00:28:27.334 16:12:17 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:27.334 16:12:17 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:27.591 16:12:17 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:27.848 16:12:17 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:27.848 16:12:17 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:28.105 16:12:17 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:28.363 16:12:18 -- host/failover.sh@101 -- # sleep 3 00:28:31.639 16:12:21 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:31.639 16:12:21 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:31.639 16:12:21 -- host/failover.sh@108 -- # killprocess 2528222 00:28:31.639 16:12:21 -- common/autotest_common.sh@926 -- # '[' -z 2528222 ']' 00:28:31.639 16:12:21 -- common/autotest_common.sh@930 -- # kill -0 2528222 00:28:31.639 16:12:21 -- common/autotest_common.sh@931 -- # uname 00:28:31.639 16:12:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:31.639 16:12:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2528222 00:28:31.897 16:12:21 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:28:31.897 16:12:21 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:28:31.897 16:12:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2528222' 00:28:31.897 killing process with pid 2528222 00:28:31.897 16:12:21 -- common/autotest_common.sh@945 -- # kill 2528222 00:28:31.898 16:12:21 -- common/autotest_common.sh@950 -- # wait 2528222 00:28:31.898 16:12:21 -- host/failover.sh@110 -- # sync 00:28:32.156 16:12:21 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:32.413 16:12:22 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:32.413 16:12:22 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:32.413 16:12:22 -- host/failover.sh@116 -- # nvmftestfini 00:28:32.413 16:12:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:32.413 16:12:22 -- nvmf/common.sh@116 -- # sync 00:28:32.413 16:12:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:32.413 16:12:22 -- nvmf/common.sh@119 -- # set +e 00:28:32.413 16:12:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:32.413 16:12:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:32.413 rmmod nvme_tcp 00:28:32.413 rmmod nvme_fabrics 00:28:32.413 rmmod nvme_keyring 00:28:32.413 16:12:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:32.413 16:12:22 -- nvmf/common.sh@123 -- # set -e 00:28:32.413 16:12:22 -- nvmf/common.sh@124 -- # return 0 00:28:32.413 16:12:22 -- nvmf/common.sh@477 -- # '[' -n 2525138 ']' 00:28:32.413 16:12:22 -- nvmf/common.sh@478 -- # killprocess 2525138 00:28:32.413 16:12:22 -- common/autotest_common.sh@926 -- # '[' -z 2525138 ']' 00:28:32.413 16:12:22 -- common/autotest_common.sh@930 -- # kill -0 2525138 00:28:32.413 16:12:22 -- common/autotest_common.sh@931 -- # uname 00:28:32.413 16:12:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:32.413 16:12:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2525138 00:28:32.413 16:12:22 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:32.413 16:12:22 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:32.413 16:12:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2525138' 00:28:32.413 killing process with pid 2525138 00:28:32.413 16:12:22 -- common/autotest_common.sh@945 -- # kill 2525138 00:28:32.413 16:12:22 -- common/autotest_common.sh@950 -- # wait 2525138 00:28:32.672 16:12:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:32.672 16:12:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:32.672 16:12:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:32.672 16:12:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:32.672 16:12:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:32.672 16:12:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:32.672 16:12:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:32.672 16:12:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:34.616 16:12:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:34.616 00:28:34.616 real 0m37.233s 00:28:34.616 user 2m10.557s 00:28:34.616 sys 0m6.806s 00:28:34.616 16:12:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:34.616 16:12:24 -- common/autotest_common.sh@10 -- # set +x 00:28:34.616 ************************************ 00:28:34.616 END TEST nvmf_failover 00:28:34.616 ************************************ 00:28:34.616 16:12:24 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:34.616 16:12:24 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:28:34.616 16:12:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:34.616 16:12:24 -- common/autotest_common.sh@10 -- # set +x 00:28:34.616 ************************************ 00:28:34.616 START TEST nvmf_discovery 00:28:34.616 ************************************ 00:28:34.616 16:12:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:34.900 * Looking for test storage... 00:28:34.900 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:34.900 16:12:24 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:34.900 16:12:24 -- nvmf/common.sh@7 -- # uname -s 00:28:34.900 16:12:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:34.900 16:12:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:34.900 16:12:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:34.900 16:12:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:34.900 16:12:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:34.900 16:12:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:34.900 16:12:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:34.900 16:12:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:34.900 16:12:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:34.900 16:12:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:34.900 16:12:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:34.900 16:12:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:34.900 16:12:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:34.900 16:12:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:34.901 16:12:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:34.901 16:12:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:34.901 16:12:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:34.901 16:12:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:34.901 16:12:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:34.901 16:12:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:34.901 16:12:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:34.901 16:12:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:34.901 16:12:24 -- paths/export.sh@5 -- # export PATH 00:28:34.901 16:12:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:34.901 16:12:24 -- nvmf/common.sh@46 -- # : 0 00:28:34.901 16:12:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:34.901 16:12:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:34.901 16:12:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:34.901 16:12:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:34.901 16:12:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:34.901 16:12:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:34.901 16:12:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:34.901 16:12:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:34.901 16:12:24 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:34.901 16:12:24 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:34.901 16:12:24 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:34.901 16:12:24 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:34.901 16:12:24 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:34.901 16:12:24 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:34.901 16:12:24 -- host/discovery.sh@25 -- # nvmftestinit 00:28:34.901 16:12:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:34.901 16:12:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:34.901 16:12:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:34.901 16:12:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:34.901 16:12:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:34.901 16:12:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:34.901 16:12:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:34.901 16:12:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:34.901 16:12:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:34.901 16:12:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:34.901 16:12:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:34.901 16:12:24 -- common/autotest_common.sh@10 -- # set +x 00:28:36.809 16:12:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:36.809 16:12:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:36.809 16:12:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:36.809 16:12:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:36.809 16:12:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:36.809 16:12:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:36.809 16:12:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:36.809 16:12:26 -- nvmf/common.sh@294 -- # net_devs=() 00:28:36.809 16:12:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:36.809 16:12:26 -- nvmf/common.sh@295 -- # e810=() 00:28:36.809 16:12:26 -- nvmf/common.sh@295 -- # local -ga e810 00:28:36.809 16:12:26 -- nvmf/common.sh@296 -- # x722=() 00:28:36.809 16:12:26 -- nvmf/common.sh@296 -- # local -ga x722 00:28:36.809 16:12:26 -- nvmf/common.sh@297 -- # mlx=() 00:28:36.809 16:12:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:36.809 16:12:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:36.809 16:12:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:36.809 16:12:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:36.809 16:12:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:36.809 16:12:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:36.809 16:12:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:36.809 16:12:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:36.809 16:12:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:36.809 16:12:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:36.809 16:12:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:36.809 16:12:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:36.809 16:12:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:36.809 16:12:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:36.809 16:12:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:36.809 16:12:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:36.809 16:12:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:36.809 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:36.809 16:12:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:36.809 16:12:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:36.809 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:36.809 16:12:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:36.809 16:12:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:36.809 16:12:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:36.809 16:12:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:36.809 16:12:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:36.809 16:12:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:36.809 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:36.809 16:12:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:36.809 16:12:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:36.809 16:12:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:36.809 16:12:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:36.809 16:12:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:36.809 16:12:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:36.809 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:36.809 16:12:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:36.809 16:12:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:36.809 16:12:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:36.809 16:12:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:36.809 16:12:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:36.809 16:12:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:36.809 16:12:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:36.809 16:12:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:36.809 16:12:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:36.809 16:12:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:36.809 16:12:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:36.809 16:12:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:36.809 16:12:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:36.809 16:12:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:36.809 16:12:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:36.809 16:12:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:36.809 16:12:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:36.809 16:12:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:36.809 16:12:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:36.809 16:12:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:36.809 16:12:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:36.809 16:12:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:36.809 16:12:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:36.810 16:12:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:36.810 16:12:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:36.810 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:36.810 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:28:36.810 00:28:36.810 --- 10.0.0.2 ping statistics --- 00:28:36.810 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:36.810 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:28:36.810 16:12:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:36.810 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:36.810 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:28:36.810 00:28:36.810 --- 10.0.0.1 ping statistics --- 00:28:36.810 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:36.810 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:28:36.810 16:12:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:36.810 16:12:26 -- nvmf/common.sh@410 -- # return 0 00:28:36.810 16:12:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:36.810 16:12:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:36.810 16:12:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:36.810 16:12:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:36.810 16:12:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:36.810 16:12:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:36.810 16:12:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:36.810 16:12:26 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:28:36.810 16:12:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:36.810 16:12:26 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:36.810 16:12:26 -- common/autotest_common.sh@10 -- # set +x 00:28:36.810 16:12:26 -- nvmf/common.sh@469 -- # nvmfpid=2531676 00:28:36.810 16:12:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:36.810 16:12:26 -- nvmf/common.sh@470 -- # waitforlisten 2531676 00:28:36.810 16:12:26 -- common/autotest_common.sh@819 -- # '[' -z 2531676 ']' 00:28:36.810 16:12:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:36.810 16:12:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:36.810 16:12:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:36.810 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:36.810 16:12:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:36.810 16:12:26 -- common/autotest_common.sh@10 -- # set +x 00:28:36.810 [2024-10-30 16:12:26.615031] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:28:36.810 [2024-10-30 16:12:26.615110] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:36.810 EAL: No free 2048 kB hugepages reported on node 1 00:28:36.810 [2024-10-30 16:12:26.681762] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:37.069 [2024-10-30 16:12:26.769059] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:37.069 [2024-10-30 16:12:26.769228] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:37.069 [2024-10-30 16:12:26.769277] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:37.069 [2024-10-30 16:12:26.769298] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:37.070 [2024-10-30 16:12:26.769345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:38.010 16:12:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:38.010 16:12:27 -- common/autotest_common.sh@852 -- # return 0 00:28:38.010 16:12:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:38.010 16:12:27 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:38.010 16:12:27 -- common/autotest_common.sh@10 -- # set +x 00:28:38.010 16:12:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:38.010 16:12:27 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:38.010 16:12:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:38.010 16:12:27 -- common/autotest_common.sh@10 -- # set +x 00:28:38.010 [2024-10-30 16:12:27.612218] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:38.010 16:12:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:38.010 16:12:27 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:28:38.010 16:12:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:38.010 16:12:27 -- common/autotest_common.sh@10 -- # set +x 00:28:38.010 [2024-10-30 16:12:27.620453] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:38.010 16:12:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:38.010 16:12:27 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:28:38.010 16:12:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:38.010 16:12:27 -- common/autotest_common.sh@10 -- # set +x 00:28:38.010 null0 00:28:38.010 16:12:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:38.010 16:12:27 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:28:38.010 16:12:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:38.010 16:12:27 -- common/autotest_common.sh@10 -- # set +x 00:28:38.010 null1 00:28:38.010 16:12:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:38.010 16:12:27 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:28:38.010 16:12:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:38.010 16:12:27 -- common/autotest_common.sh@10 -- # set +x 00:28:38.010 16:12:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:38.010 16:12:27 -- host/discovery.sh@45 -- # hostpid=2531828 00:28:38.010 16:12:27 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:28:38.010 16:12:27 -- host/discovery.sh@46 -- # waitforlisten 2531828 /tmp/host.sock 00:28:38.010 16:12:27 -- common/autotest_common.sh@819 -- # '[' -z 2531828 ']' 00:28:38.010 16:12:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:28:38.010 16:12:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:38.010 16:12:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:38.010 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:38.010 16:12:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:38.010 16:12:27 -- common/autotest_common.sh@10 -- # set +x 00:28:38.010 [2024-10-30 16:12:27.690792] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:28:38.010 [2024-10-30 16:12:27.690858] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2531828 ] 00:28:38.010 EAL: No free 2048 kB hugepages reported on node 1 00:28:38.010 [2024-10-30 16:12:27.752007] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:38.010 [2024-10-30 16:12:27.849660] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:38.010 [2024-10-30 16:12:27.849820] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:38.944 16:12:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:38.945 16:12:28 -- common/autotest_common.sh@852 -- # return 0 00:28:38.945 16:12:28 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:38.945 16:12:28 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:28:38.945 16:12:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:38.945 16:12:28 -- common/autotest_common.sh@10 -- # set +x 00:28:38.945 16:12:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:38.945 16:12:28 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:28:38.945 16:12:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:38.945 16:12:28 -- common/autotest_common.sh@10 -- # set +x 00:28:38.945 16:12:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:38.945 16:12:28 -- host/discovery.sh@72 -- # notify_id=0 00:28:38.945 16:12:28 -- host/discovery.sh@78 -- # get_subsystem_names 00:28:38.945 16:12:28 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:38.945 16:12:28 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:38.945 16:12:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:38.945 16:12:28 -- host/discovery.sh@59 -- # sort 00:28:38.945 16:12:28 -- common/autotest_common.sh@10 -- # set +x 00:28:38.945 16:12:28 -- host/discovery.sh@59 -- # xargs 00:28:38.945 16:12:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:38.945 16:12:28 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:28:38.945 16:12:28 -- host/discovery.sh@79 -- # get_bdev_list 00:28:38.945 16:12:28 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:38.945 16:12:28 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:38.945 16:12:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:38.945 16:12:28 -- common/autotest_common.sh@10 -- # set +x 00:28:38.945 16:12:28 -- host/discovery.sh@55 -- # sort 00:28:38.945 16:12:28 -- host/discovery.sh@55 -- # xargs 00:28:38.945 16:12:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:38.945 16:12:28 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:28:38.945 16:12:28 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:28:38.945 16:12:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:38.945 16:12:28 -- common/autotest_common.sh@10 -- # set +x 00:28:38.945 16:12:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:38.945 16:12:28 -- host/discovery.sh@82 -- # get_subsystem_names 00:28:38.945 16:12:28 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:38.945 16:12:28 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:38.945 16:12:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:38.945 16:12:28 -- host/discovery.sh@59 -- # sort 00:28:38.945 16:12:28 -- common/autotest_common.sh@10 -- # set +x 00:28:38.945 16:12:28 -- host/discovery.sh@59 -- # xargs 00:28:38.945 16:12:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:38.945 16:12:28 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:28:38.945 16:12:28 -- host/discovery.sh@83 -- # get_bdev_list 00:28:38.945 16:12:28 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:38.945 16:12:28 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:38.945 16:12:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:38.945 16:12:28 -- common/autotest_common.sh@10 -- # set +x 00:28:38.945 16:12:28 -- host/discovery.sh@55 -- # sort 00:28:38.945 16:12:28 -- host/discovery.sh@55 -- # xargs 00:28:38.945 16:12:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.205 16:12:28 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:28:39.205 16:12:28 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:28:39.205 16:12:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.205 16:12:28 -- common/autotest_common.sh@10 -- # set +x 00:28:39.205 16:12:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.205 16:12:28 -- host/discovery.sh@86 -- # get_subsystem_names 00:28:39.205 16:12:28 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:39.205 16:12:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.205 16:12:28 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:39.205 16:12:28 -- common/autotest_common.sh@10 -- # set +x 00:28:39.205 16:12:28 -- host/discovery.sh@59 -- # sort 00:28:39.205 16:12:28 -- host/discovery.sh@59 -- # xargs 00:28:39.205 16:12:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.205 16:12:28 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:28:39.205 16:12:28 -- host/discovery.sh@87 -- # get_bdev_list 00:28:39.205 16:12:28 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:39.205 16:12:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.205 16:12:28 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:39.205 16:12:28 -- common/autotest_common.sh@10 -- # set +x 00:28:39.205 16:12:28 -- host/discovery.sh@55 -- # sort 00:28:39.205 16:12:28 -- host/discovery.sh@55 -- # xargs 00:28:39.205 16:12:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.205 16:12:28 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:28:39.205 16:12:28 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:39.205 16:12:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.205 16:12:28 -- common/autotest_common.sh@10 -- # set +x 00:28:39.205 [2024-10-30 16:12:28.936074] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:39.205 16:12:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.205 16:12:28 -- host/discovery.sh@92 -- # get_subsystem_names 00:28:39.205 16:12:28 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:39.205 16:12:28 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:39.205 16:12:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.205 16:12:28 -- host/discovery.sh@59 -- # sort 00:28:39.205 16:12:28 -- common/autotest_common.sh@10 -- # set +x 00:28:39.205 16:12:28 -- host/discovery.sh@59 -- # xargs 00:28:39.205 16:12:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.205 16:12:28 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:28:39.205 16:12:28 -- host/discovery.sh@93 -- # get_bdev_list 00:28:39.205 16:12:28 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:39.205 16:12:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.205 16:12:28 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:39.205 16:12:28 -- common/autotest_common.sh@10 -- # set +x 00:28:39.205 16:12:28 -- host/discovery.sh@55 -- # sort 00:28:39.205 16:12:28 -- host/discovery.sh@55 -- # xargs 00:28:39.205 16:12:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.205 16:12:29 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:28:39.205 16:12:29 -- host/discovery.sh@94 -- # get_notification_count 00:28:39.205 16:12:29 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:39.205 16:12:29 -- host/discovery.sh@74 -- # jq '. | length' 00:28:39.205 16:12:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.205 16:12:29 -- common/autotest_common.sh@10 -- # set +x 00:28:39.205 16:12:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.205 16:12:29 -- host/discovery.sh@74 -- # notification_count=0 00:28:39.205 16:12:29 -- host/discovery.sh@75 -- # notify_id=0 00:28:39.205 16:12:29 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:28:39.205 16:12:29 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:28:39.205 16:12:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:39.205 16:12:29 -- common/autotest_common.sh@10 -- # set +x 00:28:39.205 16:12:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:39.205 16:12:29 -- host/discovery.sh@100 -- # sleep 1 00:28:40.141 [2024-10-30 16:12:29.681189] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:40.141 [2024-10-30 16:12:29.681223] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:40.141 [2024-10-30 16:12:29.681250] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:40.141 [2024-10-30 16:12:29.768522] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:40.141 [2024-10-30 16:12:29.872202] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:40.141 [2024-10-30 16:12:29.872229] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:40.401 16:12:30 -- host/discovery.sh@101 -- # get_subsystem_names 00:28:40.401 16:12:30 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:40.401 16:12:30 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:40.401 16:12:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:40.401 16:12:30 -- host/discovery.sh@59 -- # sort 00:28:40.401 16:12:30 -- common/autotest_common.sh@10 -- # set +x 00:28:40.401 16:12:30 -- host/discovery.sh@59 -- # xargs 00:28:40.401 16:12:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:40.401 16:12:30 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:40.401 16:12:30 -- host/discovery.sh@102 -- # get_bdev_list 00:28:40.401 16:12:30 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:40.401 16:12:30 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:40.401 16:12:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:40.401 16:12:30 -- common/autotest_common.sh@10 -- # set +x 00:28:40.401 16:12:30 -- host/discovery.sh@55 -- # sort 00:28:40.401 16:12:30 -- host/discovery.sh@55 -- # xargs 00:28:40.401 16:12:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:40.401 16:12:30 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:28:40.401 16:12:30 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:28:40.401 16:12:30 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:40.401 16:12:30 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:40.401 16:12:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:40.401 16:12:30 -- host/discovery.sh@63 -- # sort -n 00:28:40.401 16:12:30 -- common/autotest_common.sh@10 -- # set +x 00:28:40.401 16:12:30 -- host/discovery.sh@63 -- # xargs 00:28:40.401 16:12:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:40.401 16:12:30 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:28:40.401 16:12:30 -- host/discovery.sh@104 -- # get_notification_count 00:28:40.401 16:12:30 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:40.401 16:12:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:40.401 16:12:30 -- common/autotest_common.sh@10 -- # set +x 00:28:40.401 16:12:30 -- host/discovery.sh@74 -- # jq '. | length' 00:28:40.401 16:12:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:40.401 16:12:30 -- host/discovery.sh@74 -- # notification_count=1 00:28:40.401 16:12:30 -- host/discovery.sh@75 -- # notify_id=1 00:28:40.401 16:12:30 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:28:40.401 16:12:30 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:28:40.401 16:12:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:40.401 16:12:30 -- common/autotest_common.sh@10 -- # set +x 00:28:40.401 16:12:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:40.401 16:12:30 -- host/discovery.sh@109 -- # sleep 1 00:28:41.782 16:12:31 -- host/discovery.sh@110 -- # get_bdev_list 00:28:41.782 16:12:31 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:41.782 16:12:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:41.782 16:12:31 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:41.782 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:28:41.782 16:12:31 -- host/discovery.sh@55 -- # sort 00:28:41.782 16:12:31 -- host/discovery.sh@55 -- # xargs 00:28:41.782 16:12:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:41.782 16:12:31 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:41.782 16:12:31 -- host/discovery.sh@111 -- # get_notification_count 00:28:41.782 16:12:31 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:28:41.782 16:12:31 -- host/discovery.sh@74 -- # jq '. | length' 00:28:41.782 16:12:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:41.782 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:28:41.782 16:12:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:41.782 16:12:31 -- host/discovery.sh@74 -- # notification_count=1 00:28:41.782 16:12:31 -- host/discovery.sh@75 -- # notify_id=2 00:28:41.782 16:12:31 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:28:41.782 16:12:31 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:28:41.782 16:12:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:41.782 16:12:31 -- common/autotest_common.sh@10 -- # set +x 00:28:41.782 [2024-10-30 16:12:31.315300] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:41.782 [2024-10-30 16:12:31.316018] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:41.782 [2024-10-30 16:12:31.316058] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:41.782 16:12:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:41.782 16:12:31 -- host/discovery.sh@117 -- # sleep 1 00:28:41.782 [2024-10-30 16:12:31.403312] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:28:41.782 [2024-10-30 16:12:31.467809] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:41.782 [2024-10-30 16:12:31.467835] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:41.782 [2024-10-30 16:12:31.467846] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:42.717 16:12:32 -- host/discovery.sh@118 -- # get_subsystem_names 00:28:42.717 16:12:32 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:42.717 16:12:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:42.717 16:12:32 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:42.717 16:12:32 -- common/autotest_common.sh@10 -- # set +x 00:28:42.717 16:12:32 -- host/discovery.sh@59 -- # sort 00:28:42.717 16:12:32 -- host/discovery.sh@59 -- # xargs 00:28:42.717 16:12:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:42.717 16:12:32 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:42.717 16:12:32 -- host/discovery.sh@119 -- # get_bdev_list 00:28:42.717 16:12:32 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:42.717 16:12:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:42.717 16:12:32 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:42.717 16:12:32 -- host/discovery.sh@55 -- # sort 00:28:42.717 16:12:32 -- common/autotest_common.sh@10 -- # set +x 00:28:42.717 16:12:32 -- host/discovery.sh@55 -- # xargs 00:28:42.717 16:12:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:42.717 16:12:32 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:42.717 16:12:32 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:28:42.717 16:12:32 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:42.717 16:12:32 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:42.717 16:12:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:42.717 16:12:32 -- common/autotest_common.sh@10 -- # set +x 00:28:42.717 16:12:32 -- host/discovery.sh@63 -- # sort -n 00:28:42.717 16:12:32 -- host/discovery.sh@63 -- # xargs 00:28:42.717 16:12:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:42.717 16:12:32 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:28:42.717 16:12:32 -- host/discovery.sh@121 -- # get_notification_count 00:28:42.717 16:12:32 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:42.717 16:12:32 -- host/discovery.sh@74 -- # jq '. | length' 00:28:42.717 16:12:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:42.717 16:12:32 -- common/autotest_common.sh@10 -- # set +x 00:28:42.717 16:12:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:42.717 16:12:32 -- host/discovery.sh@74 -- # notification_count=0 00:28:42.717 16:12:32 -- host/discovery.sh@75 -- # notify_id=2 00:28:42.717 16:12:32 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:28:42.717 16:12:32 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:42.717 16:12:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:42.717 16:12:32 -- common/autotest_common.sh@10 -- # set +x 00:28:42.717 [2024-10-30 16:12:32.487663] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:42.717 [2024-10-30 16:12:32.487698] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:42.717 16:12:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:42.717 16:12:32 -- host/discovery.sh@127 -- # sleep 1 00:28:42.717 [2024-10-30 16:12:32.496098] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.717 [2024-10-30 16:12:32.496139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.717 [2024-10-30 16:12:32.496159] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.717 [2024-10-30 16:12:32.496174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.718 [2024-10-30 16:12:32.496190] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.718 [2024-10-30 16:12:32.496219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.718 [2024-10-30 16:12:32.496233] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:42.718 [2024-10-30 16:12:32.496246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:42.718 [2024-10-30 16:12:32.496266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fdf410 is same with the state(5) to be set 00:28:42.718 [2024-10-30 16:12:32.506103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fdf410 (9): Bad file descriptor 00:28:42.718 [2024-10-30 16:12:32.516153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:42.718 [2024-10-30 16:12:32.516347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:42.718 [2024-10-30 16:12:32.516472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:42.718 [2024-10-30 16:12:32.516498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fdf410 with addr=10.0.0.2, port=4420 00:28:42.718 [2024-10-30 16:12:32.516515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fdf410 is same with the state(5) to be set 00:28:42.718 [2024-10-30 16:12:32.516538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fdf410 (9): Bad file descriptor 00:28:42.718 [2024-10-30 16:12:32.516579] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:42.718 [2024-10-30 16:12:32.516596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:42.718 [2024-10-30 16:12:32.516613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:42.718 [2024-10-30 16:12:32.516636] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:42.718 [2024-10-30 16:12:32.526233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:42.718 [2024-10-30 16:12:32.526472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:42.718 [2024-10-30 16:12:32.526590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:42.718 [2024-10-30 16:12:32.526634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fdf410 with addr=10.0.0.2, port=4420 00:28:42.718 [2024-10-30 16:12:32.526651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fdf410 is same with the state(5) to be set 00:28:42.718 [2024-10-30 16:12:32.526673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fdf410 (9): Bad file descriptor 00:28:42.718 [2024-10-30 16:12:32.526693] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:42.718 [2024-10-30 16:12:32.526706] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:42.718 [2024-10-30 16:12:32.526719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:42.718 [2024-10-30 16:12:32.526738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:42.718 [2024-10-30 16:12:32.536330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:42.718 [2024-10-30 16:12:32.536487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:42.718 [2024-10-30 16:12:32.536671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:42.718 [2024-10-30 16:12:32.536697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fdf410 with addr=10.0.0.2, port=4420 00:28:42.718 [2024-10-30 16:12:32.536713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fdf410 is same with the state(5) to be set 00:28:42.718 [2024-10-30 16:12:32.536750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fdf410 (9): Bad file descriptor 00:28:42.718 [2024-10-30 16:12:32.536770] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:42.718 [2024-10-30 16:12:32.536782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:42.718 [2024-10-30 16:12:32.536795] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:42.718 [2024-10-30 16:12:32.536828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:42.718 [2024-10-30 16:12:32.546406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:42.718 [2024-10-30 16:12:32.546589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:42.718 [2024-10-30 16:12:32.546765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:42.718 [2024-10-30 16:12:32.546793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fdf410 with addr=10.0.0.2, port=4420 00:28:42.718 [2024-10-30 16:12:32.546810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fdf410 is same with the state(5) to be set 00:28:42.718 [2024-10-30 16:12:32.546834] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fdf410 (9): Bad file descriptor 00:28:42.718 [2024-10-30 16:12:32.546856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:42.718 [2024-10-30 16:12:32.546871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:42.718 [2024-10-30 16:12:32.546885] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:42.718 [2024-10-30 16:12:32.546906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:42.718 [2024-10-30 16:12:32.556473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:42.718 [2024-10-30 16:12:32.556665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:42.718 [2024-10-30 16:12:32.556820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:42.718 [2024-10-30 16:12:32.556849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fdf410 with addr=10.0.0.2, port=4420 00:28:42.718 [2024-10-30 16:12:32.556866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fdf410 is same with the state(5) to be set 00:28:42.718 [2024-10-30 16:12:32.556890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fdf410 (9): Bad file descriptor 00:28:42.718 [2024-10-30 16:12:32.556912] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:42.718 [2024-10-30 16:12:32.556927] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:42.718 [2024-10-30 16:12:32.556941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:42.718 [2024-10-30 16:12:32.556963] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:42.718 [2024-10-30 16:12:32.566559] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:42.718 [2024-10-30 16:12:32.566729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:42.718 [2024-10-30 16:12:32.566838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:42.718 [2024-10-30 16:12:32.566864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fdf410 with addr=10.0.0.2, port=4420 00:28:42.718 [2024-10-30 16:12:32.566879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fdf410 is same with the state(5) to be set 00:28:42.718 [2024-10-30 16:12:32.566901] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fdf410 (9): Bad file descriptor 00:28:42.718 [2024-10-30 16:12:32.566922] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:42.718 [2024-10-30 16:12:32.566935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:42.718 [2024-10-30 16:12:32.566948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:42.718 [2024-10-30 16:12:32.566967] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:42.718 [2024-10-30 16:12:32.574055] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:28:42.718 [2024-10-30 16:12:32.574089] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:43.655 16:12:33 -- host/discovery.sh@128 -- # get_subsystem_names 00:28:43.655 16:12:33 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:43.655 16:12:33 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:43.655 16:12:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:43.655 16:12:33 -- host/discovery.sh@59 -- # sort 00:28:43.655 16:12:33 -- common/autotest_common.sh@10 -- # set +x 00:28:43.655 16:12:33 -- host/discovery.sh@59 -- # xargs 00:28:43.655 16:12:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:43.655 16:12:33 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:43.655 16:12:33 -- host/discovery.sh@129 -- # get_bdev_list 00:28:43.912 16:12:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:43.912 16:12:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:43.912 16:12:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:43.912 16:12:33 -- common/autotest_common.sh@10 -- # set +x 00:28:43.912 16:12:33 -- host/discovery.sh@55 -- # sort 00:28:43.912 16:12:33 -- host/discovery.sh@55 -- # xargs 00:28:43.912 16:12:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:43.912 16:12:33 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:43.912 16:12:33 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:28:43.912 16:12:33 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:43.912 16:12:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:43.912 16:12:33 -- common/autotest_common.sh@10 -- # set +x 00:28:43.913 16:12:33 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:43.913 16:12:33 -- host/discovery.sh@63 -- # sort -n 00:28:43.913 16:12:33 -- host/discovery.sh@63 -- # xargs 00:28:43.913 16:12:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:43.913 16:12:33 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:28:43.913 16:12:33 -- host/discovery.sh@131 -- # get_notification_count 00:28:43.913 16:12:33 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:43.913 16:12:33 -- host/discovery.sh@74 -- # jq '. | length' 00:28:43.913 16:12:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:43.913 16:12:33 -- common/autotest_common.sh@10 -- # set +x 00:28:43.913 16:12:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:43.913 16:12:33 -- host/discovery.sh@74 -- # notification_count=0 00:28:43.913 16:12:33 -- host/discovery.sh@75 -- # notify_id=2 00:28:43.913 16:12:33 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:28:43.913 16:12:33 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:28:43.913 16:12:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:43.913 16:12:33 -- common/autotest_common.sh@10 -- # set +x 00:28:43.913 16:12:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:43.913 16:12:33 -- host/discovery.sh@135 -- # sleep 1 00:28:44.852 16:12:34 -- host/discovery.sh@136 -- # get_subsystem_names 00:28:44.852 16:12:34 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:44.852 16:12:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:44.852 16:12:34 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:44.852 16:12:34 -- common/autotest_common.sh@10 -- # set +x 00:28:44.852 16:12:34 -- host/discovery.sh@59 -- # sort 00:28:44.852 16:12:34 -- host/discovery.sh@59 -- # xargs 00:28:44.852 16:12:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:44.852 16:12:34 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:28:44.852 16:12:34 -- host/discovery.sh@137 -- # get_bdev_list 00:28:44.852 16:12:34 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:44.852 16:12:34 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:44.852 16:12:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:44.852 16:12:34 -- common/autotest_common.sh@10 -- # set +x 00:28:44.852 16:12:34 -- host/discovery.sh@55 -- # sort 00:28:44.852 16:12:34 -- host/discovery.sh@55 -- # xargs 00:28:44.852 16:12:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.110 16:12:34 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:28:45.110 16:12:34 -- host/discovery.sh@138 -- # get_notification_count 00:28:45.110 16:12:34 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:45.110 16:12:34 -- host/discovery.sh@74 -- # jq '. | length' 00:28:45.110 16:12:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.110 16:12:34 -- common/autotest_common.sh@10 -- # set +x 00:28:45.110 16:12:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.110 16:12:34 -- host/discovery.sh@74 -- # notification_count=2 00:28:45.110 16:12:34 -- host/discovery.sh@75 -- # notify_id=4 00:28:45.110 16:12:34 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:28:45.110 16:12:34 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:45.110 16:12:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.110 16:12:34 -- common/autotest_common.sh@10 -- # set +x 00:28:46.047 [2024-10-30 16:12:35.857842] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:46.047 [2024-10-30 16:12:35.857871] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:46.047 [2024-10-30 16:12:35.857896] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:46.306 [2024-10-30 16:12:35.944162] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:28:46.306 [2024-10-30 16:12:36.052494] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:46.306 [2024-10-30 16:12:36.052529] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:46.306 16:12:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:46.306 16:12:36 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:46.306 16:12:36 -- common/autotest_common.sh@640 -- # local es=0 00:28:46.306 16:12:36 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:46.306 16:12:36 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:28:46.306 16:12:36 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:46.306 16:12:36 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:28:46.306 16:12:36 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:46.306 16:12:36 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:46.306 16:12:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:46.306 16:12:36 -- common/autotest_common.sh@10 -- # set +x 00:28:46.306 request: 00:28:46.306 { 00:28:46.306 "name": "nvme", 00:28:46.306 "trtype": "tcp", 00:28:46.306 "traddr": "10.0.0.2", 00:28:46.306 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:46.306 "adrfam": "ipv4", 00:28:46.306 "trsvcid": "8009", 00:28:46.306 "wait_for_attach": true, 00:28:46.306 "method": "bdev_nvme_start_discovery", 00:28:46.306 "req_id": 1 00:28:46.306 } 00:28:46.306 Got JSON-RPC error response 00:28:46.306 response: 00:28:46.306 { 00:28:46.306 "code": -17, 00:28:46.306 "message": "File exists" 00:28:46.306 } 00:28:46.306 16:12:36 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:28:46.306 16:12:36 -- common/autotest_common.sh@643 -- # es=1 00:28:46.306 16:12:36 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:28:46.306 16:12:36 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:28:46.306 16:12:36 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:28:46.306 16:12:36 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:28:46.306 16:12:36 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:46.306 16:12:36 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:46.306 16:12:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:46.306 16:12:36 -- host/discovery.sh@67 -- # sort 00:28:46.306 16:12:36 -- common/autotest_common.sh@10 -- # set +x 00:28:46.306 16:12:36 -- host/discovery.sh@67 -- # xargs 00:28:46.306 16:12:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:46.306 16:12:36 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:28:46.306 16:12:36 -- host/discovery.sh@147 -- # get_bdev_list 00:28:46.306 16:12:36 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:46.306 16:12:36 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:46.306 16:12:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:46.306 16:12:36 -- common/autotest_common.sh@10 -- # set +x 00:28:46.306 16:12:36 -- host/discovery.sh@55 -- # sort 00:28:46.306 16:12:36 -- host/discovery.sh@55 -- # xargs 00:28:46.306 16:12:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:46.306 16:12:36 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:46.306 16:12:36 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:46.306 16:12:36 -- common/autotest_common.sh@640 -- # local es=0 00:28:46.306 16:12:36 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:46.306 16:12:36 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:28:46.306 16:12:36 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:46.306 16:12:36 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:28:46.306 16:12:36 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:46.306 16:12:36 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:46.306 16:12:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:46.306 16:12:36 -- common/autotest_common.sh@10 -- # set +x 00:28:46.306 request: 00:28:46.306 { 00:28:46.306 "name": "nvme_second", 00:28:46.306 "trtype": "tcp", 00:28:46.306 "traddr": "10.0.0.2", 00:28:46.306 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:46.306 "adrfam": "ipv4", 00:28:46.306 "trsvcid": "8009", 00:28:46.306 "wait_for_attach": true, 00:28:46.306 "method": "bdev_nvme_start_discovery", 00:28:46.306 "req_id": 1 00:28:46.306 } 00:28:46.306 Got JSON-RPC error response 00:28:46.306 response: 00:28:46.306 { 00:28:46.306 "code": -17, 00:28:46.306 "message": "File exists" 00:28:46.306 } 00:28:46.306 16:12:36 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:28:46.306 16:12:36 -- common/autotest_common.sh@643 -- # es=1 00:28:46.306 16:12:36 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:28:46.306 16:12:36 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:28:46.306 16:12:36 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:28:46.306 16:12:36 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:28:46.306 16:12:36 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:46.306 16:12:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:46.306 16:12:36 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:46.306 16:12:36 -- common/autotest_common.sh@10 -- # set +x 00:28:46.306 16:12:36 -- host/discovery.sh@67 -- # sort 00:28:46.306 16:12:36 -- host/discovery.sh@67 -- # xargs 00:28:46.306 16:12:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:46.566 16:12:36 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:28:46.566 16:12:36 -- host/discovery.sh@153 -- # get_bdev_list 00:28:46.566 16:12:36 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:46.566 16:12:36 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:46.566 16:12:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:46.566 16:12:36 -- common/autotest_common.sh@10 -- # set +x 00:28:46.566 16:12:36 -- host/discovery.sh@55 -- # sort 00:28:46.566 16:12:36 -- host/discovery.sh@55 -- # xargs 00:28:46.566 16:12:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:46.566 16:12:36 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:46.566 16:12:36 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:46.566 16:12:36 -- common/autotest_common.sh@640 -- # local es=0 00:28:46.566 16:12:36 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:46.566 16:12:36 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:28:46.566 16:12:36 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:46.566 16:12:36 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:28:46.566 16:12:36 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:28:46.566 16:12:36 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:46.566 16:12:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:46.566 16:12:36 -- common/autotest_common.sh@10 -- # set +x 00:28:47.503 [2024-10-30 16:12:37.260696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.503 [2024-10-30 16:12:37.260869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.503 [2024-10-30 16:12:37.260896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f562e0 with addr=10.0.0.2, port=8010 00:28:47.503 [2024-10-30 16:12:37.260918] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:47.503 [2024-10-30 16:12:37.260932] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:47.503 [2024-10-30 16:12:37.260944] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:48.438 [2024-10-30 16:12:38.263118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.439 [2024-10-30 16:12:38.263253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.439 [2024-10-30 16:12:38.263305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f562e0 with addr=10.0.0.2, port=8010 00:28:48.439 [2024-10-30 16:12:38.263331] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:48.439 [2024-10-30 16:12:38.263344] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:48.439 [2024-10-30 16:12:38.263356] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:49.817 [2024-10-30 16:12:39.265390] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:28:49.817 request: 00:28:49.817 { 00:28:49.817 "name": "nvme_second", 00:28:49.817 "trtype": "tcp", 00:28:49.817 "traddr": "10.0.0.2", 00:28:49.817 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:49.817 "adrfam": "ipv4", 00:28:49.817 "trsvcid": "8010", 00:28:49.817 "attach_timeout_ms": 3000, 00:28:49.817 "method": "bdev_nvme_start_discovery", 00:28:49.817 "req_id": 1 00:28:49.817 } 00:28:49.817 Got JSON-RPC error response 00:28:49.817 response: 00:28:49.817 { 00:28:49.817 "code": -110, 00:28:49.817 "message": "Connection timed out" 00:28:49.817 } 00:28:49.817 16:12:39 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:28:49.817 16:12:39 -- common/autotest_common.sh@643 -- # es=1 00:28:49.817 16:12:39 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:28:49.817 16:12:39 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:28:49.817 16:12:39 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:28:49.817 16:12:39 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:28:49.817 16:12:39 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:49.817 16:12:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:49.817 16:12:39 -- common/autotest_common.sh@10 -- # set +x 00:28:49.817 16:12:39 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:49.817 16:12:39 -- host/discovery.sh@67 -- # sort 00:28:49.817 16:12:39 -- host/discovery.sh@67 -- # xargs 00:28:49.817 16:12:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:49.817 16:12:39 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:28:49.817 16:12:39 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:28:49.817 16:12:39 -- host/discovery.sh@162 -- # kill 2531828 00:28:49.817 16:12:39 -- host/discovery.sh@163 -- # nvmftestfini 00:28:49.817 16:12:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:49.817 16:12:39 -- nvmf/common.sh@116 -- # sync 00:28:49.817 16:12:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:49.817 16:12:39 -- nvmf/common.sh@119 -- # set +e 00:28:49.817 16:12:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:49.817 16:12:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:49.817 rmmod nvme_tcp 00:28:49.817 rmmod nvme_fabrics 00:28:49.817 rmmod nvme_keyring 00:28:49.817 16:12:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:49.817 16:12:39 -- nvmf/common.sh@123 -- # set -e 00:28:49.817 16:12:39 -- nvmf/common.sh@124 -- # return 0 00:28:49.817 16:12:39 -- nvmf/common.sh@477 -- # '[' -n 2531676 ']' 00:28:49.817 16:12:39 -- nvmf/common.sh@478 -- # killprocess 2531676 00:28:49.817 16:12:39 -- common/autotest_common.sh@926 -- # '[' -z 2531676 ']' 00:28:49.817 16:12:39 -- common/autotest_common.sh@930 -- # kill -0 2531676 00:28:49.817 16:12:39 -- common/autotest_common.sh@931 -- # uname 00:28:49.817 16:12:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:28:49.817 16:12:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2531676 00:28:49.817 16:12:39 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:28:49.817 16:12:39 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:28:49.817 16:12:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2531676' 00:28:49.817 killing process with pid 2531676 00:28:49.817 16:12:39 -- common/autotest_common.sh@945 -- # kill 2531676 00:28:49.817 16:12:39 -- common/autotest_common.sh@950 -- # wait 2531676 00:28:49.817 16:12:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:49.817 16:12:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:49.817 16:12:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:49.817 16:12:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:49.817 16:12:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:49.817 16:12:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:49.817 16:12:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:49.817 16:12:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:52.355 16:12:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:52.355 00:28:52.355 real 0m17.231s 00:28:52.355 user 0m26.776s 00:28:52.355 sys 0m2.853s 00:28:52.355 16:12:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:52.355 16:12:41 -- common/autotest_common.sh@10 -- # set +x 00:28:52.355 ************************************ 00:28:52.355 END TEST nvmf_discovery 00:28:52.355 ************************************ 00:28:52.355 16:12:41 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:52.355 16:12:41 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:28:52.355 16:12:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:52.355 16:12:41 -- common/autotest_common.sh@10 -- # set +x 00:28:52.355 ************************************ 00:28:52.355 START TEST nvmf_discovery_remove_ifc 00:28:52.355 ************************************ 00:28:52.355 16:12:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:52.355 * Looking for test storage... 00:28:52.355 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:52.355 16:12:41 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:52.355 16:12:41 -- nvmf/common.sh@7 -- # uname -s 00:28:52.355 16:12:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:52.355 16:12:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:52.355 16:12:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:52.355 16:12:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:52.355 16:12:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:52.355 16:12:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:52.355 16:12:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:52.355 16:12:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:52.355 16:12:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:52.355 16:12:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:52.355 16:12:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:52.355 16:12:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:52.355 16:12:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:52.355 16:12:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:52.355 16:12:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:52.355 16:12:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:52.355 16:12:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:52.355 16:12:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:52.355 16:12:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:52.355 16:12:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:52.355 16:12:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:52.355 16:12:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:52.355 16:12:41 -- paths/export.sh@5 -- # export PATH 00:28:52.355 16:12:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:52.355 16:12:41 -- nvmf/common.sh@46 -- # : 0 00:28:52.355 16:12:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:52.355 16:12:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:52.355 16:12:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:52.355 16:12:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:52.355 16:12:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:52.355 16:12:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:52.355 16:12:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:52.355 16:12:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:52.355 16:12:41 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:28:52.355 16:12:41 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:28:52.355 16:12:41 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:28:52.355 16:12:41 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:28:52.355 16:12:41 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:28:52.355 16:12:41 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:28:52.355 16:12:41 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:28:52.355 16:12:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:52.355 16:12:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:52.355 16:12:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:52.355 16:12:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:52.355 16:12:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:52.355 16:12:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:52.355 16:12:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:52.355 16:12:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:52.355 16:12:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:52.355 16:12:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:52.355 16:12:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:52.355 16:12:41 -- common/autotest_common.sh@10 -- # set +x 00:28:54.260 16:12:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:54.260 16:12:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:54.260 16:12:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:54.260 16:12:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:54.260 16:12:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:54.260 16:12:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:54.260 16:12:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:54.260 16:12:43 -- nvmf/common.sh@294 -- # net_devs=() 00:28:54.260 16:12:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:54.260 16:12:43 -- nvmf/common.sh@295 -- # e810=() 00:28:54.260 16:12:43 -- nvmf/common.sh@295 -- # local -ga e810 00:28:54.260 16:12:43 -- nvmf/common.sh@296 -- # x722=() 00:28:54.260 16:12:43 -- nvmf/common.sh@296 -- # local -ga x722 00:28:54.260 16:12:43 -- nvmf/common.sh@297 -- # mlx=() 00:28:54.260 16:12:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:54.260 16:12:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:54.260 16:12:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:54.260 16:12:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:54.260 16:12:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:54.260 16:12:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:54.260 16:12:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:54.260 16:12:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:54.260 16:12:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:54.260 16:12:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:54.260 16:12:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:54.260 16:12:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:54.260 16:12:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:54.260 16:12:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:54.260 16:12:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:54.260 16:12:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:54.260 16:12:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:54.260 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:54.260 16:12:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:54.260 16:12:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:54.260 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:54.260 16:12:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:54.260 16:12:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:54.260 16:12:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:54.260 16:12:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:54.260 16:12:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:54.260 16:12:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:54.260 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:54.260 16:12:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:54.260 16:12:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:54.260 16:12:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:54.260 16:12:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:54.260 16:12:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:54.260 16:12:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:54.260 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:54.260 16:12:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:54.260 16:12:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:54.260 16:12:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:54.260 16:12:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:54.260 16:12:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:54.260 16:12:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:54.260 16:12:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:54.260 16:12:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:54.260 16:12:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:54.260 16:12:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:54.260 16:12:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:54.260 16:12:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:54.260 16:12:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:54.260 16:12:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:54.260 16:12:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:54.260 16:12:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:54.260 16:12:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:54.260 16:12:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:54.260 16:12:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:54.261 16:12:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:54.261 16:12:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:54.261 16:12:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:54.261 16:12:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:54.261 16:12:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:54.261 16:12:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:54.261 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:54.261 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:28:54.261 00:28:54.261 --- 10.0.0.2 ping statistics --- 00:28:54.261 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:54.261 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:28:54.261 16:12:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:54.261 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:54.261 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:28:54.261 00:28:54.261 --- 10.0.0.1 ping statistics --- 00:28:54.261 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:54.261 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:28:54.261 16:12:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:54.261 16:12:43 -- nvmf/common.sh@410 -- # return 0 00:28:54.261 16:12:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:54.261 16:12:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:54.261 16:12:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:54.261 16:12:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:54.261 16:12:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:54.261 16:12:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:54.261 16:12:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:54.261 16:12:43 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:28:54.261 16:12:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:54.261 16:12:43 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:54.261 16:12:43 -- common/autotest_common.sh@10 -- # set +x 00:28:54.261 16:12:43 -- nvmf/common.sh@469 -- # nvmfpid=2535414 00:28:54.261 16:12:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:54.261 16:12:43 -- nvmf/common.sh@470 -- # waitforlisten 2535414 00:28:54.261 16:12:43 -- common/autotest_common.sh@819 -- # '[' -z 2535414 ']' 00:28:54.261 16:12:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:54.261 16:12:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:54.261 16:12:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:54.261 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:54.261 16:12:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:54.261 16:12:43 -- common/autotest_common.sh@10 -- # set +x 00:28:54.261 [2024-10-30 16:12:43.947925] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:28:54.261 [2024-10-30 16:12:43.948008] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:54.261 EAL: No free 2048 kB hugepages reported on node 1 00:28:54.261 [2024-10-30 16:12:44.017212] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:54.261 [2024-10-30 16:12:44.104987] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:54.261 [2024-10-30 16:12:44.105168] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:54.261 [2024-10-30 16:12:44.105198] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:54.261 [2024-10-30 16:12:44.105221] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:54.261 [2024-10-30 16:12:44.105292] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:55.197 16:12:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:55.197 16:12:44 -- common/autotest_common.sh@852 -- # return 0 00:28:55.197 16:12:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:55.197 16:12:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:55.197 16:12:44 -- common/autotest_common.sh@10 -- # set +x 00:28:55.197 16:12:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:55.197 16:12:44 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:28:55.197 16:12:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:55.197 16:12:44 -- common/autotest_common.sh@10 -- # set +x 00:28:55.197 [2024-10-30 16:12:44.938686] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:55.197 [2024-10-30 16:12:44.946867] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:55.197 null0 00:28:55.197 [2024-10-30 16:12:44.978816] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:55.197 16:12:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:55.197 16:12:44 -- host/discovery_remove_ifc.sh@59 -- # hostpid=2535572 00:28:55.197 16:12:44 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:28:55.197 16:12:44 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 2535572 /tmp/host.sock 00:28:55.197 16:12:44 -- common/autotest_common.sh@819 -- # '[' -z 2535572 ']' 00:28:55.197 16:12:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:28:55.197 16:12:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:55.197 16:12:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:55.197 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:55.197 16:12:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:55.197 16:12:44 -- common/autotest_common.sh@10 -- # set +x 00:28:55.197 [2024-10-30 16:12:45.041011] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:28:55.197 [2024-10-30 16:12:45.041073] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2535572 ] 00:28:55.197 EAL: No free 2048 kB hugepages reported on node 1 00:28:55.456 [2024-10-30 16:12:45.103016] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:55.457 [2024-10-30 16:12:45.191191] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:55.457 [2024-10-30 16:12:45.191391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:55.457 16:12:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:55.457 16:12:45 -- common/autotest_common.sh@852 -- # return 0 00:28:55.457 16:12:45 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:55.457 16:12:45 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:28:55.457 16:12:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:55.457 16:12:45 -- common/autotest_common.sh@10 -- # set +x 00:28:55.457 16:12:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:55.457 16:12:45 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:28:55.457 16:12:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:55.457 16:12:45 -- common/autotest_common.sh@10 -- # set +x 00:28:55.716 16:12:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:55.716 16:12:45 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:28:55.716 16:12:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:55.716 16:12:45 -- common/autotest_common.sh@10 -- # set +x 00:28:56.655 [2024-10-30 16:12:46.416371] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:56.655 [2024-10-30 16:12:46.416409] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:56.655 [2024-10-30 16:12:46.416435] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:56.655 [2024-10-30 16:12:46.502701] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:56.913 [2024-10-30 16:12:46.687648] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:28:56.913 [2024-10-30 16:12:46.687706] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:28:56.913 [2024-10-30 16:12:46.687744] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:28:56.913 [2024-10-30 16:12:46.687768] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:56.913 [2024-10-30 16:12:46.687807] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:56.913 16:12:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:56.913 16:12:46 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:28:56.913 16:12:46 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:56.913 16:12:46 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:56.913 16:12:46 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:56.913 16:12:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:56.913 16:12:46 -- common/autotest_common.sh@10 -- # set +x 00:28:56.913 16:12:46 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:56.913 16:12:46 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:56.913 [2024-10-30 16:12:46.694876] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1c10c50 was disconnected and freed. delete nvme_qpair. 00:28:56.913 16:12:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:56.913 16:12:46 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:28:56.913 16:12:46 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:28:56.914 16:12:46 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:28:57.172 16:12:46 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:28:57.172 16:12:46 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:57.172 16:12:46 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:57.172 16:12:46 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:57.172 16:12:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:57.172 16:12:46 -- common/autotest_common.sh@10 -- # set +x 00:28:57.172 16:12:46 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:57.172 16:12:46 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:57.172 16:12:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:57.172 16:12:46 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:57.172 16:12:46 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:58.138 16:12:47 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:58.138 16:12:47 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:58.138 16:12:47 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:58.138 16:12:47 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:58.138 16:12:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:58.138 16:12:47 -- common/autotest_common.sh@10 -- # set +x 00:28:58.138 16:12:47 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:58.138 16:12:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:58.138 16:12:48 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:58.138 16:12:48 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:59.515 16:12:49 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:59.515 16:12:49 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:59.515 16:12:49 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:59.515 16:12:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:59.515 16:12:49 -- common/autotest_common.sh@10 -- # set +x 00:28:59.515 16:12:49 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:59.515 16:12:49 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:59.515 16:12:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:59.515 16:12:49 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:59.515 16:12:49 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:00.449 16:12:50 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:00.449 16:12:50 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:00.449 16:12:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:00.449 16:12:50 -- common/autotest_common.sh@10 -- # set +x 00:29:00.449 16:12:50 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:00.449 16:12:50 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:00.449 16:12:50 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:00.449 16:12:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:00.449 16:12:50 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:00.449 16:12:50 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:01.385 16:12:51 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:01.385 16:12:51 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:01.385 16:12:51 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:01.385 16:12:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:01.385 16:12:51 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:01.385 16:12:51 -- common/autotest_common.sh@10 -- # set +x 00:29:01.386 16:12:51 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:01.386 16:12:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:01.386 16:12:51 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:01.386 16:12:51 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:02.321 [2024-10-30 16:12:52.128967] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:29:02.322 [2024-10-30 16:12:52.129031] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:02.322 [2024-10-30 16:12:52.129055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:02.322 [2024-10-30 16:12:52.129073] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:02.322 [2024-10-30 16:12:52.129088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:02.322 [2024-10-30 16:12:52.129103] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:02.322 [2024-10-30 16:12:52.129118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:02.322 [2024-10-30 16:12:52.129134] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:02.322 [2024-10-30 16:12:52.129149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:02.322 [2024-10-30 16:12:52.129164] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:02.322 [2024-10-30 16:12:52.129178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:02.322 [2024-10-30 16:12:52.129202] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bd70b0 is same with the state(5) to be set 00:29:02.322 [2024-10-30 16:12:52.138989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bd70b0 (9): Bad file descriptor 00:29:02.322 16:12:52 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:02.322 16:12:52 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.322 16:12:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:02.322 16:12:52 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:02.322 16:12:52 -- common/autotest_common.sh@10 -- # set +x 00:29:02.322 16:12:52 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:02.322 16:12:52 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:02.322 [2024-10-30 16:12:52.149044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:03.699 [2024-10-30 16:12:53.183292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:04.638 [2024-10-30 16:12:54.207314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:04.638 [2024-10-30 16:12:54.207397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1bd70b0 with addr=10.0.0.2, port=4420 00:29:04.638 [2024-10-30 16:12:54.207425] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bd70b0 is same with the state(5) to be set 00:29:04.638 [2024-10-30 16:12:54.207463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:04.638 [2024-10-30 16:12:54.207480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:04.638 [2024-10-30 16:12:54.207492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:04.638 [2024-10-30 16:12:54.207507] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:04.638 [2024-10-30 16:12:54.207649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bd70b0 (9): Bad file descriptor 00:29:04.638 [2024-10-30 16:12:54.207688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:04.638 [2024-10-30 16:12:54.207736] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:04.638 [2024-10-30 16:12:54.207788] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:04.638 [2024-10-30 16:12:54.207810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:04.638 [2024-10-30 16:12:54.207829] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:04.638 [2024-10-30 16:12:54.207842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:04.638 [2024-10-30 16:12:54.207855] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:04.638 [2024-10-30 16:12:54.207868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:04.638 [2024-10-30 16:12:54.207882] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:04.638 [2024-10-30 16:12:54.207894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:04.638 [2024-10-30 16:12:54.207908] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:04.638 [2024-10-30 16:12:54.207921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:04.638 [2024-10-30 16:12:54.207933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:04.638 [2024-10-30 16:12:54.208461] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1bd74c0 (9): Bad file descriptor 00:29:04.638 [2024-10-30 16:12:54.209484] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:04.638 [2024-10-30 16:12:54.209508] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:04.638 16:12:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:04.638 16:12:54 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:04.638 16:12:54 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:05.577 16:12:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:05.577 16:12:55 -- common/autotest_common.sh@10 -- # set +x 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:05.577 16:12:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:05.577 16:12:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:05.577 16:12:55 -- common/autotest_common.sh@10 -- # set +x 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:05.577 16:12:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:05.577 16:12:55 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:06.512 [2024-10-30 16:12:56.222178] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:06.512 [2024-10-30 16:12:56.222207] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:06.512 [2024-10-30 16:12:56.222234] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:06.512 [2024-10-30 16:12:56.309539] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:06.512 16:12:56 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:06.512 16:12:56 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:06.512 16:12:56 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:06.512 16:12:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:06.512 16:12:56 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:06.512 16:12:56 -- common/autotest_common.sh@10 -- # set +x 00:29:06.512 16:12:56 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:06.512 16:12:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:06.512 [2024-10-30 16:12:56.372326] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:06.512 [2024-10-30 16:12:56.372372] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:06.512 [2024-10-30 16:12:56.372404] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:06.512 [2024-10-30 16:12:56.372426] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:06.512 [2024-10-30 16:12:56.372439] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:06.512 [2024-10-30 16:12:56.380740] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1be5ac0 was disconnected and freed. delete nvme_qpair. 00:29:06.512 16:12:56 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:06.512 16:12:56 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:07.889 16:12:57 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:07.889 16:12:57 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:07.889 16:12:57 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:07.889 16:12:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:07.889 16:12:57 -- common/autotest_common.sh@10 -- # set +x 00:29:07.889 16:12:57 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:07.889 16:12:57 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:07.889 16:12:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:07.889 16:12:57 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:07.889 16:12:57 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:07.889 16:12:57 -- host/discovery_remove_ifc.sh@90 -- # killprocess 2535572 00:29:07.889 16:12:57 -- common/autotest_common.sh@926 -- # '[' -z 2535572 ']' 00:29:07.889 16:12:57 -- common/autotest_common.sh@930 -- # kill -0 2535572 00:29:07.889 16:12:57 -- common/autotest_common.sh@931 -- # uname 00:29:07.889 16:12:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:07.889 16:12:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2535572 00:29:07.889 16:12:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:07.889 16:12:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:07.889 16:12:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2535572' 00:29:07.889 killing process with pid 2535572 00:29:07.889 16:12:57 -- common/autotest_common.sh@945 -- # kill 2535572 00:29:07.889 16:12:57 -- common/autotest_common.sh@950 -- # wait 2535572 00:29:07.889 16:12:57 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:07.889 16:12:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:07.889 16:12:57 -- nvmf/common.sh@116 -- # sync 00:29:07.889 16:12:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:07.889 16:12:57 -- nvmf/common.sh@119 -- # set +e 00:29:07.889 16:12:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:07.889 16:12:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:07.889 rmmod nvme_tcp 00:29:07.889 rmmod nvme_fabrics 00:29:07.889 rmmod nvme_keyring 00:29:07.889 16:12:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:07.889 16:12:57 -- nvmf/common.sh@123 -- # set -e 00:29:07.889 16:12:57 -- nvmf/common.sh@124 -- # return 0 00:29:07.889 16:12:57 -- nvmf/common.sh@477 -- # '[' -n 2535414 ']' 00:29:07.889 16:12:57 -- nvmf/common.sh@478 -- # killprocess 2535414 00:29:07.890 16:12:57 -- common/autotest_common.sh@926 -- # '[' -z 2535414 ']' 00:29:07.890 16:12:57 -- common/autotest_common.sh@930 -- # kill -0 2535414 00:29:07.890 16:12:57 -- common/autotest_common.sh@931 -- # uname 00:29:07.890 16:12:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:07.890 16:12:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2535414 00:29:08.147 16:12:57 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:08.147 16:12:57 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:08.147 16:12:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2535414' 00:29:08.147 killing process with pid 2535414 00:29:08.147 16:12:57 -- common/autotest_common.sh@945 -- # kill 2535414 00:29:08.147 16:12:57 -- common/autotest_common.sh@950 -- # wait 2535414 00:29:08.147 16:12:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:08.147 16:12:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:08.147 16:12:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:08.147 16:12:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:08.147 16:12:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:08.147 16:12:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:08.147 16:12:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:08.147 16:12:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:10.763 16:13:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:10.763 00:29:10.763 real 0m18.328s 00:29:10.763 user 0m25.502s 00:29:10.763 sys 0m2.826s 00:29:10.763 16:13:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:10.763 16:13:00 -- common/autotest_common.sh@10 -- # set +x 00:29:10.763 ************************************ 00:29:10.763 END TEST nvmf_discovery_remove_ifc 00:29:10.763 ************************************ 00:29:10.763 16:13:00 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:10.763 16:13:00 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:10.763 16:13:00 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:29:10.763 16:13:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:10.763 16:13:00 -- common/autotest_common.sh@10 -- # set +x 00:29:10.763 ************************************ 00:29:10.763 START TEST nvmf_digest 00:29:10.763 ************************************ 00:29:10.763 16:13:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:10.763 * Looking for test storage... 00:29:10.763 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:10.763 16:13:00 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:10.763 16:13:00 -- nvmf/common.sh@7 -- # uname -s 00:29:10.763 16:13:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:10.763 16:13:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:10.763 16:13:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:10.763 16:13:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:10.763 16:13:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:10.763 16:13:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:10.763 16:13:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:10.763 16:13:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:10.763 16:13:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:10.763 16:13:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:10.763 16:13:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:10.763 16:13:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:10.763 16:13:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:10.763 16:13:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:10.763 16:13:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:10.763 16:13:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:10.763 16:13:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:10.763 16:13:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:10.763 16:13:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:10.763 16:13:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:10.763 16:13:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:10.763 16:13:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:10.763 16:13:00 -- paths/export.sh@5 -- # export PATH 00:29:10.763 16:13:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:10.763 16:13:00 -- nvmf/common.sh@46 -- # : 0 00:29:10.763 16:13:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:10.763 16:13:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:10.763 16:13:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:10.763 16:13:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:10.763 16:13:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:10.763 16:13:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:10.763 16:13:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:10.763 16:13:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:10.763 16:13:00 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:10.763 16:13:00 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:10.763 16:13:00 -- host/digest.sh@16 -- # runtime=2 00:29:10.763 16:13:00 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:10.763 16:13:00 -- host/digest.sh@132 -- # nvmftestinit 00:29:10.763 16:13:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:10.763 16:13:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:10.763 16:13:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:10.763 16:13:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:10.763 16:13:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:10.763 16:13:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:10.763 16:13:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:10.763 16:13:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:10.763 16:13:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:10.763 16:13:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:10.763 16:13:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:10.763 16:13:00 -- common/autotest_common.sh@10 -- # set +x 00:29:12.664 16:13:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:12.664 16:13:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:12.664 16:13:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:12.664 16:13:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:12.664 16:13:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:12.664 16:13:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:12.664 16:13:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:12.664 16:13:02 -- nvmf/common.sh@294 -- # net_devs=() 00:29:12.664 16:13:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:12.664 16:13:02 -- nvmf/common.sh@295 -- # e810=() 00:29:12.664 16:13:02 -- nvmf/common.sh@295 -- # local -ga e810 00:29:12.664 16:13:02 -- nvmf/common.sh@296 -- # x722=() 00:29:12.664 16:13:02 -- nvmf/common.sh@296 -- # local -ga x722 00:29:12.664 16:13:02 -- nvmf/common.sh@297 -- # mlx=() 00:29:12.664 16:13:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:12.664 16:13:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:12.664 16:13:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:12.664 16:13:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:12.664 16:13:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:12.664 16:13:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:12.664 16:13:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:12.664 16:13:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:12.664 16:13:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:12.664 16:13:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:12.664 16:13:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:12.664 16:13:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:12.664 16:13:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:12.664 16:13:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:12.664 16:13:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:12.664 16:13:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:12.664 16:13:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:12.664 16:13:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:12.664 16:13:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:12.664 16:13:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:12.664 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:12.665 16:13:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:12.665 16:13:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:12.665 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:12.665 16:13:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:12.665 16:13:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:12.665 16:13:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:12.665 16:13:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:12.665 16:13:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:12.665 16:13:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:12.665 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:12.665 16:13:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:12.665 16:13:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:12.665 16:13:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:12.665 16:13:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:12.665 16:13:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:12.665 16:13:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:12.665 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:12.665 16:13:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:12.665 16:13:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:12.665 16:13:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:12.665 16:13:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:12.665 16:13:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:12.665 16:13:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:12.665 16:13:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:12.665 16:13:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:12.665 16:13:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:12.665 16:13:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:12.665 16:13:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:12.665 16:13:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:12.665 16:13:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:12.665 16:13:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:12.665 16:13:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:12.665 16:13:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:12.665 16:13:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:12.665 16:13:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:12.665 16:13:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:12.665 16:13:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:12.665 16:13:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:12.665 16:13:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:12.665 16:13:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:12.665 16:13:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:12.665 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:12.665 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:29:12.665 00:29:12.665 --- 10.0.0.2 ping statistics --- 00:29:12.665 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:12.665 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:29:12.665 16:13:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:12.665 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:12.665 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:29:12.665 00:29:12.665 --- 10.0.0.1 ping statistics --- 00:29:12.665 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:12.665 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:29:12.665 16:13:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:12.665 16:13:02 -- nvmf/common.sh@410 -- # return 0 00:29:12.665 16:13:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:12.665 16:13:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:12.665 16:13:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:12.665 16:13:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:12.665 16:13:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:12.665 16:13:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:12.665 16:13:02 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:12.665 16:13:02 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:12.665 16:13:02 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:12.665 16:13:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:12.665 16:13:02 -- common/autotest_common.sh@10 -- # set +x 00:29:12.665 ************************************ 00:29:12.665 START TEST nvmf_digest_clean 00:29:12.665 ************************************ 00:29:12.665 16:13:02 -- common/autotest_common.sh@1104 -- # run_digest 00:29:12.665 16:13:02 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:12.665 16:13:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:12.665 16:13:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:12.665 16:13:02 -- common/autotest_common.sh@10 -- # set +x 00:29:12.665 16:13:02 -- nvmf/common.sh@469 -- # nvmfpid=2539086 00:29:12.665 16:13:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:12.665 16:13:02 -- nvmf/common.sh@470 -- # waitforlisten 2539086 00:29:12.665 16:13:02 -- common/autotest_common.sh@819 -- # '[' -z 2539086 ']' 00:29:12.665 16:13:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:12.665 16:13:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:12.665 16:13:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:12.665 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:12.665 16:13:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:12.665 16:13:02 -- common/autotest_common.sh@10 -- # set +x 00:29:12.665 [2024-10-30 16:13:02.296382] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:12.665 [2024-10-30 16:13:02.296478] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:12.665 EAL: No free 2048 kB hugepages reported on node 1 00:29:12.665 [2024-10-30 16:13:02.360999] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:12.665 [2024-10-30 16:13:02.448316] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:12.665 [2024-10-30 16:13:02.448496] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:12.665 [2024-10-30 16:13:02.448514] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:12.665 [2024-10-30 16:13:02.448527] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:12.665 [2024-10-30 16:13:02.448566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:12.665 16:13:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:12.665 16:13:02 -- common/autotest_common.sh@852 -- # return 0 00:29:12.665 16:13:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:12.665 16:13:02 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:12.665 16:13:02 -- common/autotest_common.sh@10 -- # set +x 00:29:12.665 16:13:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:12.665 16:13:02 -- host/digest.sh@120 -- # common_target_config 00:29:12.665 16:13:02 -- host/digest.sh@43 -- # rpc_cmd 00:29:12.665 16:13:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:12.665 16:13:02 -- common/autotest_common.sh@10 -- # set +x 00:29:12.924 null0 00:29:12.924 [2024-10-30 16:13:02.648919] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:12.924 [2024-10-30 16:13:02.673157] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:12.924 16:13:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:12.924 16:13:02 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:12.924 16:13:02 -- host/digest.sh@77 -- # local rw bs qd 00:29:12.924 16:13:02 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:12.924 16:13:02 -- host/digest.sh@80 -- # rw=randread 00:29:12.924 16:13:02 -- host/digest.sh@80 -- # bs=4096 00:29:12.924 16:13:02 -- host/digest.sh@80 -- # qd=128 00:29:12.924 16:13:02 -- host/digest.sh@82 -- # bperfpid=2539111 00:29:12.924 16:13:02 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:12.924 16:13:02 -- host/digest.sh@83 -- # waitforlisten 2539111 /var/tmp/bperf.sock 00:29:12.924 16:13:02 -- common/autotest_common.sh@819 -- # '[' -z 2539111 ']' 00:29:12.924 16:13:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:12.924 16:13:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:12.924 16:13:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:12.924 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:12.924 16:13:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:12.924 16:13:02 -- common/autotest_common.sh@10 -- # set +x 00:29:12.924 [2024-10-30 16:13:02.718667] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:12.924 [2024-10-30 16:13:02.718742] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2539111 ] 00:29:12.924 EAL: No free 2048 kB hugepages reported on node 1 00:29:12.924 [2024-10-30 16:13:02.780641] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:13.183 [2024-10-30 16:13:02.871051] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:13.183 16:13:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:13.183 16:13:02 -- common/autotest_common.sh@852 -- # return 0 00:29:13.183 16:13:02 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:13.183 16:13:02 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:13.183 16:13:02 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:13.749 16:13:03 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:13.749 16:13:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:14.006 nvme0n1 00:29:14.007 16:13:03 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:14.007 16:13:03 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:14.007 Running I/O for 2 seconds... 00:29:16.537 00:29:16.537 Latency(us) 00:29:16.537 [2024-10-30T15:13:06.413Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:16.537 [2024-10-30T15:13:06.413Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:16.537 nvme0n1 : 2.05 16004.09 62.52 0.00 0.00 7832.39 3592.34 47768.46 00:29:16.537 [2024-10-30T15:13:06.413Z] =================================================================================================================== 00:29:16.537 [2024-10-30T15:13:06.413Z] Total : 16004.09 62.52 0.00 0.00 7832.39 3592.34 47768.46 00:29:16.537 0 00:29:16.537 16:13:05 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:16.537 16:13:05 -- host/digest.sh@92 -- # get_accel_stats 00:29:16.537 16:13:05 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:16.537 16:13:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:16.537 16:13:05 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:16.537 | select(.opcode=="crc32c") 00:29:16.537 | "\(.module_name) \(.executed)"' 00:29:16.537 16:13:06 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:16.537 16:13:06 -- host/digest.sh@93 -- # exp_module=software 00:29:16.537 16:13:06 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:16.537 16:13:06 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:16.537 16:13:06 -- host/digest.sh@97 -- # killprocess 2539111 00:29:16.537 16:13:06 -- common/autotest_common.sh@926 -- # '[' -z 2539111 ']' 00:29:16.537 16:13:06 -- common/autotest_common.sh@930 -- # kill -0 2539111 00:29:16.537 16:13:06 -- common/autotest_common.sh@931 -- # uname 00:29:16.537 16:13:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:16.537 16:13:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2539111 00:29:16.537 16:13:06 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:16.537 16:13:06 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:16.537 16:13:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2539111' 00:29:16.537 killing process with pid 2539111 00:29:16.537 16:13:06 -- common/autotest_common.sh@945 -- # kill 2539111 00:29:16.537 Received shutdown signal, test time was about 2.000000 seconds 00:29:16.537 00:29:16.537 Latency(us) 00:29:16.537 [2024-10-30T15:13:06.413Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:16.537 [2024-10-30T15:13:06.413Z] =================================================================================================================== 00:29:16.537 [2024-10-30T15:13:06.413Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:16.537 16:13:06 -- common/autotest_common.sh@950 -- # wait 2539111 00:29:16.537 16:13:06 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:16.537 16:13:06 -- host/digest.sh@77 -- # local rw bs qd 00:29:16.537 16:13:06 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:16.537 16:13:06 -- host/digest.sh@80 -- # rw=randread 00:29:16.537 16:13:06 -- host/digest.sh@80 -- # bs=131072 00:29:16.537 16:13:06 -- host/digest.sh@80 -- # qd=16 00:29:16.537 16:13:06 -- host/digest.sh@82 -- # bperfpid=2539527 00:29:16.537 16:13:06 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:16.537 16:13:06 -- host/digest.sh@83 -- # waitforlisten 2539527 /var/tmp/bperf.sock 00:29:16.537 16:13:06 -- common/autotest_common.sh@819 -- # '[' -z 2539527 ']' 00:29:16.537 16:13:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:16.537 16:13:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:16.537 16:13:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:16.537 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:16.537 16:13:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:16.537 16:13:06 -- common/autotest_common.sh@10 -- # set +x 00:29:16.795 [2024-10-30 16:13:06.445217] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:16.795 [2024-10-30 16:13:06.445333] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2539527 ] 00:29:16.795 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:16.795 Zero copy mechanism will not be used. 00:29:16.795 EAL: No free 2048 kB hugepages reported on node 1 00:29:16.795 [2024-10-30 16:13:06.511394] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:16.795 [2024-10-30 16:13:06.601698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:16.795 16:13:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:16.795 16:13:06 -- common/autotest_common.sh@852 -- # return 0 00:29:16.795 16:13:06 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:16.795 16:13:06 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:16.795 16:13:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:17.361 16:13:07 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:17.361 16:13:07 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:17.620 nvme0n1 00:29:17.620 16:13:07 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:17.620 16:13:07 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:17.620 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:17.620 Zero copy mechanism will not be used. 00:29:17.620 Running I/O for 2 seconds... 00:29:20.148 00:29:20.148 Latency(us) 00:29:20.148 [2024-10-30T15:13:10.024Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:20.148 [2024-10-30T15:13:10.024Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:20.148 nvme0n1 : 2.00 6301.04 787.63 0.00 0.00 2534.83 670.53 7621.59 00:29:20.148 [2024-10-30T15:13:10.024Z] =================================================================================================================== 00:29:20.148 [2024-10-30T15:13:10.024Z] Total : 6301.04 787.63 0.00 0.00 2534.83 670.53 7621.59 00:29:20.148 0 00:29:20.148 16:13:09 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:20.148 16:13:09 -- host/digest.sh@92 -- # get_accel_stats 00:29:20.148 16:13:09 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:20.148 16:13:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:20.148 16:13:09 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:20.148 | select(.opcode=="crc32c") 00:29:20.148 | "\(.module_name) \(.executed)"' 00:29:20.148 16:13:09 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:20.148 16:13:09 -- host/digest.sh@93 -- # exp_module=software 00:29:20.148 16:13:09 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:20.148 16:13:09 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:20.148 16:13:09 -- host/digest.sh@97 -- # killprocess 2539527 00:29:20.148 16:13:09 -- common/autotest_common.sh@926 -- # '[' -z 2539527 ']' 00:29:20.148 16:13:09 -- common/autotest_common.sh@930 -- # kill -0 2539527 00:29:20.148 16:13:09 -- common/autotest_common.sh@931 -- # uname 00:29:20.148 16:13:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:20.148 16:13:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2539527 00:29:20.148 16:13:09 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:20.148 16:13:09 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:20.148 16:13:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2539527' 00:29:20.148 killing process with pid 2539527 00:29:20.148 16:13:09 -- common/autotest_common.sh@945 -- # kill 2539527 00:29:20.148 Received shutdown signal, test time was about 2.000000 seconds 00:29:20.148 00:29:20.148 Latency(us) 00:29:20.148 [2024-10-30T15:13:10.024Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:20.148 [2024-10-30T15:13:10.024Z] =================================================================================================================== 00:29:20.148 [2024-10-30T15:13:10.024Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:20.148 16:13:09 -- common/autotest_common.sh@950 -- # wait 2539527 00:29:20.148 16:13:09 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:20.148 16:13:09 -- host/digest.sh@77 -- # local rw bs qd 00:29:20.148 16:13:09 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:20.148 16:13:09 -- host/digest.sh@80 -- # rw=randwrite 00:29:20.148 16:13:09 -- host/digest.sh@80 -- # bs=4096 00:29:20.148 16:13:09 -- host/digest.sh@80 -- # qd=128 00:29:20.148 16:13:09 -- host/digest.sh@82 -- # bperfpid=2540068 00:29:20.148 16:13:09 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:20.148 16:13:09 -- host/digest.sh@83 -- # waitforlisten 2540068 /var/tmp/bperf.sock 00:29:20.148 16:13:09 -- common/autotest_common.sh@819 -- # '[' -z 2540068 ']' 00:29:20.148 16:13:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:20.148 16:13:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:20.148 16:13:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:20.148 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:20.148 16:13:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:20.148 16:13:09 -- common/autotest_common.sh@10 -- # set +x 00:29:20.405 [2024-10-30 16:13:10.038633] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:20.405 [2024-10-30 16:13:10.038717] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2540068 ] 00:29:20.405 EAL: No free 2048 kB hugepages reported on node 1 00:29:20.405 [2024-10-30 16:13:10.100161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:20.405 [2024-10-30 16:13:10.189616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:20.405 16:13:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:20.405 16:13:10 -- common/autotest_common.sh@852 -- # return 0 00:29:20.405 16:13:10 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:20.405 16:13:10 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:20.405 16:13:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:20.970 16:13:10 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:20.970 16:13:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:21.535 nvme0n1 00:29:21.535 16:13:11 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:21.535 16:13:11 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:21.535 Running I/O for 2 seconds... 00:29:23.432 00:29:23.432 Latency(us) 00:29:23.432 [2024-10-30T15:13:13.308Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:23.432 [2024-10-30T15:13:13.308Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:23.432 nvme0n1 : 2.01 20137.33 78.66 0.00 0.00 6347.73 2912.71 18544.26 00:29:23.432 [2024-10-30T15:13:13.308Z] =================================================================================================================== 00:29:23.432 [2024-10-30T15:13:13.308Z] Total : 20137.33 78.66 0.00 0.00 6347.73 2912.71 18544.26 00:29:23.432 0 00:29:23.432 16:13:13 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:23.432 16:13:13 -- host/digest.sh@92 -- # get_accel_stats 00:29:23.432 16:13:13 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:23.432 16:13:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:23.432 16:13:13 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:23.432 | select(.opcode=="crc32c") 00:29:23.432 | "\(.module_name) \(.executed)"' 00:29:23.690 16:13:13 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:23.690 16:13:13 -- host/digest.sh@93 -- # exp_module=software 00:29:23.690 16:13:13 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:23.690 16:13:13 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:23.690 16:13:13 -- host/digest.sh@97 -- # killprocess 2540068 00:29:23.690 16:13:13 -- common/autotest_common.sh@926 -- # '[' -z 2540068 ']' 00:29:23.690 16:13:13 -- common/autotest_common.sh@930 -- # kill -0 2540068 00:29:23.690 16:13:13 -- common/autotest_common.sh@931 -- # uname 00:29:23.690 16:13:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:23.690 16:13:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2540068 00:29:23.690 16:13:13 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:23.690 16:13:13 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:23.690 16:13:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2540068' 00:29:23.690 killing process with pid 2540068 00:29:23.690 16:13:13 -- common/autotest_common.sh@945 -- # kill 2540068 00:29:23.690 Received shutdown signal, test time was about 2.000000 seconds 00:29:23.690 00:29:23.690 Latency(us) 00:29:23.690 [2024-10-30T15:13:13.566Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:23.690 [2024-10-30T15:13:13.566Z] =================================================================================================================== 00:29:23.690 [2024-10-30T15:13:13.566Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:23.690 16:13:13 -- common/autotest_common.sh@950 -- # wait 2540068 00:29:23.947 16:13:13 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:23.947 16:13:13 -- host/digest.sh@77 -- # local rw bs qd 00:29:23.947 16:13:13 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:23.947 16:13:13 -- host/digest.sh@80 -- # rw=randwrite 00:29:23.947 16:13:13 -- host/digest.sh@80 -- # bs=131072 00:29:23.947 16:13:13 -- host/digest.sh@80 -- # qd=16 00:29:23.947 16:13:13 -- host/digest.sh@82 -- # bperfpid=2540495 00:29:23.947 16:13:13 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:23.947 16:13:13 -- host/digest.sh@83 -- # waitforlisten 2540495 /var/tmp/bperf.sock 00:29:23.947 16:13:13 -- common/autotest_common.sh@819 -- # '[' -z 2540495 ']' 00:29:23.947 16:13:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:23.947 16:13:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:23.947 16:13:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:23.947 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:23.947 16:13:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:23.947 16:13:13 -- common/autotest_common.sh@10 -- # set +x 00:29:23.947 [2024-10-30 16:13:13.820013] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:23.948 [2024-10-30 16:13:13.820091] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2540495 ] 00:29:23.948 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:23.948 Zero copy mechanism will not be used. 00:29:24.205 EAL: No free 2048 kB hugepages reported on node 1 00:29:24.205 [2024-10-30 16:13:13.883390] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:24.205 [2024-10-30 16:13:13.969044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:24.205 16:13:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:24.205 16:13:14 -- common/autotest_common.sh@852 -- # return 0 00:29:24.205 16:13:14 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:24.205 16:13:14 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:24.205 16:13:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:24.772 16:13:14 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:24.772 16:13:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:25.030 nvme0n1 00:29:25.030 16:13:14 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:25.030 16:13:14 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:25.030 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:25.030 Zero copy mechanism will not be used. 00:29:25.030 Running I/O for 2 seconds... 00:29:27.561 00:29:27.561 Latency(us) 00:29:27.561 [2024-10-30T15:13:17.437Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:27.561 [2024-10-30T15:13:17.437Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:27.561 nvme0n1 : 2.00 6550.33 818.79 0.00 0.00 2435.73 1832.58 10194.49 00:29:27.561 [2024-10-30T15:13:17.437Z] =================================================================================================================== 00:29:27.561 [2024-10-30T15:13:17.437Z] Total : 6550.33 818.79 0.00 0.00 2435.73 1832.58 10194.49 00:29:27.561 0 00:29:27.561 16:13:16 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:27.561 16:13:16 -- host/digest.sh@92 -- # get_accel_stats 00:29:27.561 16:13:16 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:27.561 16:13:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:27.561 16:13:16 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:27.561 | select(.opcode=="crc32c") 00:29:27.561 | "\(.module_name) \(.executed)"' 00:29:27.561 16:13:17 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:27.561 16:13:17 -- host/digest.sh@93 -- # exp_module=software 00:29:27.561 16:13:17 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:27.561 16:13:17 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:27.561 16:13:17 -- host/digest.sh@97 -- # killprocess 2540495 00:29:27.561 16:13:17 -- common/autotest_common.sh@926 -- # '[' -z 2540495 ']' 00:29:27.561 16:13:17 -- common/autotest_common.sh@930 -- # kill -0 2540495 00:29:27.561 16:13:17 -- common/autotest_common.sh@931 -- # uname 00:29:27.561 16:13:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:27.561 16:13:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2540495 00:29:27.561 16:13:17 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:27.561 16:13:17 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:27.561 16:13:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2540495' 00:29:27.561 killing process with pid 2540495 00:29:27.561 16:13:17 -- common/autotest_common.sh@945 -- # kill 2540495 00:29:27.561 Received shutdown signal, test time was about 2.000000 seconds 00:29:27.561 00:29:27.561 Latency(us) 00:29:27.561 [2024-10-30T15:13:17.437Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:27.561 [2024-10-30T15:13:17.437Z] =================================================================================================================== 00:29:27.561 [2024-10-30T15:13:17.437Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:27.561 16:13:17 -- common/autotest_common.sh@950 -- # wait 2540495 00:29:27.561 16:13:17 -- host/digest.sh@126 -- # killprocess 2539086 00:29:27.561 16:13:17 -- common/autotest_common.sh@926 -- # '[' -z 2539086 ']' 00:29:27.561 16:13:17 -- common/autotest_common.sh@930 -- # kill -0 2539086 00:29:27.561 16:13:17 -- common/autotest_common.sh@931 -- # uname 00:29:27.561 16:13:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:27.561 16:13:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2539086 00:29:27.561 16:13:17 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:27.561 16:13:17 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:27.561 16:13:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2539086' 00:29:27.561 killing process with pid 2539086 00:29:27.561 16:13:17 -- common/autotest_common.sh@945 -- # kill 2539086 00:29:27.561 16:13:17 -- common/autotest_common.sh@950 -- # wait 2539086 00:29:27.819 00:29:27.819 real 0m15.347s 00:29:27.819 user 0m30.498s 00:29:27.819 sys 0m4.320s 00:29:27.819 16:13:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:27.819 16:13:17 -- common/autotest_common.sh@10 -- # set +x 00:29:27.819 ************************************ 00:29:27.819 END TEST nvmf_digest_clean 00:29:27.819 ************************************ 00:29:27.819 16:13:17 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:27.819 16:13:17 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:27.819 16:13:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:27.819 16:13:17 -- common/autotest_common.sh@10 -- # set +x 00:29:27.819 ************************************ 00:29:27.819 START TEST nvmf_digest_error 00:29:27.819 ************************************ 00:29:27.819 16:13:17 -- common/autotest_common.sh@1104 -- # run_digest_error 00:29:27.819 16:13:17 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:27.819 16:13:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:27.819 16:13:17 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:27.819 16:13:17 -- common/autotest_common.sh@10 -- # set +x 00:29:27.819 16:13:17 -- nvmf/common.sh@469 -- # nvmfpid=2540938 00:29:27.819 16:13:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:27.819 16:13:17 -- nvmf/common.sh@470 -- # waitforlisten 2540938 00:29:27.819 16:13:17 -- common/autotest_common.sh@819 -- # '[' -z 2540938 ']' 00:29:27.819 16:13:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:27.819 16:13:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:27.819 16:13:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:27.819 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:27.819 16:13:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:27.819 16:13:17 -- common/autotest_common.sh@10 -- # set +x 00:29:27.819 [2024-10-30 16:13:17.674456] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:27.819 [2024-10-30 16:13:17.674560] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:28.077 EAL: No free 2048 kB hugepages reported on node 1 00:29:28.077 [2024-10-30 16:13:17.740794] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:28.077 [2024-10-30 16:13:17.829470] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:28.077 [2024-10-30 16:13:17.829625] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:28.077 [2024-10-30 16:13:17.829642] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:28.077 [2024-10-30 16:13:17.829654] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:28.077 [2024-10-30 16:13:17.829686] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:28.077 16:13:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:28.077 16:13:17 -- common/autotest_common.sh@852 -- # return 0 00:29:28.077 16:13:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:28.077 16:13:17 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:28.077 16:13:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.077 16:13:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:28.077 16:13:17 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:28.077 16:13:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:28.077 16:13:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.077 [2024-10-30 16:13:17.926337] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:28.077 16:13:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:28.077 16:13:17 -- host/digest.sh@104 -- # common_target_config 00:29:28.077 16:13:17 -- host/digest.sh@43 -- # rpc_cmd 00:29:28.077 16:13:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:28.077 16:13:17 -- common/autotest_common.sh@10 -- # set +x 00:29:28.336 null0 00:29:28.336 [2024-10-30 16:13:18.047029] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:28.336 [2024-10-30 16:13:18.071303] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:28.336 16:13:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:28.336 16:13:18 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:28.336 16:13:18 -- host/digest.sh@54 -- # local rw bs qd 00:29:28.336 16:13:18 -- host/digest.sh@56 -- # rw=randread 00:29:28.336 16:13:18 -- host/digest.sh@56 -- # bs=4096 00:29:28.336 16:13:18 -- host/digest.sh@56 -- # qd=128 00:29:28.336 16:13:18 -- host/digest.sh@58 -- # bperfpid=2541082 00:29:28.336 16:13:18 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:28.336 16:13:18 -- host/digest.sh@60 -- # waitforlisten 2541082 /var/tmp/bperf.sock 00:29:28.336 16:13:18 -- common/autotest_common.sh@819 -- # '[' -z 2541082 ']' 00:29:28.336 16:13:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:28.336 16:13:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:28.336 16:13:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:28.336 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:28.336 16:13:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:28.336 16:13:18 -- common/autotest_common.sh@10 -- # set +x 00:29:28.336 [2024-10-30 16:13:18.120726] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:28.336 [2024-10-30 16:13:18.120804] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2541082 ] 00:29:28.336 EAL: No free 2048 kB hugepages reported on node 1 00:29:28.336 [2024-10-30 16:13:18.186997] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:28.594 [2024-10-30 16:13:18.275810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:29.527 16:13:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:29.527 16:13:19 -- common/autotest_common.sh@852 -- # return 0 00:29:29.527 16:13:19 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:29.527 16:13:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:29.527 16:13:19 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:29.527 16:13:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:29.527 16:13:19 -- common/autotest_common.sh@10 -- # set +x 00:29:29.527 16:13:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:29.527 16:13:19 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:29.527 16:13:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:30.092 nvme0n1 00:29:30.092 16:13:19 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:30.092 16:13:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:30.093 16:13:19 -- common/autotest_common.sh@10 -- # set +x 00:29:30.093 16:13:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:30.093 16:13:19 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:30.093 16:13:19 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:30.093 Running I/O for 2 seconds... 00:29:30.093 [2024-10-30 16:13:19.857037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.093 [2024-10-30 16:13:19.857096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:19875 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.093 [2024-10-30 16:13:19.857120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.093 [2024-10-30 16:13:19.873906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.093 [2024-10-30 16:13:19.873937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:16730 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.093 [2024-10-30 16:13:19.873969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.093 [2024-10-30 16:13:19.884711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.093 [2024-10-30 16:13:19.884745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:9192 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.093 [2024-10-30 16:13:19.884765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.093 [2024-10-30 16:13:19.901131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.093 [2024-10-30 16:13:19.901167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:23572 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.093 [2024-10-30 16:13:19.901187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.093 [2024-10-30 16:13:19.917407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.093 [2024-10-30 16:13:19.917437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20036 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.093 [2024-10-30 16:13:19.917476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.093 [2024-10-30 16:13:19.935159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.093 [2024-10-30 16:13:19.935190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:15591 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.093 [2024-10-30 16:13:19.935207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.093 [2024-10-30 16:13:19.946376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.093 [2024-10-30 16:13:19.946407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15470 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.093 [2024-10-30 16:13:19.946424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.093 [2024-10-30 16:13:19.961569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.093 [2024-10-30 16:13:19.961604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:6547 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.093 [2024-10-30 16:13:19.961623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:19.975400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:19.975429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:13278 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:19.975445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:19.991965] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:19.991999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:16719 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:19.992019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.008594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.008630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:11002 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.008649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.025746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.025781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:23934 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.025814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.040856] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.040903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:14149 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.040921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.051126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.051169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:7507 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.051189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.065286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.065335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17043 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.065351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.077574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.077608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:21643 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.077627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.090432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.090464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:11065 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.090481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.105136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.105173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:1308 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.105194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.120889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.120924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:23350 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.120943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.139159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.139194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:10208 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.139212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.155218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.155272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:1643 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.155293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.171085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.171128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:19531 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.171153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.185935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.185972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:24521 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.185990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.203110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.203147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:14099 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.203166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.351 [2024-10-30 16:13:20.219950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.351 [2024-10-30 16:13:20.219984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:9599 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.351 [2024-10-30 16:13:20.220003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.233903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.233934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:14315 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.233951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.246046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.246081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:7207 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.246099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.262783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.262817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6698 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.262835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.278469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.278496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14595 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.278527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.290344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.290373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:4220 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.290404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.303721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.303762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:5915 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.303782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.318607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.318640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:21399 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.318659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.329593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.329626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25468 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.329644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.342815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.342848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:1001 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.342866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.359580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.359614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:2140 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.359632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.375092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.375127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:21060 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.375146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.392639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.392675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:20312 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.392694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.407884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.407919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12178 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.407939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.423120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.423156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:25237 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.423175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.434277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.434326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:17283 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.434344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.448406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.448435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:3324 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.448467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.462755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.462791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:10819 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.462811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.609 [2024-10-30 16:13:20.475712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.609 [2024-10-30 16:13:20.475747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:18784 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.609 [2024-10-30 16:13:20.475769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.866 [2024-10-30 16:13:20.492329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.866 [2024-10-30 16:13:20.492361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:17693 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.866 [2024-10-30 16:13:20.492378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.866 [2024-10-30 16:13:20.503573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.866 [2024-10-30 16:13:20.503621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:183 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.866 [2024-10-30 16:13:20.503640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.866 [2024-10-30 16:13:20.516543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.866 [2024-10-30 16:13:20.516591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8761 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.866 [2024-10-30 16:13:20.516611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.866 [2024-10-30 16:13:20.531032] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.866 [2024-10-30 16:13:20.531070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:11076 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.866 [2024-10-30 16:13:20.531089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.866 [2024-10-30 16:13:20.548032] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.866 [2024-10-30 16:13:20.548067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:25412 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.866 [2024-10-30 16:13:20.548095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.866 [2024-10-30 16:13:20.565534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.866 [2024-10-30 16:13:20.565584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18636 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.866 [2024-10-30 16:13:20.565603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.867 [2024-10-30 16:13:20.579046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.867 [2024-10-30 16:13:20.579089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:16162 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.867 [2024-10-30 16:13:20.579130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.867 [2024-10-30 16:13:20.594971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.867 [2024-10-30 16:13:20.595007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:3006 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.867 [2024-10-30 16:13:20.595026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.867 [2024-10-30 16:13:20.606666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.867 [2024-10-30 16:13:20.606702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:23200 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.867 [2024-10-30 16:13:20.606721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.867 [2024-10-30 16:13:20.623029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.867 [2024-10-30 16:13:20.623064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:24427 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.867 [2024-10-30 16:13:20.623083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.867 [2024-10-30 16:13:20.639789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.867 [2024-10-30 16:13:20.639824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:23581 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.867 [2024-10-30 16:13:20.639844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.867 [2024-10-30 16:13:20.655713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.867 [2024-10-30 16:13:20.655748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:10548 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.867 [2024-10-30 16:13:20.655768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.867 [2024-10-30 16:13:20.670506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.867 [2024-10-30 16:13:20.670536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:19012 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.867 [2024-10-30 16:13:20.670567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.867 [2024-10-30 16:13:20.684888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.867 [2024-10-30 16:13:20.684929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:18616 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.867 [2024-10-30 16:13:20.684948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.867 [2024-10-30 16:13:20.702152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.867 [2024-10-30 16:13:20.702187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:11701 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.867 [2024-10-30 16:13:20.702206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.867 [2024-10-30 16:13:20.718512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.867 [2024-10-30 16:13:20.718543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:25346 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.867 [2024-10-30 16:13:20.718560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:30.867 [2024-10-30 16:13:20.732664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:30.867 [2024-10-30 16:13:20.732699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:6583 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.867 [2024-10-30 16:13:20.732719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.750821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.750856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:8385 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.750875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.767702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.767737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:24554 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.767757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.784285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.784313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:16240 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.784344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.797738] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.797773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:2800 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.797793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.808790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.808825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:20874 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.808843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.822976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.823011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16423 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.823030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.834785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.834818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:22968 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.834836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.846389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.846416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:12370 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.846447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.859194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.859226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:260 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.859245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.870524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.870568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22348 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.870584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.883928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.883962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:1029 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.883980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.901301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.901340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:25268 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.901357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.915710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.915744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:24336 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.915762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.927707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.927755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:19364 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.927778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.941901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.941934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:20846 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.941951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.959492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.959520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:16218 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.959550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.972780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.972811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10112 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.972827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.984029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.984062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:21231 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.984081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.126 [2024-10-30 16:13:20.999463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.126 [2024-10-30 16:13:20.999494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:23550 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.126 [2024-10-30 16:13:20.999520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.385 [2024-10-30 16:13:21.016404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.385 [2024-10-30 16:13:21.016435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:16892 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.385 [2024-10-30 16:13:21.016460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.385 [2024-10-30 16:13:21.032215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.385 [2024-10-30 16:13:21.032251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10262 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.385 [2024-10-30 16:13:21.032292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.385 [2024-10-30 16:13:21.045888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.385 [2024-10-30 16:13:21.045925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:1112 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.386 [2024-10-30 16:13:21.045955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.386 [2024-10-30 16:13:21.057369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.386 [2024-10-30 16:13:21.057410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:685 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.386 [2024-10-30 16:13:21.057440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.386 [2024-10-30 16:13:21.073442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.386 [2024-10-30 16:13:21.073472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:12989 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.386 [2024-10-30 16:13:21.073496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.386 [2024-10-30 16:13:21.091054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.386 [2024-10-30 16:13:21.091091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:3715 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.386 [2024-10-30 16:13:21.091121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.386 [2024-10-30 16:13:21.107743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.386 [2024-10-30 16:13:21.107779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14974 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.386 [2024-10-30 16:13:21.107809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.386 [2024-10-30 16:13:21.124297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.386 [2024-10-30 16:13:21.124345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14182 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.386 [2024-10-30 16:13:21.124369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.386 [2024-10-30 16:13:21.140832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.386 [2024-10-30 16:13:21.140868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:18484 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.386 [2024-10-30 16:13:21.140898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.386 [2024-10-30 16:13:21.157663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.386 [2024-10-30 16:13:21.157700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:615 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.386 [2024-10-30 16:13:21.157732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.386 [2024-10-30 16:13:21.174939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.386 [2024-10-30 16:13:21.174976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:13678 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.386 [2024-10-30 16:13:21.175006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.386 [2024-10-30 16:13:21.191722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.386 [2024-10-30 16:13:21.191758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:259 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.386 [2024-10-30 16:13:21.191795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.386 [2024-10-30 16:13:21.208299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.386 [2024-10-30 16:13:21.208329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:15718 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.386 [2024-10-30 16:13:21.208354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.386 [2024-10-30 16:13:21.225305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.386 [2024-10-30 16:13:21.225352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:16213 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.386 [2024-10-30 16:13:21.225377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.386 [2024-10-30 16:13:21.241835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.386 [2024-10-30 16:13:21.241881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:8359 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.386 [2024-10-30 16:13:21.241912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.386 [2024-10-30 16:13:21.258960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.386 [2024-10-30 16:13:21.258997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:17740 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.386 [2024-10-30 16:13:21.259027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.276053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.276089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:25544 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.276120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.292925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.292962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:17103 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.292993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.309652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.309689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:13588 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.309718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.326444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.326474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:25339 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.326500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.343198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.343241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:12608 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.343285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.359815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.359851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:3655 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.359882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.376684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.376720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:25365 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.376750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.393195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.393231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:13242 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.393269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.410958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.410993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9763 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.411026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.427934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.427971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:284 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.428001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.443084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.443120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:23669 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.443150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.461547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.461591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:15906 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.461615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.478265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.478300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11064 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.478340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.494921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.494957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20129 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.494988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.645 [2024-10-30 16:13:21.512217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.645 [2024-10-30 16:13:21.512254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:2675 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.645 [2024-10-30 16:13:21.512293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.904 [2024-10-30 16:13:21.523793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.904 [2024-10-30 16:13:21.523829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:8124 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.904 [2024-10-30 16:13:21.523860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.904 [2024-10-30 16:13:21.538806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.904 [2024-10-30 16:13:21.538842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:9138 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.904 [2024-10-30 16:13:21.538872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.904 [2024-10-30 16:13:21.555639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.904 [2024-10-30 16:13:21.555675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:20503 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.904 [2024-10-30 16:13:21.555704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.904 [2024-10-30 16:13:21.572367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.904 [2024-10-30 16:13:21.572397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:12220 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.904 [2024-10-30 16:13:21.572422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.904 [2024-10-30 16:13:21.589461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.904 [2024-10-30 16:13:21.589493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:5891 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.904 [2024-10-30 16:13:21.589519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.904 [2024-10-30 16:13:21.606677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.904 [2024-10-30 16:13:21.606713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:15162 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.904 [2024-10-30 16:13:21.606744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.904 [2024-10-30 16:13:21.623491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.904 [2024-10-30 16:13:21.623521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:12977 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.904 [2024-10-30 16:13:21.623573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.904 [2024-10-30 16:13:21.640443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.904 [2024-10-30 16:13:21.640475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:5742 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.904 [2024-10-30 16:13:21.640501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.904 [2024-10-30 16:13:21.657454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.904 [2024-10-30 16:13:21.657484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:4448 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.904 [2024-10-30 16:13:21.657508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.904 [2024-10-30 16:13:21.674921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.904 [2024-10-30 16:13:21.674955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:5090 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.904 [2024-10-30 16:13:21.674984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.904 [2024-10-30 16:13:21.691968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.904 [2024-10-30 16:13:21.692005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:398 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.904 [2024-10-30 16:13:21.692035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.904 [2024-10-30 16:13:21.703235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.904 [2024-10-30 16:13:21.703295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:11799 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.904 [2024-10-30 16:13:21.703326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.904 [2024-10-30 16:13:21.719001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.904 [2024-10-30 16:13:21.719038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:6443 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.904 [2024-10-30 16:13:21.719067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.904 [2024-10-30 16:13:21.735859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.904 [2024-10-30 16:13:21.735894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:11314 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.904 [2024-10-30 16:13:21.735924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.905 [2024-10-30 16:13:21.752690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.905 [2024-10-30 16:13:21.752727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:13250 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.905 [2024-10-30 16:13:21.752757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.905 [2024-10-30 16:13:21.769628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:31.905 [2024-10-30 16:13:21.769670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:18866 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.905 [2024-10-30 16:13:21.769701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.163 [2024-10-30 16:13:21.786834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:32.163 [2024-10-30 16:13:21.786872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:15279 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.163 [2024-10-30 16:13:21.786902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.163 [2024-10-30 16:13:21.803580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:32.163 [2024-10-30 16:13:21.803609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20766 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.163 [2024-10-30 16:13:21.803651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.163 [2024-10-30 16:13:21.820548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:32.163 [2024-10-30 16:13:21.820597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:9805 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.163 [2024-10-30 16:13:21.820626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.163 [2024-10-30 16:13:21.836714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xa4c300) 00:29:32.163 [2024-10-30 16:13:21.836752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:15792 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.163 [2024-10-30 16:13:21.836783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.163 00:29:32.163 Latency(us) 00:29:32.163 [2024-10-30T15:13:22.039Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:32.163 [2024-10-30T15:13:22.039Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:32.163 nvme0n1 : 2.01 16532.97 64.58 0.00 0.00 7734.35 3640.89 27185.30 00:29:32.163 [2024-10-30T15:13:22.039Z] =================================================================================================================== 00:29:32.163 [2024-10-30T15:13:22.039Z] Total : 16532.97 64.58 0.00 0.00 7734.35 3640.89 27185.30 00:29:32.163 0 00:29:32.163 16:13:21 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:32.163 16:13:21 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:32.163 16:13:21 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:32.163 | .driver_specific 00:29:32.163 | .nvme_error 00:29:32.163 | .status_code 00:29:32.163 | .command_transient_transport_error' 00:29:32.163 16:13:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:32.422 16:13:22 -- host/digest.sh@71 -- # (( 130 > 0 )) 00:29:32.422 16:13:22 -- host/digest.sh@73 -- # killprocess 2541082 00:29:32.422 16:13:22 -- common/autotest_common.sh@926 -- # '[' -z 2541082 ']' 00:29:32.422 16:13:22 -- common/autotest_common.sh@930 -- # kill -0 2541082 00:29:32.422 16:13:22 -- common/autotest_common.sh@931 -- # uname 00:29:32.422 16:13:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:32.422 16:13:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2541082 00:29:32.422 16:13:22 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:32.422 16:13:22 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:32.422 16:13:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2541082' 00:29:32.422 killing process with pid 2541082 00:29:32.422 16:13:22 -- common/autotest_common.sh@945 -- # kill 2541082 00:29:32.422 Received shutdown signal, test time was about 2.000000 seconds 00:29:32.422 00:29:32.422 Latency(us) 00:29:32.422 [2024-10-30T15:13:22.298Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:32.422 [2024-10-30T15:13:22.298Z] =================================================================================================================== 00:29:32.422 [2024-10-30T15:13:22.298Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:32.422 16:13:22 -- common/autotest_common.sh@950 -- # wait 2541082 00:29:32.681 16:13:22 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:32.681 16:13:22 -- host/digest.sh@54 -- # local rw bs qd 00:29:32.681 16:13:22 -- host/digest.sh@56 -- # rw=randread 00:29:32.681 16:13:22 -- host/digest.sh@56 -- # bs=131072 00:29:32.681 16:13:22 -- host/digest.sh@56 -- # qd=16 00:29:32.681 16:13:22 -- host/digest.sh@58 -- # bperfpid=2541516 00:29:32.681 16:13:22 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:32.681 16:13:22 -- host/digest.sh@60 -- # waitforlisten 2541516 /var/tmp/bperf.sock 00:29:32.681 16:13:22 -- common/autotest_common.sh@819 -- # '[' -z 2541516 ']' 00:29:32.681 16:13:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:32.681 16:13:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:32.681 16:13:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:32.681 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:32.681 16:13:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:32.681 16:13:22 -- common/autotest_common.sh@10 -- # set +x 00:29:32.681 [2024-10-30 16:13:22.395097] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:32.681 [2024-10-30 16:13:22.395172] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2541516 ] 00:29:32.681 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:32.681 Zero copy mechanism will not be used. 00:29:32.681 EAL: No free 2048 kB hugepages reported on node 1 00:29:32.681 [2024-10-30 16:13:22.459866] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:32.681 [2024-10-30 16:13:22.547280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:33.615 16:13:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:33.615 16:13:23 -- common/autotest_common.sh@852 -- # return 0 00:29:33.615 16:13:23 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:33.615 16:13:23 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:33.873 16:13:23 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:33.873 16:13:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:33.873 16:13:23 -- common/autotest_common.sh@10 -- # set +x 00:29:33.873 16:13:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:33.873 16:13:23 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:33.873 16:13:23 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:34.441 nvme0n1 00:29:34.441 16:13:24 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:34.441 16:13:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:34.441 16:13:24 -- common/autotest_common.sh@10 -- # set +x 00:29:34.441 16:13:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:34.441 16:13:24 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:34.441 16:13:24 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:34.441 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:34.441 Zero copy mechanism will not be used. 00:29:34.441 Running I/O for 2 seconds... 00:29:34.441 [2024-10-30 16:13:24.138810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.441 [2024-10-30 16:13:24.138870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.441 [2024-10-30 16:13:24.138904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.441 [2024-10-30 16:13:24.144567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.441 [2024-10-30 16:13:24.144614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.441 [2024-10-30 16:13:24.144641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.441 [2024-10-30 16:13:24.150108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.441 [2024-10-30 16:13:24.150144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.441 [2024-10-30 16:13:24.150176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.441 [2024-10-30 16:13:24.155518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.441 [2024-10-30 16:13:24.155551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.441 [2024-10-30 16:13:24.155580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.441 [2024-10-30 16:13:24.160722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.441 [2024-10-30 16:13:24.160759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.441 [2024-10-30 16:13:24.160790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.441 [2024-10-30 16:13:24.166841] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.441 [2024-10-30 16:13:24.166888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.441 [2024-10-30 16:13:24.166923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.441 [2024-10-30 16:13:24.171702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.441 [2024-10-30 16:13:24.171739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.441 [2024-10-30 16:13:24.171770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.441 [2024-10-30 16:13:24.177057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.441 [2024-10-30 16:13:24.177095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.441 [2024-10-30 16:13:24.177126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.441 [2024-10-30 16:13:24.182364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.441 [2024-10-30 16:13:24.182396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.441 [2024-10-30 16:13:24.182432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.441 [2024-10-30 16:13:24.187498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.441 [2024-10-30 16:13:24.187530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.441 [2024-10-30 16:13:24.187556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.441 [2024-10-30 16:13:24.192727] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.441 [2024-10-30 16:13:24.192764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.441 [2024-10-30 16:13:24.192795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.441 [2024-10-30 16:13:24.197847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.441 [2024-10-30 16:13:24.197884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.441 [2024-10-30 16:13:24.197915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.441 [2024-10-30 16:13:24.203275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.441 [2024-10-30 16:13:24.203323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.441 [2024-10-30 16:13:24.203350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.441 [2024-10-30 16:13:24.208540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.441 [2024-10-30 16:13:24.208577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.441 [2024-10-30 16:13:24.208609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.214205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.214242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.214283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.219840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.219877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.219908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.225114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.225150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.225181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.230567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.230615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.230648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.235903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.235940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.235970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.241450] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.241481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.241508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.246830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.246867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.246899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.252233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.252279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.252325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.257526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.257557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.257600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.262562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.262607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.262648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.268125] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.268163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.268194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.273464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.273495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.273542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.278590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.278627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.278659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.284066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.284103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.284134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.289582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.289632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.289662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.295693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.295738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.295772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.300419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.300450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.300477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.306463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.306494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.306520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.311876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.311913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.311944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.442 [2024-10-30 16:13:24.317216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.442 [2024-10-30 16:13:24.317254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.442 [2024-10-30 16:13:24.317314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.702 [2024-10-30 16:13:24.322488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.702 [2024-10-30 16:13:24.322524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.702 [2024-10-30 16:13:24.322566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.702 [2024-10-30 16:13:24.327732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.702 [2024-10-30 16:13:24.327768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.702 [2024-10-30 16:13:24.327799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.702 [2024-10-30 16:13:24.333107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.702 [2024-10-30 16:13:24.333145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.702 [2024-10-30 16:13:24.333176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.702 [2024-10-30 16:13:24.338400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.702 [2024-10-30 16:13:24.338431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.702 [2024-10-30 16:13:24.338457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.702 [2024-10-30 16:13:24.343594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.702 [2024-10-30 16:13:24.343645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.702 [2024-10-30 16:13:24.343677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.702 [2024-10-30 16:13:24.348950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.702 [2024-10-30 16:13:24.348988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.702 [2024-10-30 16:13:24.349019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.702 [2024-10-30 16:13:24.354402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.702 [2024-10-30 16:13:24.354433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.702 [2024-10-30 16:13:24.354460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.702 [2024-10-30 16:13:24.359710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.702 [2024-10-30 16:13:24.359746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.702 [2024-10-30 16:13:24.359776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.702 [2024-10-30 16:13:24.365141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.702 [2024-10-30 16:13:24.365177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.702 [2024-10-30 16:13:24.365209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.702 [2024-10-30 16:13:24.370608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.702 [2024-10-30 16:13:24.370645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.702 [2024-10-30 16:13:24.370677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.702 [2024-10-30 16:13:24.375994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.702 [2024-10-30 16:13:24.376032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.702 [2024-10-30 16:13:24.376063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.381155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.381192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.381224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.386284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.386331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.386357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.391632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.391669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.391700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.397035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.397072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.397104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.402764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.402801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.402832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.408510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.408557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.408584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.413807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.413844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.413883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.419219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.419264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.419309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.424425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.424456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.424482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.429757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.429794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.429825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.435097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.435133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.435165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.440524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.440573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.440604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.445824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.445861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.445892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.451137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.451174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.451205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.456545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.456594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.456625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.462109] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.462156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.462189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.466941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.466978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.467009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.472464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.472510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.472535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.477868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.477905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.477936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.482961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.482999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.483030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.488231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.488278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.488312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.493626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.493664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.493695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.499016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.499054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.499085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.504411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.504442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.504482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.509889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.509926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.509958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.515401] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.515449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.515476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.520865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.520903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.520934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.526402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.703 [2024-10-30 16:13:24.526448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.703 [2024-10-30 16:13:24.526473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.703 [2024-10-30 16:13:24.531785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.704 [2024-10-30 16:13:24.531822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.704 [2024-10-30 16:13:24.531853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.704 [2024-10-30 16:13:24.537310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.704 [2024-10-30 16:13:24.537342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.704 [2024-10-30 16:13:24.537368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.704 [2024-10-30 16:13:24.542613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.704 [2024-10-30 16:13:24.542651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.704 [2024-10-30 16:13:24.542682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.704 [2024-10-30 16:13:24.548049] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.704 [2024-10-30 16:13:24.548085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.704 [2024-10-30 16:13:24.548117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.704 [2024-10-30 16:13:24.553305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.704 [2024-10-30 16:13:24.553337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.704 [2024-10-30 16:13:24.553371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.704 [2024-10-30 16:13:24.558674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.704 [2024-10-30 16:13:24.558712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.704 [2024-10-30 16:13:24.558743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.704 [2024-10-30 16:13:24.564229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.704 [2024-10-30 16:13:24.564274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.704 [2024-10-30 16:13:24.564317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.704 [2024-10-30 16:13:24.569425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.704 [2024-10-30 16:13:24.569457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.704 [2024-10-30 16:13:24.569485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.704 [2024-10-30 16:13:24.574464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.704 [2024-10-30 16:13:24.574497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.704 [2024-10-30 16:13:24.574536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.579752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.579793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.579824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.585200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.585237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.585279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.590741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.590779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.590811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.596041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.596078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.596109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.601456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.601503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.601544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.606969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.607016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.607047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.612368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.612400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.612426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.618695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.618733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.618764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.624147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.624197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.624228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.629709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.629747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.629778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.635221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.635277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.635322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.640749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.640787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.640819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.646363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.646394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.646440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.651840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.651879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.651910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.657347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.657381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.657409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.662773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.662812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.662843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.668389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.668422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.668450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.673907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.673946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.673978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.679481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.679515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.679556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.685317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.964 [2024-10-30 16:13:24.685351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.964 [2024-10-30 16:13:24.685380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.964 [2024-10-30 16:13:24.691341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.691375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.691404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.697167] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.697211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.697242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.702703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.702741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.702781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.708385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.708418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.708445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.713979] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.714016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.714047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.720554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.720594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.720643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.728045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.728083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.728114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.734748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.734787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.734819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.740957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.740994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.741024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.746869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.746908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.746939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.752587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.752639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.752671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.757420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.757453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.757480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.762075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.762113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.762144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.767050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.767087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.767118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.772318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.772349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.772376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.777870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.777907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.777938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.783308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.783340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.783379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.788728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.788765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.788796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.794222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.794268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.794317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.799655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.799692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.799723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.805355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.805401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.805427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.810670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.810708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.810739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.816168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.816205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.965 [2024-10-30 16:13:24.816236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:34.965 [2024-10-30 16:13:24.821360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.965 [2024-10-30 16:13:24.821392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.966 [2024-10-30 16:13:24.821418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:34.966 [2024-10-30 16:13:24.826874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.966 [2024-10-30 16:13:24.826911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.966 [2024-10-30 16:13:24.826942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:34.966 [2024-10-30 16:13:24.832128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.966 [2024-10-30 16:13:24.832166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.966 [2024-10-30 16:13:24.832197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:34.966 [2024-10-30 16:13:24.837531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:34.966 [2024-10-30 16:13:24.837564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:34.966 [2024-10-30 16:13:24.837609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.842812] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.842857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.842889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.848891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.848929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.848960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.855031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.855068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.855100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.861459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.861492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.861520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.867745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.867784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.867815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.874099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.874138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.874168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.880513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.880566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.880593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.887134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.887180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.887211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.893629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.893678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.893712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.899497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.899553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.899591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.905488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.905521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.905551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.910361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.910395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.910422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.915507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.915541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.915585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.920504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.920538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.920580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.925520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.925554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.925597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.930434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.930468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.930496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.935358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.935392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.935420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.940280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.940327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.940360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.945780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.945817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.945849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.951222] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.951269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.951315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.956725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.956764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.956795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.962236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.962296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.962323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.967668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.967706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.967737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.973142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.973180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.973211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.978607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.978644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.978676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.984122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.984159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.984190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.989493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.989531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.226 [2024-10-30 16:13:24.989558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.226 [2024-10-30 16:13:24.994921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.226 [2024-10-30 16:13:24.994959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:24.994991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.000331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.000379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.000406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.005824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.005863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.005895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.011137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.011176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.011208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.016473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.016505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.016532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.021700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.021738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.021769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.027083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.027121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.027153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.032478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.032526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.032553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.037936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.037974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.038006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.043315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.043347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.043388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.048638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.048670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.048714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.054165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.054212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.054245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.058707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.058744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.058764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.063129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.063166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.063187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.067838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.067874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.067895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.072677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.072714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.072734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.077393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.077426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.077450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.082137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.082174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.082195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.087453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.087485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.087502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.092896] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.092933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.092954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.227 [2024-10-30 16:13:25.098272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.227 [2024-10-30 16:13:25.098320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.227 [2024-10-30 16:13:25.098338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.487 [2024-10-30 16:13:25.103711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.487 [2024-10-30 16:13:25.103747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.487 [2024-10-30 16:13:25.103768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.487 [2024-10-30 16:13:25.108973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.487 [2024-10-30 16:13:25.109010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.487 [2024-10-30 16:13:25.109030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.487 [2024-10-30 16:13:25.114373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.487 [2024-10-30 16:13:25.114417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.114434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.119848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.119884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.119905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.125267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.125327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.125346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.130531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.130579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.130598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.135988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.136025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.136045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.141477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.141513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.141531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.147106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.147143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.147163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.152529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.152562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.152595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.157596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.157632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.157653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.163113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.163151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.163171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.168475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.168508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.168541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.173878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.173915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.173935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.179440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.179487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.179505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.184824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.184860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.184880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.190369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.190399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.190432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.195863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.195899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.195920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.201305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.201336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.201353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.206734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.206771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.206791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.212127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.212164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.212185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.217516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.217570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.217588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.223385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.223416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.223433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.228828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.228866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.228886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.234244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.234306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.234324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.239678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.239715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.239735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.245320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.245357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.245401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.249987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.250024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.250045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.254908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.254945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.254967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.259706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.259743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.488 [2024-10-30 16:13:25.259763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.488 [2024-10-30 16:13:25.265245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.488 [2024-10-30 16:13:25.265310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.265332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.269982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.270019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.270039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.274918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.274955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.274976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.279389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.279421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.279440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.284317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.284349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.284366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.288958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.288994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.289015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.293624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.293661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.293681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.298779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.298816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.298836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.303847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.303884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.303911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.308710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.308746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.308767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.314137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.314173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.314193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.319650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.319686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.319706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.325437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.325469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.325487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.330840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.330876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.330896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.336323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.336354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.336372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.341756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.341792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.341813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.347329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.347383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.347413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.351997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.352040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.352062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.356792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.356828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.356849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.489 [2024-10-30 16:13:25.362136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.489 [2024-10-30 16:13:25.362172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.489 [2024-10-30 16:13:25.362191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.748 [2024-10-30 16:13:25.367907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.748 [2024-10-30 16:13:25.367945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.748 [2024-10-30 16:13:25.367965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.748 [2024-10-30 16:13:25.373815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.748 [2024-10-30 16:13:25.373851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.748 [2024-10-30 16:13:25.373872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.748 [2024-10-30 16:13:25.379374] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.748 [2024-10-30 16:13:25.379405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.748 [2024-10-30 16:13:25.379422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.748 [2024-10-30 16:13:25.384443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.748 [2024-10-30 16:13:25.384490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.748 [2024-10-30 16:13:25.384507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.748 [2024-10-30 16:13:25.389788] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.748 [2024-10-30 16:13:25.389824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.748 [2024-10-30 16:13:25.389844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.748 [2024-10-30 16:13:25.395026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.748 [2024-10-30 16:13:25.395063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.748 [2024-10-30 16:13:25.395083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.748 [2024-10-30 16:13:25.400249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.748 [2024-10-30 16:13:25.400312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.748 [2024-10-30 16:13:25.400331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.748 [2024-10-30 16:13:25.405562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.748 [2024-10-30 16:13:25.405598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.748 [2024-10-30 16:13:25.405618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.748 [2024-10-30 16:13:25.410956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.748 [2024-10-30 16:13:25.410993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.748 [2024-10-30 16:13:25.411014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.748 [2024-10-30 16:13:25.416343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.748 [2024-10-30 16:13:25.416390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.748 [2024-10-30 16:13:25.416408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.748 [2024-10-30 16:13:25.421706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.748 [2024-10-30 16:13:25.421741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.748 [2024-10-30 16:13:25.421761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.748 [2024-10-30 16:13:25.427008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.748 [2024-10-30 16:13:25.427045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.748 [2024-10-30 16:13:25.427065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.748 [2024-10-30 16:13:25.432490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.748 [2024-10-30 16:13:25.432522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.748 [2024-10-30 16:13:25.432553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.748 [2024-10-30 16:13:25.437933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.437969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.437990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.443375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.443407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.443434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.448694] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.448730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.448750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.453906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.453943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.453963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.459028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.459065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.459085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.464752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.464789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.464809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.471397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.471428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.471445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.478822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.478860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.478880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.486410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.486440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.486458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.493877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.493914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.493934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.501397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.501433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.501451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.509048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.509094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.509128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.515715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.515755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.515787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.522412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.522460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.522478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.530038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.530075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.530096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.538206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.538242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.538272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.546715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.546763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.546797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.553669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.553709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.553730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.560662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.560709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.560740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.567527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.567576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.567602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.574687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.574724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.574745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.580170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.580215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.580240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.585705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.585752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.585783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.590534] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.590591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.590617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.595488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.595519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.595537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.600998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.601036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.601057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.606498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.606529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.606562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.611884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.611921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.611948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.749 [2024-10-30 16:13:25.617509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.749 [2024-10-30 16:13:25.617539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.749 [2024-10-30 16:13:25.617556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.750 [2024-10-30 16:13:25.623021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:35.750 [2024-10-30 16:13:25.623058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.750 [2024-10-30 16:13:25.623079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.628425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.628457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.628475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.633925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.633961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.633982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.639313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.639346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.639364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.644615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.644653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.644673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.649937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.649974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.649994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.655201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.655238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.655266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.660538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.660595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.660616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.665929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.665966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.665988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.671394] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.671427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.671445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.676865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.676902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.676923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.682339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.682387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.682405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.687690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.687728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.687750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.693290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.693339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.693358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.698712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.698749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.698770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.704300] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.704332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.704349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.709608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.709645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.709666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.714957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.714994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.715014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.720353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.720387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.720405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.726111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.726149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.726170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.731830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.731866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.731886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.737304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.737346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.737379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.742889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.742926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.742946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.748353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.748387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.748422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.753801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.753838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.753865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.759035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.759072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.759093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.764481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.010 [2024-10-30 16:13:25.764514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.010 [2024-10-30 16:13:25.764533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.010 [2024-10-30 16:13:25.769996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.770033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.770054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.775444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.775477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.775495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.780913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.780950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.780971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.786237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.786283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.786304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.791539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.791571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.791607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.797109] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.797147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.797168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.802394] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.802427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.802461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.807778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.807815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.807836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.813214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.813252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.813282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.818508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.818557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.818574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.824029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.824066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.824086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.828740] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.828781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.828803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.833487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.833520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.833539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.838599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.838636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.838656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.843994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.844029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.844056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.849422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.849455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.849474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.854824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.854861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.854881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.860096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.860133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.860153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.865405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.865439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.865457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.870760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.870797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.870817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.876225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.876270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.876309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.011 [2024-10-30 16:13:25.882057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.011 [2024-10-30 16:13:25.882094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.011 [2024-10-30 16:13:25.882115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.887482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.887516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.887534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.892859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.892902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.892922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.898420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.898453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.898471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.903882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.903918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.903938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.909434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.909468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.909486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.915330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.915362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.915379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.920677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.920714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.920734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.925975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.926011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.926032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.931292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.931340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.931359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.936570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.936602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.936638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.942236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.942298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.942319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.947889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.947925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.947945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.953514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.953567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.953586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.958960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.958996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.959016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.964380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.964428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.964446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.969802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.969838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.969858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.975280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.270 [2024-10-30 16:13:25.975332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.270 [2024-10-30 16:13:25.975350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.270 [2024-10-30 16:13:25.980660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:25.980696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:25.980716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:25.986323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:25.986355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:25.986378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:25.991803] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:25.991839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:25.991859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:25.997342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:25.997398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:25.997416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.002855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.002891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.002912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.008396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.008427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.008445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.013732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.013768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.013788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.019139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.019175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.019196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.024461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.024494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.024512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.030032] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.030069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.030090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.035472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.035511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.035530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.041072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.041109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.041129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.046657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.046693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.046713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.052039] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.052076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.052096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.057438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.057470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.057488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.062903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.062939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.062959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.068141] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.068178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.068198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.073272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.073321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.073339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.078653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.078690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.078711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.084137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.084173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.084193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.089589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.089626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.089647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.094913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.094949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.094969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.100335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.100368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.100401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.105735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.105771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.105792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.111193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.111230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.111250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.116462] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.116511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.116529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.121940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.121977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.121997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.127253] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.127313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.271 [2024-10-30 16:13:26.127337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.271 [2024-10-30 16:13:26.132716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.271 [2024-10-30 16:13:26.132753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.272 [2024-10-30 16:13:26.132774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.272 [2024-10-30 16:13:26.138081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x609190) 00:29:36.272 [2024-10-30 16:13:26.138117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.272 [2024-10-30 16:13:26.138137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.272 00:29:36.272 Latency(us) 00:29:36.272 [2024-10-30T15:13:26.148Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:36.272 [2024-10-30T15:13:26.148Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:36.272 nvme0n1 : 2.00 5656.04 707.01 0.00 0.00 2823.83 1286.45 8349.77 00:29:36.272 [2024-10-30T15:13:26.148Z] =================================================================================================================== 00:29:36.272 [2024-10-30T15:13:26.148Z] Total : 5656.04 707.01 0.00 0.00 2823.83 1286.45 8349.77 00:29:36.272 0 00:29:36.529 16:13:26 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:36.529 16:13:26 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:36.529 16:13:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:36.529 16:13:26 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:36.529 | .driver_specific 00:29:36.529 | .nvme_error 00:29:36.529 | .status_code 00:29:36.529 | .command_transient_transport_error' 00:29:36.787 16:13:26 -- host/digest.sh@71 -- # (( 365 > 0 )) 00:29:36.787 16:13:26 -- host/digest.sh@73 -- # killprocess 2541516 00:29:36.787 16:13:26 -- common/autotest_common.sh@926 -- # '[' -z 2541516 ']' 00:29:36.787 16:13:26 -- common/autotest_common.sh@930 -- # kill -0 2541516 00:29:36.787 16:13:26 -- common/autotest_common.sh@931 -- # uname 00:29:36.787 16:13:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:36.787 16:13:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2541516 00:29:36.787 16:13:26 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:36.787 16:13:26 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:36.787 16:13:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2541516' 00:29:36.787 killing process with pid 2541516 00:29:36.787 16:13:26 -- common/autotest_common.sh@945 -- # kill 2541516 00:29:36.787 Received shutdown signal, test time was about 2.000000 seconds 00:29:36.787 00:29:36.787 Latency(us) 00:29:36.787 [2024-10-30T15:13:26.663Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:36.787 [2024-10-30T15:13:26.663Z] =================================================================================================================== 00:29:36.787 [2024-10-30T15:13:26.663Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:36.787 16:13:26 -- common/autotest_common.sh@950 -- # wait 2541516 00:29:36.787 16:13:26 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:29:36.787 16:13:26 -- host/digest.sh@54 -- # local rw bs qd 00:29:36.787 16:13:26 -- host/digest.sh@56 -- # rw=randwrite 00:29:36.787 16:13:26 -- host/digest.sh@56 -- # bs=4096 00:29:36.787 16:13:26 -- host/digest.sh@56 -- # qd=128 00:29:36.787 16:13:26 -- host/digest.sh@58 -- # bperfpid=2542066 00:29:36.787 16:13:26 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:29:36.787 16:13:26 -- host/digest.sh@60 -- # waitforlisten 2542066 /var/tmp/bperf.sock 00:29:36.787 16:13:26 -- common/autotest_common.sh@819 -- # '[' -z 2542066 ']' 00:29:36.787 16:13:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:36.787 16:13:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:36.787 16:13:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:36.787 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:36.787 16:13:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:36.787 16:13:26 -- common/autotest_common.sh@10 -- # set +x 00:29:37.045 [2024-10-30 16:13:26.695128] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:37.045 [2024-10-30 16:13:26.695206] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2542066 ] 00:29:37.045 EAL: No free 2048 kB hugepages reported on node 1 00:29:37.045 [2024-10-30 16:13:26.756001] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:37.045 [2024-10-30 16:13:26.845716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:37.980 16:13:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:37.980 16:13:27 -- common/autotest_common.sh@852 -- # return 0 00:29:37.980 16:13:27 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:37.980 16:13:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:38.238 16:13:27 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:38.239 16:13:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:38.239 16:13:27 -- common/autotest_common.sh@10 -- # set +x 00:29:38.239 16:13:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:38.239 16:13:27 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:38.239 16:13:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:38.805 nvme0n1 00:29:38.805 16:13:28 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:38.805 16:13:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:38.805 16:13:28 -- common/autotest_common.sh@10 -- # set +x 00:29:38.805 16:13:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:38.805 16:13:28 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:38.805 16:13:28 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:38.805 Running I/O for 2 seconds... 00:29:38.805 [2024-10-30 16:13:28.597928] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190eea00 00:29:38.805 [2024-10-30 16:13:28.599309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:14620 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.805 [2024-10-30 16:13:28.599351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:38.805 [2024-10-30 16:13:28.608506] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e7818 00:29:38.805 [2024-10-30 16:13:28.609544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23325 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.805 [2024-10-30 16:13:28.609600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:29:38.805 [2024-10-30 16:13:28.620057] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e23b8 00:29:38.805 [2024-10-30 16:13:28.621118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:13287 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.805 [2024-10-30 16:13:28.621172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:29:38.805 [2024-10-30 16:13:28.631620] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e84c0 00:29:38.805 [2024-10-30 16:13:28.632705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19739 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.805 [2024-10-30 16:13:28.632749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:38.805 [2024-10-30 16:13:28.643227] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e0a68 00:29:38.805 [2024-10-30 16:13:28.644371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:9616 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.805 [2024-10-30 16:13:28.644415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0040 p:0 m:0 dnr:0 00:29:38.805 [2024-10-30 16:13:28.655587] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190eaab8 00:29:38.805 [2024-10-30 16:13:28.656689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:15345 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.805 [2024-10-30 16:13:28.656738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:29:38.805 [2024-10-30 16:13:28.668830] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f5378 00:29:38.805 [2024-10-30 16:13:28.669524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:19766 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.805 [2024-10-30 16:13:28.669553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:002b p:0 m:0 dnr:0 00:29:38.806 [2024-10-30 16:13:28.681357] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190ed0b0 00:29:38.806 [2024-10-30 16:13:28.681996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:9441 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:38.806 [2024-10-30 16:13:28.682044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:39.064 [2024-10-30 16:13:28.694403] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f7970 00:29:39.064 [2024-10-30 16:13:28.695506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:25550 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.064 [2024-10-30 16:13:28.695536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:39.064 [2024-10-30 16:13:28.706465] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e1f80 00:29:39.064 [2024-10-30 16:13:28.707542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:10626 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.064 [2024-10-30 16:13:28.707587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:39.064 [2024-10-30 16:13:28.718953] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f8a50 00:29:39.064 [2024-10-30 16:13:28.720105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:8919 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.064 [2024-10-30 16:13:28.720139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:39.064 [2024-10-30 16:13:28.731198] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e5220 00:29:39.064 [2024-10-30 16:13:28.732439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:4069 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.064 [2024-10-30 16:13:28.732467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.064 [2024-10-30 16:13:28.742501] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f57b0 00:29:39.064 [2024-10-30 16:13:28.743496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:15875 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.064 [2024-10-30 16:13:28.743525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0037 p:0 m:0 dnr:0 00:29:39.064 [2024-10-30 16:13:28.755309] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190fcdd0 00:29:39.064 [2024-10-30 16:13:28.756019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:25035 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.064 [2024-10-30 16:13:28.756051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:29:39.064 [2024-10-30 16:13:28.767627] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e5220 00:29:39.064 [2024-10-30 16:13:28.767997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:16367 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.064 [2024-10-30 16:13:28.768030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:29:39.064 [2024-10-30 16:13:28.779995] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e6fa8 00:29:39.064 [2024-10-30 16:13:28.780349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:20183 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.064 [2024-10-30 16:13:28.780395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:29:39.064 [2024-10-30 16:13:28.794179] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f81e0 00:29:39.064 [2024-10-30 16:13:28.795947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:1485 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.064 [2024-10-30 16:13:28.795980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.064 [2024-10-30 16:13:28.806368] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190ea248 00:29:39.064 [2024-10-30 16:13:28.807790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:13751 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.064 [2024-10-30 16:13:28.807823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:39.064 [2024-10-30 16:13:28.818739] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190ef270 00:29:39.064 [2024-10-30 16:13:28.820219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:17942 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.064 [2024-10-30 16:13:28.820251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:29:39.064 [2024-10-30 16:13:28.831356] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f0350 00:29:39.064 [2024-10-30 16:13:28.832854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:12377 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.065 [2024-10-30 16:13:28.832887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:29:39.065 [2024-10-30 16:13:28.843955] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190ea248 00:29:39.065 [2024-10-30 16:13:28.845192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:13881 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.065 [2024-10-30 16:13:28.845224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:29:39.065 [2024-10-30 16:13:28.854088] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f35f0 00:29:39.065 [2024-10-30 16:13:28.855231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:15133 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.065 [2024-10-30 16:13:28.855271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:29:39.065 [2024-10-30 16:13:28.866526] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190ddc00 00:29:39.065 [2024-10-30 16:13:28.867483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:19279 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.065 [2024-10-30 16:13:28.867513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:29:39.065 [2024-10-30 16:13:28.878992] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190eb328 00:29:39.065 [2024-10-30 16:13:28.879974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:5885 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.065 [2024-10-30 16:13:28.880006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:003b p:0 m:0 dnr:0 00:29:39.065 [2024-10-30 16:13:28.891387] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f6890 00:29:39.065 [2024-10-30 16:13:28.892384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:18885 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.065 [2024-10-30 16:13:28.892412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:003a p:0 m:0 dnr:0 00:29:39.065 [2024-10-30 16:13:28.903765] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f3e60 00:29:39.065 [2024-10-30 16:13:28.904758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:2759 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.065 [2024-10-30 16:13:28.904790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0039 p:0 m:0 dnr:0 00:29:39.065 [2024-10-30 16:13:28.916172] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190feb58 00:29:39.065 [2024-10-30 16:13:28.917114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:23569 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.065 [2024-10-30 16:13:28.917147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:29:39.065 [2024-10-30 16:13:28.928770] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190fc128 00:29:39.065 [2024-10-30 16:13:28.929453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:23365 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.065 [2024-10-30 16:13:28.929500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:29:39.065 [2024-10-30 16:13:28.941794] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e38d0 00:29:39.065 [2024-10-30 16:13:28.942252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:18526 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.065 [2024-10-30 16:13:28.942321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:28.954117] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e5220 00:29:39.324 [2024-10-30 16:13:28.954507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:7793 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:28.954538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:28.968110] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2510 00:29:39.324 [2024-10-30 16:13:28.969742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:7489 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:28.969776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:28.980454] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190eb328 00:29:39.324 [2024-10-30 16:13:28.982377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:24994 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:28.982406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:28.991354] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f0bc0 00:29:39.324 [2024-10-30 16:13:28.992414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:3427 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:28.992459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.003613] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:39.324 [2024-10-30 16:13:29.004273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:1729 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.004316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.015788] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e49b0 00:29:39.324 [2024-10-30 16:13:29.016459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:4661 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.016487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.028036] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190ef6a8 00:29:39.324 [2024-10-30 16:13:29.028745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:2165 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.028778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.040213] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190de8a8 00:29:39.324 [2024-10-30 16:13:29.040880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:11679 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.040914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.055117] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190fa7d8 00:29:39.324 [2024-10-30 16:13:29.056962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:19795 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.057001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.067276] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e8d30 00:29:39.324 [2024-10-30 16:13:29.069159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:2737 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.069191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.077690] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190ef6a8 00:29:39.324 [2024-10-30 16:13:29.079051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:17935 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.079083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.092247] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190fc998 00:29:39.324 [2024-10-30 16:13:29.093898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:336 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.093933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.104470] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f35f0 00:29:39.324 [2024-10-30 16:13:29.105991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:19120 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.106023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.116719] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e5220 00:29:39.324 [2024-10-30 16:13:29.118502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:5355 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.118532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.128978] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f8a50 00:29:39.324 [2024-10-30 16:13:29.130953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:10932 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.130985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.141198] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e3498 00:29:39.324 [2024-10-30 16:13:29.142958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:13862 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.142991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.151851] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190eea00 00:29:39.324 [2024-10-30 16:13:29.152995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:1103 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.153028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.163974] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190ed0b0 00:29:39.324 [2024-10-30 16:13:29.165022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:7051 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.165055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.176286] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190dfdc0 00:29:39.324 [2024-10-30 16:13:29.177410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:21139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.177437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.187529] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f6890 00:29:39.324 [2024-10-30 16:13:29.188398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9532 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.324 [2024-10-30 16:13:29.188428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:29:39.324 [2024-10-30 16:13:29.201061] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190fa7d8 00:29:39.583 [2024-10-30 16:13:29.202587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:24222 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.583 [2024-10-30 16:13:29.202617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:29:39.583 [2024-10-30 16:13:29.213549] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f1430 00:29:39.583 [2024-10-30 16:13:29.214310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:15267 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.583 [2024-10-30 16:13:29.214340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:29:39.583 [2024-10-30 16:13:29.227081] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e8088 00:29:39.583 [2024-10-30 16:13:29.228886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:18382 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.583 [2024-10-30 16:13:29.228920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:39.583 [2024-10-30 16:13:29.239522] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190df118 00:29:39.583 [2024-10-30 16:13:29.240411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:13599 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.583 [2024-10-30 16:13:29.240439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:29:39.583 [2024-10-30 16:13:29.250375] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190df550 00:29:39.583 [2024-10-30 16:13:29.251581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:19187 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.583 [2024-10-30 16:13:29.251615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:29:39.583 [2024-10-30 16:13:29.262699] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190df550 00:29:39.583 [2024-10-30 16:13:29.264001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:5818 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.583 [2024-10-30 16:13:29.264033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:29:39.583 [2024-10-30 16:13:29.275016] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190df550 00:29:39.583 [2024-10-30 16:13:29.276458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:16503 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.583 [2024-10-30 16:13:29.276486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:39.583 [2024-10-30 16:13:29.287318] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190df550 00:29:39.583 [2024-10-30 16:13:29.288867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:4047 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.583 [2024-10-30 16:13:29.288900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:39.583 [2024-10-30 16:13:29.299525] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f8e88 00:29:39.583 [2024-10-30 16:13:29.299998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:17817 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.583 [2024-10-30 16:13:29.300029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:29:39.583 [2024-10-30 16:13:29.312051] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e3498 00:29:39.583 [2024-10-30 16:13:29.312460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:8390 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.583 [2024-10-30 16:13:29.312490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:29:39.583 [2024-10-30 16:13:29.324206] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e1b48 00:29:39.583 [2024-10-30 16:13:29.324622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:22672 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.583 [2024-10-30 16:13:29.324655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:29:39.583 [2024-10-30 16:13:29.338680] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e4578 00:29:39.583 [2024-10-30 16:13:29.340692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:15545 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.584 [2024-10-30 16:13:29.340725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:39.584 [2024-10-30 16:13:29.351044] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190fb048 00:29:39.584 [2024-10-30 16:13:29.352757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:20424 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.584 [2024-10-30 16:13:29.352790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:39.584 [2024-10-30 16:13:29.363384] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e6b70 00:29:39.584 [2024-10-30 16:13:29.365059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:25131 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.584 [2024-10-30 16:13:29.365092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:39.584 [2024-10-30 16:13:29.375700] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f0bc0 00:29:39.584 [2024-10-30 16:13:29.377702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:13321 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.584 [2024-10-30 16:13:29.377741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:39.584 [2024-10-30 16:13:29.386741] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190ebb98 00:29:39.584 [2024-10-30 16:13:29.387866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:9912 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.584 [2024-10-30 16:13:29.387898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:29:39.584 [2024-10-30 16:13:29.399007] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190fef90 00:29:39.584 [2024-10-30 16:13:29.399727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:17836 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.584 [2024-10-30 16:13:29.399760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:29:39.584 [2024-10-30 16:13:29.411171] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190ec408 00:29:39.584 [2024-10-30 16:13:29.411873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:1472 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.584 [2024-10-30 16:13:29.411906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:29:39.584 [2024-10-30 16:13:29.423466] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190ebfd0 00:29:39.584 [2024-10-30 16:13:29.424171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:24773 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.584 [2024-10-30 16:13:29.424202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:29:39.584 [2024-10-30 16:13:29.435595] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f8618 00:29:39.584 [2024-10-30 16:13:29.436698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:4637 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.584 [2024-10-30 16:13:29.436730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:39.584 [2024-10-30 16:13:29.447713] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f6020 00:29:39.584 [2024-10-30 16:13:29.448407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:12380 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.584 [2024-10-30 16:13:29.448435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:29:39.584 [2024-10-30 16:13:29.459794] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e95a0 00:29:39.584 [2024-10-30 16:13:29.460559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:14027 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.584 [2024-10-30 16:13:29.460601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.473066] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190fc998 00:29:39.843 [2024-10-30 16:13:29.473804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:9365 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.473838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.484862] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190fe720 00:29:39.843 [2024-10-30 16:13:29.485661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:16034 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.485694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.497076] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f0ff8 00:29:39.843 [2024-10-30 16:13:29.498607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:16356 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.498640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.509168] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e88f8 00:29:39.843 [2024-10-30 16:13:29.510381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:19200 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.510411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.520655] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f5be8 00:29:39.843 [2024-10-30 16:13:29.521033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:17211 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.521066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.533705] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190e95a0 00:29:39.843 [2024-10-30 16:13:29.534985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:12664 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.535018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.546784] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190fda78 00:29:39.843 [2024-10-30 16:13:29.547292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:6459 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.547320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.559267] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:39.843 [2024-10-30 16:13:29.559966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:9349 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.559997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.572081] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:39.843 [2024-10-30 16:13:29.572368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:19558 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.572398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.585685] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:39.843 [2024-10-30 16:13:29.585956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:18233 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.585989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.599241] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:39.843 [2024-10-30 16:13:29.599580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:20556 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.599625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.612927] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:39.843 [2024-10-30 16:13:29.613202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:8174 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.613235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.626555] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:39.843 [2024-10-30 16:13:29.626837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:21946 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.626869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.639971] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:39.843 [2024-10-30 16:13:29.640250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:1525 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.640306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.653354] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:39.843 [2024-10-30 16:13:29.653714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:11759 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.653742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.667124] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:39.843 [2024-10-30 16:13:29.667377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:2628 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.667406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.680964] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:39.843 [2024-10-30 16:13:29.681264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:200 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.681294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.694828] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:39.843 [2024-10-30 16:13:29.695101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:14121 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.695133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:39.843 [2024-10-30 16:13:29.708473] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:39.843 [2024-10-30 16:13:29.708764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:19952 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.843 [2024-10-30 16:13:29.708802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.101 [2024-10-30 16:13:29.722052] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.101 [2024-10-30 16:13:29.722342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:22266 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.101 [2024-10-30 16:13:29.722372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.101 [2024-10-30 16:13:29.735779] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.101 [2024-10-30 16:13:29.736055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:23826 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.101 [2024-10-30 16:13:29.736087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.101 [2024-10-30 16:13:29.749494] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.101 [2024-10-30 16:13:29.749776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:11714 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.101 [2024-10-30 16:13:29.749808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.101 [2024-10-30 16:13:29.763146] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.101 [2024-10-30 16:13:29.763443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:3335 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.101 [2024-10-30 16:13:29.763472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.101 [2024-10-30 16:13:29.776774] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.101 [2024-10-30 16:13:29.777052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:8692 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.101 [2024-10-30 16:13:29.777083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.101 [2024-10-30 16:13:29.790348] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.101 [2024-10-30 16:13:29.790654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:6664 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.101 [2024-10-30 16:13:29.790685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.101 [2024-10-30 16:13:29.803959] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.101 [2024-10-30 16:13:29.804230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:3102 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.101 [2024-10-30 16:13:29.804272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.101 [2024-10-30 16:13:29.817555] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.101 [2024-10-30 16:13:29.817839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:11998 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.101 [2024-10-30 16:13:29.817870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.101 [2024-10-30 16:13:29.831134] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.101 [2024-10-30 16:13:29.831432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:20875 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.101 [2024-10-30 16:13:29.831460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.101 [2024-10-30 16:13:29.844684] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.101 [2024-10-30 16:13:29.844949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:13581 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.101 [2024-10-30 16:13:29.844980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.101 [2024-10-30 16:13:29.858155] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.101 [2024-10-30 16:13:29.858429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:25097 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.101 [2024-10-30 16:13:29.858457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.101 [2024-10-30 16:13:29.871755] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.101 [2024-10-30 16:13:29.872024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:24588 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.101 [2024-10-30 16:13:29.872055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.101 [2024-10-30 16:13:29.885346] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.101 [2024-10-30 16:13:29.885646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:2180 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.101 [2024-10-30 16:13:29.885677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.102 [2024-10-30 16:13:29.898834] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.102 [2024-10-30 16:13:29.899101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:17266 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.102 [2024-10-30 16:13:29.899132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.102 [2024-10-30 16:13:29.912524] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.102 [2024-10-30 16:13:29.912805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:22211 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.102 [2024-10-30 16:13:29.912836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.102 [2024-10-30 16:13:29.926183] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.102 [2024-10-30 16:13:29.926545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:15391 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.102 [2024-10-30 16:13:29.926591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.102 [2024-10-30 16:13:29.939889] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.102 [2024-10-30 16:13:29.940159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:21523 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.102 [2024-10-30 16:13:29.940190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.102 [2024-10-30 16:13:29.953361] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.102 [2024-10-30 16:13:29.953625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:23671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.102 [2024-10-30 16:13:29.953657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.102 [2024-10-30 16:13:29.966720] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.102 [2024-10-30 16:13:29.966995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:4856 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.102 [2024-10-30 16:13:29.967027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.102 [2024-10-30 16:13:29.980004] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:29.980333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:15245 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:29.980362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:29.993521] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:29.993803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:13790 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:29.993835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.007051] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.007342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:16208 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.007372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.021057] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.021362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:19141 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.021394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.035042] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.035332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:10688 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.035375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.049037] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.049352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:10745 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.049384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.062757] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.063034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:1310 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.063073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.076489] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.076775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:25529 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.076807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.090120] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.090394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:5907 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.090423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.103880] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.104163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:236 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.104195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.117522] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.117770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:14065 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.117801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.131028] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.131322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:19152 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.131350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.144748] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.145021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:8911 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.145052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.158119] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.158419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:3500 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.158448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.171711] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.171979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:18378 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.172020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.185325] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.185663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:17018 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.185708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.198980] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.199253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:7469 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.199317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.212708] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.212985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:19357 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.213016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.359 [2024-10-30 16:13:30.226326] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.359 [2024-10-30 16:13:30.226570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:16030 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.359 [2024-10-30 16:13:30.226598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.239751] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.240035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:7313 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.240067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.253312] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.253608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:22870 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.253654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.266926] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.267202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:7318 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.267239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.280435] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.280771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:15435 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.280802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.293981] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.294271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:3172 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.294316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.307416] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.307680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:22372 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.307709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.320767] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.321035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:7900 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.321066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.334170] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.334452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:5541 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.334480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.347669] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.347951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:178 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.347982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.361200] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.361511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:19041 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.361539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.374748] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.375012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:12069 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.375043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.388227] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.388611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:18796 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.388641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.401812] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.402047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:21927 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.402078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.415201] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.415475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:9798 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.415513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.428552] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.428838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:19093 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.617 [2024-10-30 16:13:30.428869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.617 [2024-10-30 16:13:30.442139] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.617 [2024-10-30 16:13:30.442425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:21074 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.618 [2024-10-30 16:13:30.442454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.618 [2024-10-30 16:13:30.455672] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.618 [2024-10-30 16:13:30.455944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:15073 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.618 [2024-10-30 16:13:30.455974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.618 [2024-10-30 16:13:30.469104] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.618 [2024-10-30 16:13:30.469388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:24061 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.618 [2024-10-30 16:13:30.469425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.618 [2024-10-30 16:13:30.482671] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.618 [2024-10-30 16:13:30.482939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:7363 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.618 [2024-10-30 16:13:30.482971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.876 [2024-10-30 16:13:30.496069] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.877 [2024-10-30 16:13:30.496324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:15607 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.877 [2024-10-30 16:13:30.496354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.877 [2024-10-30 16:13:30.509508] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.877 [2024-10-30 16:13:30.509802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:14700 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.877 [2024-10-30 16:13:30.509834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.877 [2024-10-30 16:13:30.523044] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.877 [2024-10-30 16:13:30.523340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:350 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.877 [2024-10-30 16:13:30.523369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.877 [2024-10-30 16:13:30.536467] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.877 [2024-10-30 16:13:30.536795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:3508 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.877 [2024-10-30 16:13:30.536828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.877 [2024-10-30 16:13:30.550078] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.877 [2024-10-30 16:13:30.550364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:2543 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.877 [2024-10-30 16:13:30.550393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.877 [2024-10-30 16:13:30.563540] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.877 [2024-10-30 16:13:30.563836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:10696 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.877 [2024-10-30 16:13:30.563868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.877 [2024-10-30 16:13:30.577171] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.877 [2024-10-30 16:13:30.577451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:23350 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.877 [2024-10-30 16:13:30.577481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.877 [2024-10-30 16:13:30.590760] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x11663f0) with pdu=0x2000190f2948 00:29:40.877 [2024-10-30 16:13:30.590998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:25565 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.877 [2024-10-30 16:13:30.591030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.877 00:29:40.877 Latency(us) 00:29:40.877 [2024-10-30T15:13:30.753Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:40.877 [2024-10-30T15:13:30.753Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:40.877 nvme0n1 : 2.01 19738.62 77.10 0.00 0.00 6470.40 3034.07 14078.10 00:29:40.877 [2024-10-30T15:13:30.753Z] =================================================================================================================== 00:29:40.877 [2024-10-30T15:13:30.753Z] Total : 19738.62 77.10 0.00 0.00 6470.40 3034.07 14078.10 00:29:40.877 0 00:29:40.877 16:13:30 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:40.877 16:13:30 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:40.877 16:13:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:40.877 16:13:30 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:40.877 | .driver_specific 00:29:40.877 | .nvme_error 00:29:40.877 | .status_code 00:29:40.877 | .command_transient_transport_error' 00:29:41.147 16:13:30 -- host/digest.sh@71 -- # (( 155 > 0 )) 00:29:41.147 16:13:30 -- host/digest.sh@73 -- # killprocess 2542066 00:29:41.147 16:13:30 -- common/autotest_common.sh@926 -- # '[' -z 2542066 ']' 00:29:41.147 16:13:30 -- common/autotest_common.sh@930 -- # kill -0 2542066 00:29:41.147 16:13:30 -- common/autotest_common.sh@931 -- # uname 00:29:41.147 16:13:30 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:41.147 16:13:30 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2542066 00:29:41.147 16:13:30 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:41.147 16:13:30 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:41.147 16:13:30 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2542066' 00:29:41.147 killing process with pid 2542066 00:29:41.147 16:13:30 -- common/autotest_common.sh@945 -- # kill 2542066 00:29:41.147 Received shutdown signal, test time was about 2.000000 seconds 00:29:41.147 00:29:41.147 Latency(us) 00:29:41.147 [2024-10-30T15:13:31.023Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:41.147 [2024-10-30T15:13:31.023Z] =================================================================================================================== 00:29:41.147 [2024-10-30T15:13:31.023Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:41.147 16:13:30 -- common/autotest_common.sh@950 -- # wait 2542066 00:29:41.434 16:13:31 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:29:41.434 16:13:31 -- host/digest.sh@54 -- # local rw bs qd 00:29:41.434 16:13:31 -- host/digest.sh@56 -- # rw=randwrite 00:29:41.434 16:13:31 -- host/digest.sh@56 -- # bs=131072 00:29:41.434 16:13:31 -- host/digest.sh@56 -- # qd=16 00:29:41.434 16:13:31 -- host/digest.sh@58 -- # bperfpid=2542623 00:29:41.434 16:13:31 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:29:41.434 16:13:31 -- host/digest.sh@60 -- # waitforlisten 2542623 /var/tmp/bperf.sock 00:29:41.434 16:13:31 -- common/autotest_common.sh@819 -- # '[' -z 2542623 ']' 00:29:41.434 16:13:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:41.434 16:13:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:41.434 16:13:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:41.434 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:41.434 16:13:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:41.434 16:13:31 -- common/autotest_common.sh@10 -- # set +x 00:29:41.434 [2024-10-30 16:13:31.173907] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:41.434 [2024-10-30 16:13:31.173999] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2542623 ] 00:29:41.434 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:41.434 Zero copy mechanism will not be used. 00:29:41.434 EAL: No free 2048 kB hugepages reported on node 1 00:29:41.434 [2024-10-30 16:13:31.236503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:41.692 [2024-10-30 16:13:31.323764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:42.622 16:13:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:42.622 16:13:32 -- common/autotest_common.sh@852 -- # return 0 00:29:42.622 16:13:32 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:42.622 16:13:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:42.622 16:13:32 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:42.622 16:13:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:42.622 16:13:32 -- common/autotest_common.sh@10 -- # set +x 00:29:42.622 16:13:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:42.622 16:13:32 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:42.622 16:13:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:42.879 nvme0n1 00:29:42.879 16:13:32 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:42.879 16:13:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:43.143 16:13:32 -- common/autotest_common.sh@10 -- # set +x 00:29:43.143 16:13:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:43.143 16:13:32 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:43.143 16:13:32 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:43.143 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:43.143 Zero copy mechanism will not be used. 00:29:43.143 Running I/O for 2 seconds... 00:29:43.143 [2024-10-30 16:13:32.876012] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.876380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.876422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.881275] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.881444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.881475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.886090] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.886215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.886247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.890790] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.890909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.890941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.895422] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.895533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.895561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.900097] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.900197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.900228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.904923] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.905034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.905065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.910242] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.910403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.910431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.915459] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.915664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.915703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.920305] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.920443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.920471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.925177] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.925308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.925336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.929894] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.930040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.930070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.934639] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.934717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.934748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.939751] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.939867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.939897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.944699] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.944801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.944832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.949479] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.949718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.949753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.954438] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.954609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.954642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.959225] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.959337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.959365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.963981] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.964117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.964146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.968781] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.968889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.968920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.973663] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.973740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.973771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.978712] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.978829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.978862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.984094] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.984250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.984317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.988823] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.989055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.989089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.994073] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.994336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.994367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:32.999055] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:32.999242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:32.999282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:33.004056] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:33.004232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:33.004275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:33.008776] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:33.008907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:33.008938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:33.013745] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:33.013899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:33.013929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.143 [2024-10-30 16:13:33.019017] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.143 [2024-10-30 16:13:33.019309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.143 [2024-10-30 16:13:33.019340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.025248] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.025556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.025590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.030592] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.030793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.030826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.035073] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.035233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.035274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.039771] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.039929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.039962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.044447] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.044562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.044615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.048909] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.049058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.049091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.053567] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.053754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.053787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.058772] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.058989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.059021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.063919] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.064173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.064206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.069952] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.070055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.070085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.075053] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.075358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.075388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.080440] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.080617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.080650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.085823] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.085959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.085989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.091088] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.091269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.091316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.096748] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.096862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.096893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.102181] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.102418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.102449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.106721] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.106957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.106989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.111376] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.111512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.111559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.115877] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.115997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.116030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.120612] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.120795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.120827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.126659] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.126860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.126893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.131532] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.131726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.131766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.136323] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.136516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.136545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.140896] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.141179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.401 [2024-10-30 16:13:33.141212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.401 [2024-10-30 16:13:33.145651] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.401 [2024-10-30 16:13:33.145800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.145831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.150224] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.150400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.150430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.154952] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.155088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.155117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.159518] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.159638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.159668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.164363] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.164589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.164624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.168956] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.169111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.169142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.173657] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.173873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.173916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.178060] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.178189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.178220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.182642] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.182899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.182932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.187801] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.187976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.188006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.193041] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.193281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.193328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.199579] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.199684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.199715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.204238] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.204457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.204487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.208898] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.209064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.209094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.213463] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.213750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.213784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.218190] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.218427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.218456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.223513] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.223709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.223739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.228835] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.229091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.229125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.234892] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.235065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.235095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.240158] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.240362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.240390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.245320] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.245429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.245456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.250741] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.250968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.250998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.256061] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.256313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.256351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.261179] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.261325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.261357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.266521] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.266852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.266887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.271861] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.272053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.272084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.402 [2024-10-30 16:13:33.277032] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.402 [2024-10-30 16:13:33.277184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.402 [2024-10-30 16:13:33.277215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.660 [2024-10-30 16:13:33.282178] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.660 [2024-10-30 16:13:33.282423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.660 [2024-10-30 16:13:33.282454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.660 [2024-10-30 16:13:33.287430] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.660 [2024-10-30 16:13:33.287606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.660 [2024-10-30 16:13:33.287637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.660 [2024-10-30 16:13:33.292680] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.660 [2024-10-30 16:13:33.292806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.660 [2024-10-30 16:13:33.292836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.660 [2024-10-30 16:13:33.297969] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.660 [2024-10-30 16:13:33.298208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.660 [2024-10-30 16:13:33.298242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.303123] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.303363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.303393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.308429] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.308682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.308714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.313745] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.313995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.314028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.319353] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.319474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.319503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.324744] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.324888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.324920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.330530] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.330774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.330806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.336387] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.336607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.336639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.341492] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.341614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.341646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.346180] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.346424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.346454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.351346] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.351518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.351549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.356496] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.356683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.356715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.361056] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.361249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.361305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.365864] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.366002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.366034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.371175] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.371312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.371341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.377351] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.377549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.377596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.382801] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.382942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.382974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.387458] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.387699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.387732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.392073] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.392341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.392371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.396895] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.397072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.397110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.401592] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.401748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.401780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.406206] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.406339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.406368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.410713] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.410880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.410912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.415815] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.415992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.416021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.420884] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.421033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.421061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.426051] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.426360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.426389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.431226] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.431497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.431526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.436236] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.436378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.436407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.441321] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.441483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.441512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.446400] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.446519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.446548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.451644] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.451757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.451785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.456776] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.456954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.456982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.461951] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.462208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.462237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.466997] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.467268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.467297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.472191] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.472427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.472456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.477210] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.477500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.477529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.482267] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.482545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.482574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.487345] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.487567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.487596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.492349] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.492523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.492551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.497450] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.497596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.497624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.502565] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.502745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.502773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.507839] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.508060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.508089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.512899] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.513081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.513109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.518063] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.518232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.518279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.523111] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.523277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.523305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.528185] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.528340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.661 [2024-10-30 16:13:33.528376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.661 [2024-10-30 16:13:33.533360] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.661 [2024-10-30 16:13:33.533635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.662 [2024-10-30 16:13:33.533664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.662 [2024-10-30 16:13:33.538530] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.538787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.538820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.543872] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.544110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.544143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.549158] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.549416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.549444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.554721] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.554867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.554899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.560541] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.560682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.560713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.566442] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.566660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.566691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.572785] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.573028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.573061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.578170] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.578404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.578433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.582938] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.583202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.583234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.588252] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.588424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.588452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.593548] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.593818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.593850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.599720] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.599845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.599877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.604370] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.604485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.604514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.608896] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.609075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.609106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.613632] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.613771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.613804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.618192] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.618453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.618483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.622967] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.623133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.623165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.628218] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.628420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.628448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.633963] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.634198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.634230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.639866] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.640002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.640034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.644920] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.645112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.645144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.650169] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.650429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.650458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.655355] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.655607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.655640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.660719] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.660878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.660909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.666190] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.666410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.666445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.671630] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.920 [2024-10-30 16:13:33.671840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.920 [2024-10-30 16:13:33.671871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.920 [2024-10-30 16:13:33.676814] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.677040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.677073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.683048] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.683264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.683311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.687914] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.688078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.688109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.692579] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.692769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.692800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.697270] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.697465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.697494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.701927] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.702074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.702107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.706423] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.706595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.706627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.711623] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.711935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.711967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.716846] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.717059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.717092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.722868] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.722968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.722998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.728093] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.728239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.728281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.732673] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.732833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.732865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.737320] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.737469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.737498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.742128] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.742330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.742360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.747542] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.747750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.747782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.753052] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.753237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.753284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.758622] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.758894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.758928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.764992] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.765115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.765148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.769841] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.769974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.770008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.774413] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.774551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.774582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.779035] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.779140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.779172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.783699] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.783839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.783871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.788504] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.788657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.788688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:43.921 [2024-10-30 16:13:33.793382] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:43.921 [2024-10-30 16:13:33.793533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:43.921 [2024-10-30 16:13:33.793580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.798515] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.798763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.798798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.803925] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.804124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.804157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.809482] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.809644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.809675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.815331] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.815427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.815455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.819776] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.819913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.819945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.824406] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.824536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.824569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.828998] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.829169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.829202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.833649] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.833798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.833830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.838242] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.838445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.838475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.842833] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.842950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.842982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.847385] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.847514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.847542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.852174] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.852358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.852387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.856820] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.856936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.856968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.861466] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.861628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.861660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.866000] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.866211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.866243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.870796] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.871006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.871037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.875369] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.875596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.875629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.879923] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.880078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.880108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.884471] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.884666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.884699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.889005] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.889170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.889202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.893729] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.893875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.893905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.898512] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.898705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.898737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.903209] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.903413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.903443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.907981] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.908212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.908244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.912497] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.912661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.912694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.917066] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.917186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.917217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.921897] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.922043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.922080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.926526] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.926646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.926679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.931078] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.931181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.931211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.935669] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.935841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.935873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.940465] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.940643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.940676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.945308] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.179 [2024-10-30 16:13:33.945518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.179 [2024-10-30 16:13:33.945547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.179 [2024-10-30 16:13:33.949958] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:33.950148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:33.950179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:33.954812] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:33.954999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:33.955031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:33.959444] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:33.959661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:33.959694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:33.964072] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:33.964233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:33.964273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:33.968766] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:33.968876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:33.968907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:33.973391] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:33.973507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:33.973535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:33.978205] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:33.978415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:33.978445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:33.982997] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:33.983210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:33.983253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:33.987879] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:33.988067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:33.988101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:33.992656] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:33.992846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:33.992878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:33.997373] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:33.997521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:33.997576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:34.001789] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:34.001946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:34.001978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:34.006324] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:34.006495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:34.006524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:34.011017] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:34.011176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:34.011207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:34.016137] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:34.016414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:34.016444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:34.021685] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:34.021908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:34.021941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:34.027698] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:34.027860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:34.027893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:34.032170] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:34.032312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:34.032342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:34.036614] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:34.036773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:34.036805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:34.041118] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:34.041308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:34.041338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:34.045879] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:34.046008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:34.046046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:34.050520] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:34.050627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:34.050657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.180 [2024-10-30 16:13:34.055253] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.180 [2024-10-30 16:13:34.055477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.180 [2024-10-30 16:13:34.055506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.059894] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.060089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.060122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.064423] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.064518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.064563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.069016] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.069139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.069170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.074170] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.074363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.074392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.079410] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.079609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.079642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.085816] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.085911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.085942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.090841] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.091102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.091136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.096116] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.096267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.096313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.101314] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.101424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.101452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.106710] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.106923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.106955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.111238] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.111449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.111479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.115745] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.115887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.115918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.120509] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.120638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.120668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.124888] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.125035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.125065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.129758] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.129893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.129922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.135072] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.135213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.135244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.140449] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.140709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.140742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.145815] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.146118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.146151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.151406] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.151653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.151686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.157664] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.157897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.157942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.162540] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.162661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.162691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.167096] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.167241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.167280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.171705] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.171847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.171879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.176208] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.176346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.176381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.180785] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.180924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.180956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.185459] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.185746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.185780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.190537] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.190744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.439 [2024-10-30 16:13:34.190777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.439 [2024-10-30 16:13:34.196853] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.439 [2024-10-30 16:13:34.196970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.197003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.202031] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.202163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.202195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.207265] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.207537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.207567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.212395] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.212632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.212666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.217768] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.217889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.217919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.222942] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.223114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.223144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.228264] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.228495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.228524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.233403] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.233530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.233586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.238528] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.238778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.238812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.243677] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.243819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.243848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.248874] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.249029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.249060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.254026] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.254317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.254347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.259280] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.259511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.259557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.264489] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.264768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.264800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.269714] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.269933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.269965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.274885] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.275042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.275075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.280222] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.280398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.280427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.285379] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.285633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.285665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.291039] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.291232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.291274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.296652] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.296801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.296833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.301766] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.301972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.302002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.306731] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.306973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.307006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.311633] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.311864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.311904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.440 [2024-10-30 16:13:34.316696] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.440 [2024-10-30 16:13:34.316902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.440 [2024-10-30 16:13:34.316931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.321778] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.321960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.321992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.326838] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.327036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.327067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.332025] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.332216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.332246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.337123] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.337339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.337379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.342154] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.342370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.342411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.347320] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.347591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.347625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.352369] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.352617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.352651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.357345] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.357524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.357551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.362374] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.362608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.362641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.367529] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.367677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.367708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.372802] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.373033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.373066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.378555] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.378742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.378773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.384029] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.384164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.384194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.389332] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.389554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.389603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.394629] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.394833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.394864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.399898] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.400042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.400072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.405036] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.405272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.405317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.410178] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.410339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.410367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.415497] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.415641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.415670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.420774] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.421007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.421041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.426230] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.426564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.426612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.431515] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.431770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.431803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.436836] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.436995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.437026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.441911] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.442086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.442117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.447101] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.447308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.447341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.452391] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.452513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.452541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.457517] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.457677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.457707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.462766] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.462973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.463004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.467973] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.468116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.468146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.473099] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.473340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.473369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.478371] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.478555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.478601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.483589] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.483743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.483773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.488770] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.489028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.489063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.493869] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.494089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.494120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.499129] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.499395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.499427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.504368] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.504617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.504651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.509872] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.510029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.510058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.514972] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.515123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.515153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.520212] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.520358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.520387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.525455] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.525689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.525722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.530606] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.530751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.530781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.536047] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.536315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.536346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.541399] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.541612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.541645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.546698] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.546969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.547003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.551783] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.699 [2024-10-30 16:13:34.552012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.699 [2024-10-30 16:13:34.552046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.699 [2024-10-30 16:13:34.557005] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.700 [2024-10-30 16:13:34.557172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.700 [2024-10-30 16:13:34.557202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.700 [2024-10-30 16:13:34.562307] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.700 [2024-10-30 16:13:34.562469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.700 [2024-10-30 16:13:34.562496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.700 [2024-10-30 16:13:34.567674] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.700 [2024-10-30 16:13:34.567870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.700 [2024-10-30 16:13:34.567900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.700 [2024-10-30 16:13:34.572817] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.700 [2024-10-30 16:13:34.573043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.700 [2024-10-30 16:13:34.573076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.959 [2024-10-30 16:13:34.578331] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.959 [2024-10-30 16:13:34.578609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.959 [2024-10-30 16:13:34.578643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.959 [2024-10-30 16:13:34.583536] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.959 [2024-10-30 16:13:34.583784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.959 [2024-10-30 16:13:34.583824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.959 [2024-10-30 16:13:34.588764] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.959 [2024-10-30 16:13:34.588941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.588972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.593427] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.593586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.593618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.598632] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.598756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.598787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.604603] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.604682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.604713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.609902] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.610195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.610229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.615245] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.615468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.615496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.620559] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.620790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.620823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.625973] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.626220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.626254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.631347] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.631473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.631500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.636800] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.636935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.636965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.642677] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.642794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.642825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.648693] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.648804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.648836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.653265] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.653390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.653418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.657800] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.657963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.657994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.662494] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.662707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.662738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.667220] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.667403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.667432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.672087] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.672250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.672305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.676789] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.676914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.676945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.681432] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.681603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.681634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.685904] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.686020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.686051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.690841] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.690992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.691022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.696151] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.696421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.696451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.700794] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.700953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.700984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.705825] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.705948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.705977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.711101] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.711345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.711373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.716359] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.716489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.716521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.721438] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.721587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.721617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.726800] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.726971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.727002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.960 [2024-10-30 16:13:34.732018] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.960 [2024-10-30 16:13:34.732243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.960 [2024-10-30 16:13:34.732284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.737895] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.738146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.738180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.744152] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.744395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.744435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.750007] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.750088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.750119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.755719] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.755900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.755931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.761862] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.761969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.761999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.768226] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.768348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.768375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.774345] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.774475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.774503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.780565] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.780745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.780778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.786985] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.787179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.787210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.793408] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.793582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.793615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.799689] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.799832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.799865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.805977] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.806119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.806151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.812039] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.812319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.812350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.818765] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.818887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.818916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.824305] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.824470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.824499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.828960] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.829175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.829208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.961 [2024-10-30 16:13:34.833439] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:44.961 [2024-10-30 16:13:34.833584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.961 [2024-10-30 16:13:34.833613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.220 [2024-10-30 16:13:34.838118] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:45.220 [2024-10-30 16:13:34.838317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.220 [2024-10-30 16:13:34.838348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.220 [2024-10-30 16:13:34.842759] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:45.220 [2024-10-30 16:13:34.842942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.220 [2024-10-30 16:13:34.842977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.220 [2024-10-30 16:13:34.847341] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:45.220 [2024-10-30 16:13:34.847469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.220 [2024-10-30 16:13:34.847499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.220 [2024-10-30 16:13:34.851872] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:45.220 [2024-10-30 16:13:34.852012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.220 [2024-10-30 16:13:34.852044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.220 [2024-10-30 16:13:34.856816] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:45.220 [2024-10-30 16:13:34.856923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.221 [2024-10-30 16:13:34.856953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.221 [2024-10-30 16:13:34.861975] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:45.221 [2024-10-30 16:13:34.862107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.221 [2024-10-30 16:13:34.862146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.221 [2024-10-30 16:13:34.867103] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1166590) with pdu=0x2000190fef90 00:29:45.221 [2024-10-30 16:13:34.867368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.221 [2024-10-30 16:13:34.867398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.221 00:29:45.221 Latency(us) 00:29:45.221 [2024-10-30T15:13:35.097Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:45.221 [2024-10-30T15:13:35.097Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:45.221 nvme0n1 : 2.00 6066.42 758.30 0.00 0.00 2630.22 1856.85 9369.22 00:29:45.221 [2024-10-30T15:13:35.097Z] =================================================================================================================== 00:29:45.221 [2024-10-30T15:13:35.097Z] Total : 6066.42 758.30 0.00 0.00 2630.22 1856.85 9369.22 00:29:45.221 0 00:29:45.221 16:13:34 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:45.221 16:13:34 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:45.221 16:13:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:45.221 16:13:34 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:45.221 | .driver_specific 00:29:45.221 | .nvme_error 00:29:45.221 | .status_code 00:29:45.221 | .command_transient_transport_error' 00:29:45.479 16:13:35 -- host/digest.sh@71 -- # (( 391 > 0 )) 00:29:45.479 16:13:35 -- host/digest.sh@73 -- # killprocess 2542623 00:29:45.479 16:13:35 -- common/autotest_common.sh@926 -- # '[' -z 2542623 ']' 00:29:45.479 16:13:35 -- common/autotest_common.sh@930 -- # kill -0 2542623 00:29:45.479 16:13:35 -- common/autotest_common.sh@931 -- # uname 00:29:45.479 16:13:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:45.479 16:13:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2542623 00:29:45.479 16:13:35 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:29:45.479 16:13:35 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:29:45.479 16:13:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2542623' 00:29:45.479 killing process with pid 2542623 00:29:45.479 16:13:35 -- common/autotest_common.sh@945 -- # kill 2542623 00:29:45.479 Received shutdown signal, test time was about 2.000000 seconds 00:29:45.479 00:29:45.479 Latency(us) 00:29:45.479 [2024-10-30T15:13:35.355Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:45.479 [2024-10-30T15:13:35.355Z] =================================================================================================================== 00:29:45.479 [2024-10-30T15:13:35.355Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:45.479 16:13:35 -- common/autotest_common.sh@950 -- # wait 2542623 00:29:45.737 16:13:35 -- host/digest.sh@115 -- # killprocess 2540938 00:29:45.737 16:13:35 -- common/autotest_common.sh@926 -- # '[' -z 2540938 ']' 00:29:45.737 16:13:35 -- common/autotest_common.sh@930 -- # kill -0 2540938 00:29:45.737 16:13:35 -- common/autotest_common.sh@931 -- # uname 00:29:45.737 16:13:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:45.737 16:13:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2540938 00:29:45.737 16:13:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:45.737 16:13:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:45.737 16:13:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2540938' 00:29:45.737 killing process with pid 2540938 00:29:45.737 16:13:35 -- common/autotest_common.sh@945 -- # kill 2540938 00:29:45.737 16:13:35 -- common/autotest_common.sh@950 -- # wait 2540938 00:29:45.995 00:29:45.995 real 0m18.060s 00:29:45.995 user 0m36.737s 00:29:45.995 sys 0m4.598s 00:29:45.995 16:13:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:45.995 16:13:35 -- common/autotest_common.sh@10 -- # set +x 00:29:45.995 ************************************ 00:29:45.995 END TEST nvmf_digest_error 00:29:45.995 ************************************ 00:29:45.995 16:13:35 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:29:45.995 16:13:35 -- host/digest.sh@139 -- # nvmftestfini 00:29:45.995 16:13:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:45.995 16:13:35 -- nvmf/common.sh@116 -- # sync 00:29:45.995 16:13:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:45.995 16:13:35 -- nvmf/common.sh@119 -- # set +e 00:29:45.995 16:13:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:45.995 16:13:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:45.995 rmmod nvme_tcp 00:29:45.995 rmmod nvme_fabrics 00:29:45.995 rmmod nvme_keyring 00:29:45.995 16:13:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:45.995 16:13:35 -- nvmf/common.sh@123 -- # set -e 00:29:45.995 16:13:35 -- nvmf/common.sh@124 -- # return 0 00:29:45.995 16:13:35 -- nvmf/common.sh@477 -- # '[' -n 2540938 ']' 00:29:45.995 16:13:35 -- nvmf/common.sh@478 -- # killprocess 2540938 00:29:45.995 16:13:35 -- common/autotest_common.sh@926 -- # '[' -z 2540938 ']' 00:29:45.995 16:13:35 -- common/autotest_common.sh@930 -- # kill -0 2540938 00:29:45.995 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2540938) - No such process 00:29:45.995 16:13:35 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2540938 is not found' 00:29:45.995 Process with pid 2540938 is not found 00:29:45.995 16:13:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:45.995 16:13:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:45.995 16:13:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:45.995 16:13:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:45.995 16:13:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:45.995 16:13:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:45.995 16:13:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:45.995 16:13:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:48.527 16:13:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:48.527 00:29:48.527 real 0m37.744s 00:29:48.527 user 1m8.035s 00:29:48.527 sys 0m10.438s 00:29:48.527 16:13:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:48.527 16:13:37 -- common/autotest_common.sh@10 -- # set +x 00:29:48.527 ************************************ 00:29:48.527 END TEST nvmf_digest 00:29:48.527 ************************************ 00:29:48.527 16:13:37 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:29:48.527 16:13:37 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:29:48.527 16:13:37 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:29:48.527 16:13:37 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:48.527 16:13:37 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:29:48.527 16:13:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:48.527 16:13:37 -- common/autotest_common.sh@10 -- # set +x 00:29:48.527 ************************************ 00:29:48.527 START TEST nvmf_bdevperf 00:29:48.527 ************************************ 00:29:48.527 16:13:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:48.527 * Looking for test storage... 00:29:48.527 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:48.527 16:13:37 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:48.527 16:13:37 -- nvmf/common.sh@7 -- # uname -s 00:29:48.527 16:13:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:48.527 16:13:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:48.527 16:13:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:48.527 16:13:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:48.527 16:13:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:48.527 16:13:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:48.527 16:13:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:48.527 16:13:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:48.527 16:13:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:48.527 16:13:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:48.527 16:13:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:48.527 16:13:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:48.527 16:13:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:48.527 16:13:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:48.527 16:13:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:48.527 16:13:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:48.527 16:13:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:48.527 16:13:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:48.527 16:13:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:48.527 16:13:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:48.527 16:13:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:48.527 16:13:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:48.527 16:13:37 -- paths/export.sh@5 -- # export PATH 00:29:48.527 16:13:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:48.527 16:13:37 -- nvmf/common.sh@46 -- # : 0 00:29:48.527 16:13:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:48.527 16:13:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:48.527 16:13:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:48.527 16:13:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:48.527 16:13:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:48.527 16:13:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:48.527 16:13:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:48.527 16:13:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:48.527 16:13:37 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:29:48.527 16:13:37 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:29:48.527 16:13:37 -- host/bdevperf.sh@24 -- # nvmftestinit 00:29:48.527 16:13:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:48.527 16:13:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:48.527 16:13:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:48.527 16:13:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:48.527 16:13:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:48.527 16:13:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:48.527 16:13:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:48.527 16:13:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:48.527 16:13:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:48.527 16:13:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:48.528 16:13:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:48.528 16:13:37 -- common/autotest_common.sh@10 -- # set +x 00:29:50.429 16:13:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:50.429 16:13:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:50.429 16:13:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:50.429 16:13:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:50.429 16:13:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:50.429 16:13:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:50.429 16:13:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:50.429 16:13:39 -- nvmf/common.sh@294 -- # net_devs=() 00:29:50.429 16:13:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:50.429 16:13:39 -- nvmf/common.sh@295 -- # e810=() 00:29:50.429 16:13:39 -- nvmf/common.sh@295 -- # local -ga e810 00:29:50.429 16:13:39 -- nvmf/common.sh@296 -- # x722=() 00:29:50.429 16:13:39 -- nvmf/common.sh@296 -- # local -ga x722 00:29:50.429 16:13:39 -- nvmf/common.sh@297 -- # mlx=() 00:29:50.429 16:13:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:50.429 16:13:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:50.429 16:13:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:50.429 16:13:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:50.429 16:13:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:50.429 16:13:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:50.429 16:13:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:50.429 16:13:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:50.429 16:13:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:50.429 16:13:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:50.429 16:13:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:50.429 16:13:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:50.429 16:13:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:50.429 16:13:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:50.429 16:13:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:50.429 16:13:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:50.429 16:13:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:50.429 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:50.429 16:13:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:50.429 16:13:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:50.429 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:50.429 16:13:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:50.429 16:13:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:50.429 16:13:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:50.429 16:13:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:50.429 16:13:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:50.429 16:13:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:50.429 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:50.429 16:13:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:50.429 16:13:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:50.429 16:13:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:50.429 16:13:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:50.429 16:13:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:50.429 16:13:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:50.429 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:50.429 16:13:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:50.429 16:13:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:50.429 16:13:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:50.429 16:13:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:50.429 16:13:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:50.429 16:13:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:50.429 16:13:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:50.429 16:13:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:50.429 16:13:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:50.429 16:13:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:50.429 16:13:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:50.429 16:13:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:50.429 16:13:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:50.429 16:13:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:50.429 16:13:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:50.429 16:13:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:50.429 16:13:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:50.429 16:13:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:50.429 16:13:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:50.429 16:13:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:50.429 16:13:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:50.429 16:13:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:50.429 16:13:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:50.429 16:13:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:50.429 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:50.429 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.380 ms 00:29:50.429 00:29:50.429 --- 10.0.0.2 ping statistics --- 00:29:50.429 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:50.429 rtt min/avg/max/mdev = 0.380/0.380/0.380/0.000 ms 00:29:50.429 16:13:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:50.429 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:50.429 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.149 ms 00:29:50.429 00:29:50.429 --- 10.0.0.1 ping statistics --- 00:29:50.429 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:50.429 rtt min/avg/max/mdev = 0.149/0.149/0.149/0.000 ms 00:29:50.429 16:13:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:50.429 16:13:39 -- nvmf/common.sh@410 -- # return 0 00:29:50.429 16:13:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:50.429 16:13:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:50.429 16:13:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:50.429 16:13:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:50.429 16:13:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:50.429 16:13:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:50.429 16:13:40 -- host/bdevperf.sh@25 -- # tgt_init 00:29:50.429 16:13:40 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:50.429 16:13:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:50.429 16:13:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:50.429 16:13:40 -- common/autotest_common.sh@10 -- # set +x 00:29:50.429 16:13:40 -- nvmf/common.sh@469 -- # nvmfpid=2545123 00:29:50.429 16:13:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:50.429 16:13:40 -- nvmf/common.sh@470 -- # waitforlisten 2545123 00:29:50.429 16:13:40 -- common/autotest_common.sh@819 -- # '[' -z 2545123 ']' 00:29:50.429 16:13:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:50.429 16:13:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:50.429 16:13:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:50.429 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:50.429 16:13:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:50.429 16:13:40 -- common/autotest_common.sh@10 -- # set +x 00:29:50.429 [2024-10-30 16:13:40.066697] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:50.429 [2024-10-30 16:13:40.066785] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:50.429 EAL: No free 2048 kB hugepages reported on node 1 00:29:50.429 [2024-10-30 16:13:40.134522] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:50.429 [2024-10-30 16:13:40.227588] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:50.429 [2024-10-30 16:13:40.227741] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:50.429 [2024-10-30 16:13:40.227758] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:50.429 [2024-10-30 16:13:40.227771] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:50.429 [2024-10-30 16:13:40.227866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:50.429 [2024-10-30 16:13:40.227926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:50.429 [2024-10-30 16:13:40.227929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:51.363 16:13:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:51.363 16:13:41 -- common/autotest_common.sh@852 -- # return 0 00:29:51.363 16:13:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:51.363 16:13:41 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:51.363 16:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:51.363 16:13:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:51.363 16:13:41 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:51.363 16:13:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:51.363 16:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:51.363 [2024-10-30 16:13:41.094893] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:51.363 16:13:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:51.363 16:13:41 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:51.363 16:13:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:51.363 16:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:51.363 Malloc0 00:29:51.363 16:13:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:51.363 16:13:41 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:51.363 16:13:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:51.363 16:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:51.363 16:13:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:51.363 16:13:41 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:51.363 16:13:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:51.363 16:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:51.363 16:13:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:51.363 16:13:41 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:51.363 16:13:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:51.363 16:13:41 -- common/autotest_common.sh@10 -- # set +x 00:29:51.363 [2024-10-30 16:13:41.151279] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:51.363 16:13:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:51.363 16:13:41 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:29:51.363 16:13:41 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:29:51.363 16:13:41 -- nvmf/common.sh@520 -- # config=() 00:29:51.363 16:13:41 -- nvmf/common.sh@520 -- # local subsystem config 00:29:51.363 16:13:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:51.363 16:13:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:51.363 { 00:29:51.363 "params": { 00:29:51.363 "name": "Nvme$subsystem", 00:29:51.363 "trtype": "$TEST_TRANSPORT", 00:29:51.363 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:51.363 "adrfam": "ipv4", 00:29:51.363 "trsvcid": "$NVMF_PORT", 00:29:51.363 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:51.363 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:51.363 "hdgst": ${hdgst:-false}, 00:29:51.363 "ddgst": ${ddgst:-false} 00:29:51.363 }, 00:29:51.363 "method": "bdev_nvme_attach_controller" 00:29:51.363 } 00:29:51.363 EOF 00:29:51.363 )") 00:29:51.363 16:13:41 -- nvmf/common.sh@542 -- # cat 00:29:51.363 16:13:41 -- nvmf/common.sh@544 -- # jq . 00:29:51.363 16:13:41 -- nvmf/common.sh@545 -- # IFS=, 00:29:51.363 16:13:41 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:51.363 "params": { 00:29:51.363 "name": "Nvme1", 00:29:51.363 "trtype": "tcp", 00:29:51.363 "traddr": "10.0.0.2", 00:29:51.363 "adrfam": "ipv4", 00:29:51.363 "trsvcid": "4420", 00:29:51.363 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:51.363 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:51.363 "hdgst": false, 00:29:51.363 "ddgst": false 00:29:51.363 }, 00:29:51.363 "method": "bdev_nvme_attach_controller" 00:29:51.363 }' 00:29:51.363 [2024-10-30 16:13:41.194714] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:51.363 [2024-10-30 16:13:41.194804] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2545288 ] 00:29:51.363 EAL: No free 2048 kB hugepages reported on node 1 00:29:51.622 [2024-10-30 16:13:41.256784] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:51.622 [2024-10-30 16:13:41.340681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:51.880 Running I/O for 1 seconds... 00:29:52.815 00:29:52.815 Latency(us) 00:29:52.815 [2024-10-30T15:13:42.691Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:52.815 [2024-10-30T15:13:42.691Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:52.815 Verification LBA range: start 0x0 length 0x4000 00:29:52.815 Nvme1n1 : 1.01 12920.61 50.47 0.00 0.00 9859.59 1498.83 15631.55 00:29:52.815 [2024-10-30T15:13:42.691Z] =================================================================================================================== 00:29:52.815 [2024-10-30T15:13:42.691Z] Total : 12920.61 50.47 0.00 0.00 9859.59 1498.83 15631.55 00:29:53.073 16:13:42 -- host/bdevperf.sh@30 -- # bdevperfpid=2545432 00:29:53.073 16:13:42 -- host/bdevperf.sh@32 -- # sleep 3 00:29:53.073 16:13:42 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:29:53.073 16:13:42 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:29:53.073 16:13:42 -- nvmf/common.sh@520 -- # config=() 00:29:53.073 16:13:42 -- nvmf/common.sh@520 -- # local subsystem config 00:29:53.073 16:13:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:53.073 16:13:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:53.073 { 00:29:53.073 "params": { 00:29:53.073 "name": "Nvme$subsystem", 00:29:53.073 "trtype": "$TEST_TRANSPORT", 00:29:53.073 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:53.073 "adrfam": "ipv4", 00:29:53.073 "trsvcid": "$NVMF_PORT", 00:29:53.073 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:53.073 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:53.073 "hdgst": ${hdgst:-false}, 00:29:53.073 "ddgst": ${ddgst:-false} 00:29:53.073 }, 00:29:53.073 "method": "bdev_nvme_attach_controller" 00:29:53.073 } 00:29:53.073 EOF 00:29:53.073 )") 00:29:53.073 16:13:42 -- nvmf/common.sh@542 -- # cat 00:29:53.073 16:13:42 -- nvmf/common.sh@544 -- # jq . 00:29:53.073 16:13:42 -- nvmf/common.sh@545 -- # IFS=, 00:29:53.073 16:13:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:53.073 "params": { 00:29:53.073 "name": "Nvme1", 00:29:53.073 "trtype": "tcp", 00:29:53.073 "traddr": "10.0.0.2", 00:29:53.073 "adrfam": "ipv4", 00:29:53.073 "trsvcid": "4420", 00:29:53.073 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:53.073 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:53.073 "hdgst": false, 00:29:53.073 "ddgst": false 00:29:53.073 }, 00:29:53.073 "method": "bdev_nvme_attach_controller" 00:29:53.073 }' 00:29:53.073 [2024-10-30 16:13:42.825352] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:53.073 [2024-10-30 16:13:42.825432] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2545432 ] 00:29:53.073 EAL: No free 2048 kB hugepages reported on node 1 00:29:53.073 [2024-10-30 16:13:42.890353] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:53.331 [2024-10-30 16:13:42.975348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:53.589 Running I/O for 15 seconds... 00:29:56.120 16:13:45 -- host/bdevperf.sh@33 -- # kill -9 2545123 00:29:56.120 16:13:45 -- host/bdevperf.sh@35 -- # sleep 3 00:29:56.120 [2024-10-30 16:13:45.797001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:111784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.120 [2024-10-30 16:13:45.797068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.120 [2024-10-30 16:13:45.797104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:111792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.120 [2024-10-30 16:13:45.797122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.120 [2024-10-30 16:13:45.797144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:111816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.120 [2024-10-30 16:13:45.797160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.120 [2024-10-30 16:13:45.797179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:111824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.120 [2024-10-30 16:13:45.797194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.120 [2024-10-30 16:13:45.797212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:111848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.120 [2024-10-30 16:13:45.797227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.120 [2024-10-30 16:13:45.797245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:111856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.120 [2024-10-30 16:13:45.797270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.120 [2024-10-30 16:13:45.797289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:111864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.120 [2024-10-30 16:13:45.797331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.120 [2024-10-30 16:13:45.797348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:111880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.120 [2024-10-30 16:13:45.797361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.120 [2024-10-30 16:13:45.797380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:111888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.120 [2024-10-30 16:13:45.797394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.120 [2024-10-30 16:13:45.797411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:111896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.797426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:111904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.797458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:111936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.797489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:111968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.797519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:112000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.121 [2024-10-30 16:13:45.797578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:112008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.797613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:112016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.797647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:112024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.121 [2024-10-30 16:13:45.797679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:112032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.121 [2024-10-30 16:13:45.797715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:112040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.797747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:111344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.797779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:111360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.797810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:111384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.797842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:111400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.797872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:111416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.797903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:111432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.797935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:111440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.797970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.797987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:111448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:112048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.121 [2024-10-30 16:13:45.798033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:112056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.121 [2024-10-30 16:13:45.798065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:112064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:112072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:112080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.121 [2024-10-30 16:13:45.798158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:112088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.121 [2024-10-30 16:13:45.798189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:112096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.121 [2024-10-30 16:13:45.798221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:112104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:112112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.121 [2024-10-30 16:13:45.798295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:112120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:112128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:112136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:112144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:112152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.121 [2024-10-30 16:13:45.798459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:111456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:111464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:111472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:111480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:111512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:111544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:111576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:111592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:112160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.121 [2024-10-30 16:13:45.798759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.121 [2024-10-30 16:13:45.798776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:112168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.121 [2024-10-30 16:13:45.798794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.798811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:112176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.798826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.798842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:112184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.798857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.798874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:112192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.798888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.798904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:112200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.798919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.798936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:112208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.798951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.798967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:112216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.798982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.798998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:112224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.799013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:112232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.799044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:112240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:112248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.799106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:112256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:112264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.799169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:112272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.799206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:112280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:112288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:112296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:112304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:112312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.799384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:112320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.799413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:112328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:112336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.799468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:112344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.799497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:112352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:112360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.799586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:112368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.799616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:112376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.799653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:112384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.799684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:112392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:111632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:111648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:111656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:111672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:111696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:111728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:111736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:111752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.799971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.799988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:112400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.122 [2024-10-30 16:13:45.800002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.800019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:112408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.800041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.800060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:112416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.800074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.800091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:112424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.800105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.800123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:112432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.122 [2024-10-30 16:13:45.800138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.122 [2024-10-30 16:13:45.800155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:112440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.123 [2024-10-30 16:13:45.800169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:112448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.123 [2024-10-30 16:13:45.800201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:112456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.800233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:112464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.800274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:112472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.123 [2024-10-30 16:13:45.800322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:112480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.123 [2024-10-30 16:13:45.800359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:112488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.800387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:112496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.800415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:112504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.123 [2024-10-30 16:13:45.800444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:111768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.800476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:111776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.800505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:111800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.800532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:111808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.800576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:111832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.800619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:111840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.800652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:111872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.800691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:111912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.800724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:112512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.123 [2024-10-30 16:13:45.800755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:112520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.123 [2024-10-30 16:13:45.800787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:112528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.800819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:112536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.123 [2024-10-30 16:13:45.800851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:112544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.123 [2024-10-30 16:13:45.800892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:112552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.123 [2024-10-30 16:13:45.800925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:112560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.800957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.800973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:112568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.123 [2024-10-30 16:13:45.800988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.801005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:112576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.801020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.801037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:112584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.801051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.801068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:112592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.801082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.801099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:111920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.801113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.801131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:111928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.801146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.801162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:111944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.801176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.801194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:111952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.801215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.801233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:111960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.801247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.801273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:111976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.801303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.801328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:111984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.123 [2024-10-30 16:13:45.801342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.801357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xcaa900 is same with the state(5) to be set 00:29:56.123 [2024-10-30 16:13:45.801374] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:56.123 [2024-10-30 16:13:45.801386] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:56.123 [2024-10-30 16:13:45.801397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:111992 len:8 PRP1 0x0 PRP2 0x0 00:29:56.123 [2024-10-30 16:13:45.801415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:56.123 [2024-10-30 16:13:45.801479] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xcaa900 was disconnected and freed. reset controller. 00:29:56.123 [2024-10-30 16:13:45.803950] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.123 [2024-10-30 16:13:45.804029] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.123 [2024-10-30 16:13:45.804507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.123 [2024-10-30 16:13:45.804662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.123 [2024-10-30 16:13:45.804691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.123 [2024-10-30 16:13:45.804709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.123 [2024-10-30 16:13:45.804878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.123 [2024-10-30 16:13:45.805049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.123 [2024-10-30 16:13:45.805072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.123 [2024-10-30 16:13:45.805092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.124 [2024-10-30 16:13:45.807500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.124 [2024-10-30 16:13:45.816891] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.124 [2024-10-30 16:13:45.817252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.817435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.817461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.124 [2024-10-30 16:13:45.817477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.124 [2024-10-30 16:13:45.817635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.124 [2024-10-30 16:13:45.817750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.124 [2024-10-30 16:13:45.817772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.124 [2024-10-30 16:13:45.817787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.124 [2024-10-30 16:13:45.820351] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.124 [2024-10-30 16:13:45.829402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.124 [2024-10-30 16:13:45.829729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.829946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.829974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.124 [2024-10-30 16:13:45.829990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.124 [2024-10-30 16:13:45.830195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.124 [2024-10-30 16:13:45.830380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.124 [2024-10-30 16:13:45.830403] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.124 [2024-10-30 16:13:45.830417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.124 [2024-10-30 16:13:45.832597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.124 [2024-10-30 16:13:45.842075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.124 [2024-10-30 16:13:45.842421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.842534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.842564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.124 [2024-10-30 16:13:45.842582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.124 [2024-10-30 16:13:45.842748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.124 [2024-10-30 16:13:45.842971] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.124 [2024-10-30 16:13:45.842997] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.124 [2024-10-30 16:13:45.843012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.124 [2024-10-30 16:13:45.845396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.124 [2024-10-30 16:13:45.854787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.124 [2024-10-30 16:13:45.855134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.855299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.855331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.124 [2024-10-30 16:13:45.855349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.124 [2024-10-30 16:13:45.855480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.124 [2024-10-30 16:13:45.855613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.124 [2024-10-30 16:13:45.855636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.124 [2024-10-30 16:13:45.855651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.124 [2024-10-30 16:13:45.857906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.124 [2024-10-30 16:13:45.867382] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.124 [2024-10-30 16:13:45.867757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.867903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.867933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.124 [2024-10-30 16:13:45.867951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.124 [2024-10-30 16:13:45.868130] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.124 [2024-10-30 16:13:45.868374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.124 [2024-10-30 16:13:45.868401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.124 [2024-10-30 16:13:45.868417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.124 [2024-10-30 16:13:45.870669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.124 [2024-10-30 16:13:45.879983] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.124 [2024-10-30 16:13:45.880322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.880487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.880517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.124 [2024-10-30 16:13:45.880536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.124 [2024-10-30 16:13:45.880721] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.124 [2024-10-30 16:13:45.880926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.124 [2024-10-30 16:13:45.880952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.124 [2024-10-30 16:13:45.880967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.124 [2024-10-30 16:13:45.883356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.124 [2024-10-30 16:13:45.892674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.124 [2024-10-30 16:13:45.892928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.893084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.893111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.124 [2024-10-30 16:13:45.893127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.124 [2024-10-30 16:13:45.893305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.124 [2024-10-30 16:13:45.893498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.124 [2024-10-30 16:13:45.893524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.124 [2024-10-30 16:13:45.893540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.124 [2024-10-30 16:13:45.895777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.124 [2024-10-30 16:13:45.905200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.124 [2024-10-30 16:13:45.905529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.905678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.905736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.124 [2024-10-30 16:13:45.905761] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.124 [2024-10-30 16:13:45.905963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.124 [2024-10-30 16:13:45.906135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.124 [2024-10-30 16:13:45.906160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.124 [2024-10-30 16:13:45.906176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.124 [2024-10-30 16:13:45.908389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.124 [2024-10-30 16:13:45.917763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.124 [2024-10-30 16:13:45.918046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.918168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.124 [2024-10-30 16:13:45.918193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.124 [2024-10-30 16:13:45.918208] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.124 [2024-10-30 16:13:45.918402] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.124 [2024-10-30 16:13:45.918551] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.124 [2024-10-30 16:13:45.918576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.124 [2024-10-30 16:13:45.918593] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.124 [2024-10-30 16:13:45.921097] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.124 [2024-10-30 16:13:45.930275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.125 [2024-10-30 16:13:45.930633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.125 [2024-10-30 16:13:45.930794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.125 [2024-10-30 16:13:45.930822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.125 [2024-10-30 16:13:45.930839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.125 [2024-10-30 16:13:45.931023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.125 [2024-10-30 16:13:45.931173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.125 [2024-10-30 16:13:45.931199] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.125 [2024-10-30 16:13:45.931216] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.125 [2024-10-30 16:13:45.933661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.125 [2024-10-30 16:13:45.942866] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.125 [2024-10-30 16:13:45.943193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.125 [2024-10-30 16:13:45.943357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.125 [2024-10-30 16:13:45.943393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.125 [2024-10-30 16:13:45.943409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.125 [2024-10-30 16:13:45.943581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.125 [2024-10-30 16:13:45.943725] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.125 [2024-10-30 16:13:45.943752] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.125 [2024-10-30 16:13:45.943768] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.125 [2024-10-30 16:13:45.946164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.125 [2024-10-30 16:13:45.955575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.125 [2024-10-30 16:13:45.955946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.125 [2024-10-30 16:13:45.956049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.125 [2024-10-30 16:13:45.956073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.125 [2024-10-30 16:13:45.956089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.125 [2024-10-30 16:13:45.956229] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.125 [2024-10-30 16:13:45.956424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.125 [2024-10-30 16:13:45.956449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.125 [2024-10-30 16:13:45.956464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.125 [2024-10-30 16:13:45.958969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.125 [2024-10-30 16:13:45.968062] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.125 [2024-10-30 16:13:45.968376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.125 [2024-10-30 16:13:45.968531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.125 [2024-10-30 16:13:45.968562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.125 [2024-10-30 16:13:45.968581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.125 [2024-10-30 16:13:45.968783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.125 [2024-10-30 16:13:45.968899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.125 [2024-10-30 16:13:45.968924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.125 [2024-10-30 16:13:45.968940] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.125 [2024-10-30 16:13:45.971298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.125 [2024-10-30 16:13:45.980315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.125 [2024-10-30 16:13:45.980663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.125 [2024-10-30 16:13:45.980789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.125 [2024-10-30 16:13:45.980816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.125 [2024-10-30 16:13:45.980831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.125 [2024-10-30 16:13:45.980989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.125 [2024-10-30 16:13:45.981182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.125 [2024-10-30 16:13:45.981206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.125 [2024-10-30 16:13:45.981222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.125 [2024-10-30 16:13:45.983417] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.125 [2024-10-30 16:13:45.992867] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.125 [2024-10-30 16:13:45.993193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.125 [2024-10-30 16:13:45.993352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.125 [2024-10-30 16:13:45.993383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.125 [2024-10-30 16:13:45.993401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.125 [2024-10-30 16:13:45.993584] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.125 [2024-10-30 16:13:45.993771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.125 [2024-10-30 16:13:45.993797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.125 [2024-10-30 16:13:45.993813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.125 [2024-10-30 16:13:45.996103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.384 [2024-10-30 16:13:46.005699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.384 [2024-10-30 16:13:46.006034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.384 [2024-10-30 16:13:46.006163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.384 [2024-10-30 16:13:46.006191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.384 [2024-10-30 16:13:46.006208] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.384 [2024-10-30 16:13:46.006422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.384 [2024-10-30 16:13:46.006610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.384 [2024-10-30 16:13:46.006635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.384 [2024-10-30 16:13:46.006650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.384 [2024-10-30 16:13:46.008975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.384 [2024-10-30 16:13:46.018180] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.384 [2024-10-30 16:13:46.018522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.384 [2024-10-30 16:13:46.018751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.384 [2024-10-30 16:13:46.018782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.384 [2024-10-30 16:13:46.018800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.385 [2024-10-30 16:13:46.018966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.385 [2024-10-30 16:13:46.019135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.385 [2024-10-30 16:13:46.019167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.385 [2024-10-30 16:13:46.019184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.385 [2024-10-30 16:13:46.021578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.385 [2024-10-30 16:13:46.030848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.385 [2024-10-30 16:13:46.031129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.031287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.031318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.385 [2024-10-30 16:13:46.031337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.385 [2024-10-30 16:13:46.031486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.385 [2024-10-30 16:13:46.031673] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.385 [2024-10-30 16:13:46.031698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.385 [2024-10-30 16:13:46.031714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.385 [2024-10-30 16:13:46.034206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.385 [2024-10-30 16:13:46.043309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.385 [2024-10-30 16:13:46.043622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.043705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.043730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.385 [2024-10-30 16:13:46.043745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.385 [2024-10-30 16:13:46.043920] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.385 [2024-10-30 16:13:46.044030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.385 [2024-10-30 16:13:46.044049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.385 [2024-10-30 16:13:46.044062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.385 [2024-10-30 16:13:46.046445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.385 [2024-10-30 16:13:46.055789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.385 [2024-10-30 16:13:46.056106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.056272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.056301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.385 [2024-10-30 16:13:46.056319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.385 [2024-10-30 16:13:46.056486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.385 [2024-10-30 16:13:46.056673] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.385 [2024-10-30 16:13:46.056699] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.385 [2024-10-30 16:13:46.056721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.385 [2024-10-30 16:13:46.059250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.385 [2024-10-30 16:13:46.068425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.385 [2024-10-30 16:13:46.068785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.068902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.068930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.385 [2024-10-30 16:13:46.068948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.385 [2024-10-30 16:13:46.069114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.385 [2024-10-30 16:13:46.069295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.385 [2024-10-30 16:13:46.069330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.385 [2024-10-30 16:13:46.069349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.385 [2024-10-30 16:13:46.071857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.385 [2024-10-30 16:13:46.080968] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.385 [2024-10-30 16:13:46.081295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.081433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.081461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.385 [2024-10-30 16:13:46.081478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.385 [2024-10-30 16:13:46.081627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.385 [2024-10-30 16:13:46.081796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.385 [2024-10-30 16:13:46.081822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.385 [2024-10-30 16:13:46.081837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.385 [2024-10-30 16:13:46.084019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.385 [2024-10-30 16:13:46.093660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.385 [2024-10-30 16:13:46.093997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.094170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.094196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.385 [2024-10-30 16:13:46.094212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.385 [2024-10-30 16:13:46.094419] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.385 [2024-10-30 16:13:46.094588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.385 [2024-10-30 16:13:46.094613] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.385 [2024-10-30 16:13:46.094629] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.385 [2024-10-30 16:13:46.097030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.385 [2024-10-30 16:13:46.106240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.385 [2024-10-30 16:13:46.106657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.106779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.106805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.385 [2024-10-30 16:13:46.106837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.385 [2024-10-30 16:13:46.107004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.385 [2024-10-30 16:13:46.107210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.385 [2024-10-30 16:13:46.107235] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.385 [2024-10-30 16:13:46.107251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.385 [2024-10-30 16:13:46.109433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.385 [2024-10-30 16:13:46.118633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.385 [2024-10-30 16:13:46.118935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.119099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.119126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.385 [2024-10-30 16:13:46.119143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.385 [2024-10-30 16:13:46.119321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.385 [2024-10-30 16:13:46.119475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.385 [2024-10-30 16:13:46.119500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.385 [2024-10-30 16:13:46.119516] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.385 [2024-10-30 16:13:46.121787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.385 [2024-10-30 16:13:46.131225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.385 [2024-10-30 16:13:46.131547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.131713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.131739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.385 [2024-10-30 16:13:46.131756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.385 [2024-10-30 16:13:46.131954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.385 [2024-10-30 16:13:46.132177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.385 [2024-10-30 16:13:46.132203] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.385 [2024-10-30 16:13:46.132218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.385 [2024-10-30 16:13:46.134556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.385 [2024-10-30 16:13:46.143849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.385 [2024-10-30 16:13:46.144171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.144329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.385 [2024-10-30 16:13:46.144358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.386 [2024-10-30 16:13:46.144390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.386 [2024-10-30 16:13:46.144540] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.386 [2024-10-30 16:13:46.144727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.386 [2024-10-30 16:13:46.144751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.386 [2024-10-30 16:13:46.144767] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.386 [2024-10-30 16:13:46.147239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.386 [2024-10-30 16:13:46.156350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.386 [2024-10-30 16:13:46.156675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.156832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.156860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.386 [2024-10-30 16:13:46.156878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.386 [2024-10-30 16:13:46.157043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.386 [2024-10-30 16:13:46.157230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.386 [2024-10-30 16:13:46.157264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.386 [2024-10-30 16:13:46.157283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.386 [2024-10-30 16:13:46.159665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.386 [2024-10-30 16:13:46.168849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.386 [2024-10-30 16:13:46.169210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.169347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.169373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.386 [2024-10-30 16:13:46.169389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.386 [2024-10-30 16:13:46.169572] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.386 [2024-10-30 16:13:46.169771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.386 [2024-10-30 16:13:46.169796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.386 [2024-10-30 16:13:46.169812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.386 [2024-10-30 16:13:46.172137] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.386 [2024-10-30 16:13:46.181553] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.386 [2024-10-30 16:13:46.181898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.182081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.182120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.386 [2024-10-30 16:13:46.182150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.386 [2024-10-30 16:13:46.182362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.386 [2024-10-30 16:13:46.182607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.386 [2024-10-30 16:13:46.182643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.386 [2024-10-30 16:13:46.182671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.386 [2024-10-30 16:13:46.184889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.386 [2024-10-30 16:13:46.193964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.386 [2024-10-30 16:13:46.194272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.194424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.194452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.386 [2024-10-30 16:13:46.194470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.386 [2024-10-30 16:13:46.194647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.386 [2024-10-30 16:13:46.194813] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.386 [2024-10-30 16:13:46.194838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.386 [2024-10-30 16:13:46.194855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.386 [2024-10-30 16:13:46.197411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.386 [2024-10-30 16:13:46.206633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.386 [2024-10-30 16:13:46.206988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.207117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.207145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.386 [2024-10-30 16:13:46.207164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.386 [2024-10-30 16:13:46.207386] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.386 [2024-10-30 16:13:46.207595] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.386 [2024-10-30 16:13:46.207620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.386 [2024-10-30 16:13:46.207636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.386 [2024-10-30 16:13:46.209854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.386 [2024-10-30 16:13:46.219094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.386 [2024-10-30 16:13:46.219439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.219577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.219607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.386 [2024-10-30 16:13:46.219631] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.386 [2024-10-30 16:13:46.219798] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.386 [2024-10-30 16:13:46.219950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.386 [2024-10-30 16:13:46.219974] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.386 [2024-10-30 16:13:46.219994] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.386 [2024-10-30 16:13:46.222471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.386 [2024-10-30 16:13:46.231738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.386 [2024-10-30 16:13:46.232066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.232214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.232240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.386 [2024-10-30 16:13:46.232267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.386 [2024-10-30 16:13:46.232401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.386 [2024-10-30 16:13:46.232585] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.386 [2024-10-30 16:13:46.232609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.386 [2024-10-30 16:13:46.232625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.386 [2024-10-30 16:13:46.234847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.386 [2024-10-30 16:13:46.244342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.386 [2024-10-30 16:13:46.244625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.244749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.244776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.386 [2024-10-30 16:13:46.244792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.386 [2024-10-30 16:13:46.244976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.386 [2024-10-30 16:13:46.245165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.386 [2024-10-30 16:13:46.245189] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.386 [2024-10-30 16:13:46.245206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.386 [2024-10-30 16:13:46.247676] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.386 [2024-10-30 16:13:46.256994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.386 [2024-10-30 16:13:46.257345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.257476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.386 [2024-10-30 16:13:46.257505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.386 [2024-10-30 16:13:46.257523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.386 [2024-10-30 16:13:46.257696] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.386 [2024-10-30 16:13:46.257848] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.386 [2024-10-30 16:13:46.257873] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.386 [2024-10-30 16:13:46.257889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.386 [2024-10-30 16:13:46.260236] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.646 [2024-10-30 16:13:46.269576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.646 [2024-10-30 16:13:46.269815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.646 [2024-10-30 16:13:46.269946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.646 [2024-10-30 16:13:46.269978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.646 [2024-10-30 16:13:46.269996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.646 [2024-10-30 16:13:46.270144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.646 [2024-10-30 16:13:46.270343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.646 [2024-10-30 16:13:46.270368] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.646 [2024-10-30 16:13:46.270384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.646 [2024-10-30 16:13:46.272843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.646 [2024-10-30 16:13:46.282207] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.646 [2024-10-30 16:13:46.282587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.646 [2024-10-30 16:13:46.282753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.646 [2024-10-30 16:13:46.282783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.646 [2024-10-30 16:13:46.282801] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.646 [2024-10-30 16:13:46.282993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.646 [2024-10-30 16:13:46.283145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.646 [2024-10-30 16:13:46.283169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.646 [2024-10-30 16:13:46.283185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.646 [2024-10-30 16:13:46.285454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.646 [2024-10-30 16:13:46.294568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.646 [2024-10-30 16:13:46.294873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.646 [2024-10-30 16:13:46.295041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.646 [2024-10-30 16:13:46.295070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.646 [2024-10-30 16:13:46.295089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.646 [2024-10-30 16:13:46.295199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.646 [2024-10-30 16:13:46.295368] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.646 [2024-10-30 16:13:46.295394] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.646 [2024-10-30 16:13:46.295409] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.646 [2024-10-30 16:13:46.297628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.646 [2024-10-30 16:13:46.307044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.646 [2024-10-30 16:13:46.307326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.646 [2024-10-30 16:13:46.307482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.646 [2024-10-30 16:13:46.307511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.646 [2024-10-30 16:13:46.307530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.646 [2024-10-30 16:13:46.307696] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.646 [2024-10-30 16:13:46.307866] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.646 [2024-10-30 16:13:46.307890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.646 [2024-10-30 16:13:46.307906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.646 [2024-10-30 16:13:46.310369] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.646 [2024-10-30 16:13:46.319811] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.646 [2024-10-30 16:13:46.320092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.646 [2024-10-30 16:13:46.320191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.646 [2024-10-30 16:13:46.320219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.646 [2024-10-30 16:13:46.320237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.646 [2024-10-30 16:13:46.320397] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.646 [2024-10-30 16:13:46.320513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.647 [2024-10-30 16:13:46.320537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.647 [2024-10-30 16:13:46.320552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.647 [2024-10-30 16:13:46.322755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.647 [2024-10-30 16:13:46.332541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.647 [2024-10-30 16:13:46.332842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.333001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.333029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.647 [2024-10-30 16:13:46.333047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.647 [2024-10-30 16:13:46.333249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.647 [2024-10-30 16:13:46.333376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.647 [2024-10-30 16:13:46.333406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.647 [2024-10-30 16:13:46.333423] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.647 [2024-10-30 16:13:46.335897] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.647 [2024-10-30 16:13:46.345008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.647 [2024-10-30 16:13:46.345281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.345436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.345465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.647 [2024-10-30 16:13:46.345482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.647 [2024-10-30 16:13:46.345666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.647 [2024-10-30 16:13:46.345819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.647 [2024-10-30 16:13:46.345844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.647 [2024-10-30 16:13:46.345860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.647 [2024-10-30 16:13:46.348022] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.647 [2024-10-30 16:13:46.357609] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.647 [2024-10-30 16:13:46.357906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.358060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.358091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.647 [2024-10-30 16:13:46.358109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.647 [2024-10-30 16:13:46.358268] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.647 [2024-10-30 16:13:46.358467] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.647 [2024-10-30 16:13:46.358493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.647 [2024-10-30 16:13:46.358509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.647 [2024-10-30 16:13:46.360817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.647 [2024-10-30 16:13:46.370074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.647 [2024-10-30 16:13:46.370459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.370607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.370635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.647 [2024-10-30 16:13:46.370652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.647 [2024-10-30 16:13:46.370768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.647 [2024-10-30 16:13:46.370946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.647 [2024-10-30 16:13:46.370971] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.647 [2024-10-30 16:13:46.370993] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.647 [2024-10-30 16:13:46.373252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.647 [2024-10-30 16:13:46.382636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.647 [2024-10-30 16:13:46.382926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.383124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.383151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.647 [2024-10-30 16:13:46.383167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.647 [2024-10-30 16:13:46.383340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.647 [2024-10-30 16:13:46.383492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.647 [2024-10-30 16:13:46.383518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.647 [2024-10-30 16:13:46.383534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.647 [2024-10-30 16:13:46.385885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.647 [2024-10-30 16:13:46.395319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.647 [2024-10-30 16:13:46.395666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.395885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.395910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.647 [2024-10-30 16:13:46.395926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.647 [2024-10-30 16:13:46.396126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.647 [2024-10-30 16:13:46.396290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.647 [2024-10-30 16:13:46.396317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.647 [2024-10-30 16:13:46.396332] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.647 [2024-10-30 16:13:46.398678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.647 [2024-10-30 16:13:46.407850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.647 [2024-10-30 16:13:46.408109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.408214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.408242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.647 [2024-10-30 16:13:46.408273] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.647 [2024-10-30 16:13:46.408442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.647 [2024-10-30 16:13:46.408631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.647 [2024-10-30 16:13:46.408656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.647 [2024-10-30 16:13:46.408673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.647 [2024-10-30 16:13:46.410985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.647 [2024-10-30 16:13:46.420299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.647 [2024-10-30 16:13:46.420588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.420718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.420745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.647 [2024-10-30 16:13:46.420763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.647 [2024-10-30 16:13:46.420947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.647 [2024-10-30 16:13:46.421101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.647 [2024-10-30 16:13:46.421126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.647 [2024-10-30 16:13:46.421142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.647 [2024-10-30 16:13:46.423586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.647 [2024-10-30 16:13:46.432772] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.647 [2024-10-30 16:13:46.433111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.433243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.433280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.647 [2024-10-30 16:13:46.433301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.647 [2024-10-30 16:13:46.433481] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.647 [2024-10-30 16:13:46.433699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.647 [2024-10-30 16:13:46.433725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.647 [2024-10-30 16:13:46.433741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.647 [2024-10-30 16:13:46.436136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.647 [2024-10-30 16:13:46.445114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.647 [2024-10-30 16:13:46.445422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.445542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.647 [2024-10-30 16:13:46.445570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.647 [2024-10-30 16:13:46.445588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.648 [2024-10-30 16:13:46.445748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.648 [2024-10-30 16:13:46.445911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.648 [2024-10-30 16:13:46.445935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.648 [2024-10-30 16:13:46.445950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.648 [2024-10-30 16:13:46.448073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.648 [2024-10-30 16:13:46.457431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.648 [2024-10-30 16:13:46.457706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.648 [2024-10-30 16:13:46.457793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.648 [2024-10-30 16:13:46.457817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.648 [2024-10-30 16:13:46.457832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.648 [2024-10-30 16:13:46.457976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.648 [2024-10-30 16:13:46.458092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.648 [2024-10-30 16:13:46.458112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.648 [2024-10-30 16:13:46.458126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.648 [2024-10-30 16:13:46.460162] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.648 [2024-10-30 16:13:46.469618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.648 [2024-10-30 16:13:46.469948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.648 [2024-10-30 16:13:46.470069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.648 [2024-10-30 16:13:46.470094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.648 [2024-10-30 16:13:46.470109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.648 [2024-10-30 16:13:46.470317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.648 [2024-10-30 16:13:46.470516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.648 [2024-10-30 16:13:46.470538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.648 [2024-10-30 16:13:46.470550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.648 [2024-10-30 16:13:46.472520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.648 [2024-10-30 16:13:46.481816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.648 [2024-10-30 16:13:46.482076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.648 [2024-10-30 16:13:46.482204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.648 [2024-10-30 16:13:46.482231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.648 [2024-10-30 16:13:46.482247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.648 [2024-10-30 16:13:46.482410] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.648 [2024-10-30 16:13:46.482575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.648 [2024-10-30 16:13:46.482596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.648 [2024-10-30 16:13:46.482610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.648 [2024-10-30 16:13:46.484598] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.648 [2024-10-30 16:13:46.493989] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.648 [2024-10-30 16:13:46.494377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.648 [2024-10-30 16:13:46.494522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.648 [2024-10-30 16:13:46.494547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.648 [2024-10-30 16:13:46.494564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.648 [2024-10-30 16:13:46.494698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.648 [2024-10-30 16:13:46.494841] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.648 [2024-10-30 16:13:46.494860] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.648 [2024-10-30 16:13:46.494872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.648 [2024-10-30 16:13:46.496734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.648 [2024-10-30 16:13:46.506017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.648 [2024-10-30 16:13:46.506390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.648 [2024-10-30 16:13:46.506482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.648 [2024-10-30 16:13:46.506507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.648 [2024-10-30 16:13:46.506524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.648 [2024-10-30 16:13:46.506704] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.648 [2024-10-30 16:13:46.506858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.648 [2024-10-30 16:13:46.506877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.648 [2024-10-30 16:13:46.506889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.648 [2024-10-30 16:13:46.508901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.648 [2024-10-30 16:13:46.518123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.648 [2024-10-30 16:13:46.518429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.648 [2024-10-30 16:13:46.518553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.648 [2024-10-30 16:13:46.518580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.648 [2024-10-30 16:13:46.518597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.648 [2024-10-30 16:13:46.518747] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.648 [2024-10-30 16:13:46.518923] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.648 [2024-10-30 16:13:46.518959] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.648 [2024-10-30 16:13:46.518972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.648 [2024-10-30 16:13:46.521210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.908 [2024-10-30 16:13:46.530754] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.908 [2024-10-30 16:13:46.531078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.908 [2024-10-30 16:13:46.531230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.908 [2024-10-30 16:13:46.531271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.908 [2024-10-30 16:13:46.531290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.908 [2024-10-30 16:13:46.531457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.908 [2024-10-30 16:13:46.531634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.908 [2024-10-30 16:13:46.531655] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.908 [2024-10-30 16:13:46.531667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.908 [2024-10-30 16:13:46.533646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.908 [2024-10-30 16:13:46.542916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.908 [2024-10-30 16:13:46.543301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.908 [2024-10-30 16:13:46.543451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.908 [2024-10-30 16:13:46.543477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.908 [2024-10-30 16:13:46.543493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.908 [2024-10-30 16:13:46.543681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.908 [2024-10-30 16:13:46.543862] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.908 [2024-10-30 16:13:46.543883] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.908 [2024-10-30 16:13:46.543896] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.908 [2024-10-30 16:13:46.545954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.908 [2024-10-30 16:13:46.555210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.908 [2024-10-30 16:13:46.555592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.908 [2024-10-30 16:13:46.555715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.555740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.909 [2024-10-30 16:13:46.555756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.909 [2024-10-30 16:13:46.555921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.909 [2024-10-30 16:13:46.556121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.909 [2024-10-30 16:13:46.556142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.909 [2024-10-30 16:13:46.556155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.909 [2024-10-30 16:13:46.558107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.909 [2024-10-30 16:13:46.567925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.909 [2024-10-30 16:13:46.568223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.568366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.568394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.909 [2024-10-30 16:13:46.568416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.909 [2024-10-30 16:13:46.568549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.909 [2024-10-30 16:13:46.568733] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.909 [2024-10-30 16:13:46.568754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.909 [2024-10-30 16:13:46.568768] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.909 [2024-10-30 16:13:46.570736] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.909 [2024-10-30 16:13:46.580148] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.909 [2024-10-30 16:13:46.580414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.580555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.580582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.909 [2024-10-30 16:13:46.580598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.909 [2024-10-30 16:13:46.580715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.909 [2024-10-30 16:13:46.580894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.909 [2024-10-30 16:13:46.580929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.909 [2024-10-30 16:13:46.580942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.909 [2024-10-30 16:13:46.582854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.909 [2024-10-30 16:13:46.592425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.909 [2024-10-30 16:13:46.592748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.592879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.592905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.909 [2024-10-30 16:13:46.592921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.909 [2024-10-30 16:13:46.593069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.909 [2024-10-30 16:13:46.593185] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.909 [2024-10-30 16:13:46.593219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.909 [2024-10-30 16:13:46.593232] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.909 [2024-10-30 16:13:46.595363] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.909 [2024-10-30 16:13:46.604738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.909 [2024-10-30 16:13:46.605080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.605200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.605227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.909 [2024-10-30 16:13:46.605243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.909 [2024-10-30 16:13:46.605376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.909 [2024-10-30 16:13:46.605542] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.909 [2024-10-30 16:13:46.605563] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.909 [2024-10-30 16:13:46.605577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.909 [2024-10-30 16:13:46.607531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.909 [2024-10-30 16:13:46.616752] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.909 [2024-10-30 16:13:46.617107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.617231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.617266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.909 [2024-10-30 16:13:46.617285] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.909 [2024-10-30 16:13:46.617435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.909 [2024-10-30 16:13:46.617642] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.909 [2024-10-30 16:13:46.617663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.909 [2024-10-30 16:13:46.617676] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.909 [2024-10-30 16:13:46.619740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.909 [2024-10-30 16:13:46.628906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.909 [2024-10-30 16:13:46.629214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.629374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.629400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.909 [2024-10-30 16:13:46.629417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.909 [2024-10-30 16:13:46.629567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.909 [2024-10-30 16:13:46.629738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.909 [2024-10-30 16:13:46.629759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.909 [2024-10-30 16:13:46.629773] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.909 [2024-10-30 16:13:46.631894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.909 [2024-10-30 16:13:46.641076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.909 [2024-10-30 16:13:46.641337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.641513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.641541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.909 [2024-10-30 16:13:46.641558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.909 [2024-10-30 16:13:46.641752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.909 [2024-10-30 16:13:46.641910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.909 [2024-10-30 16:13:46.641931] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.909 [2024-10-30 16:13:46.641944] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.909 [2024-10-30 16:13:46.643938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.909 [2024-10-30 16:13:46.653111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.909 [2024-10-30 16:13:46.653441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.653565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.653590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.909 [2024-10-30 16:13:46.653607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.909 [2024-10-30 16:13:46.653756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.909 [2024-10-30 16:13:46.653898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.909 [2024-10-30 16:13:46.653919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.909 [2024-10-30 16:13:46.653932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.909 [2024-10-30 16:13:46.655858] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.909 [2024-10-30 16:13:46.665344] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.909 [2024-10-30 16:13:46.665632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.665724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.909 [2024-10-30 16:13:46.665748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.909 [2024-10-30 16:13:46.665763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.909 [2024-10-30 16:13:46.665939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.909 [2024-10-30 16:13:46.666125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.909 [2024-10-30 16:13:46.666146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.909 [2024-10-30 16:13:46.666158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.909 [2024-10-30 16:13:46.668125] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.909 [2024-10-30 16:13:46.677472] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.910 [2024-10-30 16:13:46.677812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.677954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.677980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.910 [2024-10-30 16:13:46.677996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.910 [2024-10-30 16:13:46.678161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.910 [2024-10-30 16:13:46.678330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.910 [2024-10-30 16:13:46.678356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.910 [2024-10-30 16:13:46.678371] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.910 [2024-10-30 16:13:46.680229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.910 [2024-10-30 16:13:46.689723] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.910 [2024-10-30 16:13:46.690067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.690207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.690235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.910 [2024-10-30 16:13:46.690251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.910 [2024-10-30 16:13:46.690427] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.910 [2024-10-30 16:13:46.690616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.910 [2024-10-30 16:13:46.690637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.910 [2024-10-30 16:13:46.690650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.910 [2024-10-30 16:13:46.692728] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.910 [2024-10-30 16:13:46.701896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.910 [2024-10-30 16:13:46.702225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.702324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.702350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.910 [2024-10-30 16:13:46.702365] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.910 [2024-10-30 16:13:46.702466] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.910 [2024-10-30 16:13:46.702660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.910 [2024-10-30 16:13:46.702696] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.910 [2024-10-30 16:13:46.702709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.910 [2024-10-30 16:13:46.704678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.910 [2024-10-30 16:13:46.713890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.910 [2024-10-30 16:13:46.714186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.714316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.714343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.910 [2024-10-30 16:13:46.714360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.910 [2024-10-30 16:13:46.714574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.910 [2024-10-30 16:13:46.714728] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.910 [2024-10-30 16:13:46.714749] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.910 [2024-10-30 16:13:46.714771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.910 [2024-10-30 16:13:46.716607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.910 [2024-10-30 16:13:46.725882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.910 [2024-10-30 16:13:46.726208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.726324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.726350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.910 [2024-10-30 16:13:46.726367] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.910 [2024-10-30 16:13:46.726533] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.910 [2024-10-30 16:13:46.726692] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.910 [2024-10-30 16:13:46.726712] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.910 [2024-10-30 16:13:46.726724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.910 [2024-10-30 16:13:46.728590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.910 [2024-10-30 16:13:46.738170] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.910 [2024-10-30 16:13:46.738549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.738668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.738694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.910 [2024-10-30 16:13:46.738710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.910 [2024-10-30 16:13:46.738919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.910 [2024-10-30 16:13:46.739083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.910 [2024-10-30 16:13:46.739103] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.910 [2024-10-30 16:13:46.739116] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.910 [2024-10-30 16:13:46.741201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.910 [2024-10-30 16:13:46.750431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.910 [2024-10-30 16:13:46.750743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.750850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.750875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.910 [2024-10-30 16:13:46.750891] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.910 [2024-10-30 16:13:46.751055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.910 [2024-10-30 16:13:46.751252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.910 [2024-10-30 16:13:46.751295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.910 [2024-10-30 16:13:46.751308] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.910 [2024-10-30 16:13:46.753407] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.910 [2024-10-30 16:13:46.762467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.910 [2024-10-30 16:13:46.762773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.762926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.762954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.910 [2024-10-30 16:13:46.762971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.910 [2024-10-30 16:13:46.763104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.910 [2024-10-30 16:13:46.763275] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.910 [2024-10-30 16:13:46.763312] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.910 [2024-10-30 16:13:46.763326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.910 [2024-10-30 16:13:46.765134] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:56.910 [2024-10-30 16:13:46.774446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:56.910 [2024-10-30 16:13:46.774812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.774962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.910 [2024-10-30 16:13:46.774987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:56.910 [2024-10-30 16:13:46.775003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:56.910 [2024-10-30 16:13:46.775195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:56.910 [2024-10-30 16:13:46.775393] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:56.910 [2024-10-30 16:13:46.775416] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:56.910 [2024-10-30 16:13:46.775429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:56.910 [2024-10-30 16:13:46.777298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.171 [2024-10-30 16:13:46.786898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.171 [2024-10-30 16:13:46.787229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.171 [2024-10-30 16:13:46.787369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.171 [2024-10-30 16:13:46.787396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.171 [2024-10-30 16:13:46.787412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.171 [2024-10-30 16:13:46.787578] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.171 [2024-10-30 16:13:46.787719] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.171 [2024-10-30 16:13:46.787740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.171 [2024-10-30 16:13:46.787752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.171 [2024-10-30 16:13:46.789692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.171 [2024-10-30 16:13:46.799095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.171 [2024-10-30 16:13:46.799464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.171 [2024-10-30 16:13:46.799607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.171 [2024-10-30 16:13:46.799634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.171 [2024-10-30 16:13:46.799651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.171 [2024-10-30 16:13:46.799799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.171 [2024-10-30 16:13:46.799985] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.171 [2024-10-30 16:13:46.800005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.171 [2024-10-30 16:13:46.800018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.171 [2024-10-30 16:13:46.802025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.171 [2024-10-30 16:13:46.811382] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.171 [2024-10-30 16:13:46.811689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.171 [2024-10-30 16:13:46.811829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.171 [2024-10-30 16:13:46.811854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.171 [2024-10-30 16:13:46.811870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.171 [2024-10-30 16:13:46.812036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.171 [2024-10-30 16:13:46.812216] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.171 [2024-10-30 16:13:46.812251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.171 [2024-10-30 16:13:46.812276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.171 [2024-10-30 16:13:46.814337] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.171 [2024-10-30 16:13:46.823682] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.171 [2024-10-30 16:13:46.823927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.171 [2024-10-30 16:13:46.824053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.171 [2024-10-30 16:13:46.824079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.171 [2024-10-30 16:13:46.824095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.171 [2024-10-30 16:13:46.824226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.171 [2024-10-30 16:13:46.824356] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.171 [2024-10-30 16:13:46.824378] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.171 [2024-10-30 16:13:46.824392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.171 [2024-10-30 16:13:46.826404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.171 [2024-10-30 16:13:46.835818] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.171 [2024-10-30 16:13:46.836166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.171 [2024-10-30 16:13:46.836300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.171 [2024-10-30 16:13:46.836327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.171 [2024-10-30 16:13:46.836343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.171 [2024-10-30 16:13:46.836493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.172 [2024-10-30 16:13:46.836660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.172 [2024-10-30 16:13:46.836681] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.172 [2024-10-30 16:13:46.836693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.172 [2024-10-30 16:13:46.838697] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.172 [2024-10-30 16:13:46.847975] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.172 [2024-10-30 16:13:46.848351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.848445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.848469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.172 [2024-10-30 16:13:46.848485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.172 [2024-10-30 16:13:46.848634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.172 [2024-10-30 16:13:46.848782] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.172 [2024-10-30 16:13:46.848801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.172 [2024-10-30 16:13:46.848814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.172 [2024-10-30 16:13:46.850763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.172 [2024-10-30 16:13:46.860115] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.172 [2024-10-30 16:13:46.860414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.860507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.860548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.172 [2024-10-30 16:13:46.860564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.172 [2024-10-30 16:13:46.860753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.172 [2024-10-30 16:13:46.860891] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.172 [2024-10-30 16:13:46.860912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.172 [2024-10-30 16:13:46.860925] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.172 [2024-10-30 16:13:46.862978] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.172 [2024-10-30 16:13:46.872303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.172 [2024-10-30 16:13:46.872590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.872689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.872720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.172 [2024-10-30 16:13:46.872737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.172 [2024-10-30 16:13:46.872949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.172 [2024-10-30 16:13:46.873134] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.172 [2024-10-30 16:13:46.873154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.172 [2024-10-30 16:13:46.873165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.172 [2024-10-30 16:13:46.875149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.172 [2024-10-30 16:13:46.884528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.172 [2024-10-30 16:13:46.884941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.885096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.885122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.172 [2024-10-30 16:13:46.885138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.172 [2024-10-30 16:13:46.885296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.172 [2024-10-30 16:13:46.885463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.172 [2024-10-30 16:13:46.885485] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.172 [2024-10-30 16:13:46.885499] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.172 [2024-10-30 16:13:46.887289] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.172 [2024-10-30 16:13:46.896750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.172 [2024-10-30 16:13:46.897077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.897199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.897224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.172 [2024-10-30 16:13:46.897262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.172 [2024-10-30 16:13:46.897415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.172 [2024-10-30 16:13:46.897594] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.172 [2024-10-30 16:13:46.897628] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.172 [2024-10-30 16:13:46.897641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.172 [2024-10-30 16:13:46.899433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.172 [2024-10-30 16:13:46.908988] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.172 [2024-10-30 16:13:46.909283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.909411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.909436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.172 [2024-10-30 16:13:46.909458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.172 [2024-10-30 16:13:46.909608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.172 [2024-10-30 16:13:46.909771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.172 [2024-10-30 16:13:46.909792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.172 [2024-10-30 16:13:46.909804] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.172 [2024-10-30 16:13:46.911810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.172 [2024-10-30 16:13:46.921130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.172 [2024-10-30 16:13:46.921447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.921564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.921591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.172 [2024-10-30 16:13:46.921608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.172 [2024-10-30 16:13:46.921726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.172 [2024-10-30 16:13:46.921933] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.172 [2024-10-30 16:13:46.921954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.172 [2024-10-30 16:13:46.921966] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.172 [2024-10-30 16:13:46.923960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.172 [2024-10-30 16:13:46.933335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.172 [2024-10-30 16:13:46.933634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.933765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.933791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.172 [2024-10-30 16:13:46.933807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.172 [2024-10-30 16:13:46.934002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.172 [2024-10-30 16:13:46.934143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.172 [2024-10-30 16:13:46.934164] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.172 [2024-10-30 16:13:46.934176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.172 [2024-10-30 16:13:46.936165] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.172 [2024-10-30 16:13:46.945599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.172 [2024-10-30 16:13:46.945909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.946014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.946040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.172 [2024-10-30 16:13:46.946057] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.172 [2024-10-30 16:13:46.946264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.172 [2024-10-30 16:13:46.946472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.172 [2024-10-30 16:13:46.946493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.172 [2024-10-30 16:13:46.946505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.172 [2024-10-30 16:13:46.948504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.172 [2024-10-30 16:13:46.957886] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.172 [2024-10-30 16:13:46.958183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.958324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.172 [2024-10-30 16:13:46.958353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.173 [2024-10-30 16:13:46.958373] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.173 [2024-10-30 16:13:46.958552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.173 [2024-10-30 16:13:46.958703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.173 [2024-10-30 16:13:46.958724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.173 [2024-10-30 16:13:46.958736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.173 [2024-10-30 16:13:46.960918] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.173 [2024-10-30 16:13:46.969979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.173 [2024-10-30 16:13:46.970308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.173 [2024-10-30 16:13:46.970397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.173 [2024-10-30 16:13:46.970422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.173 [2024-10-30 16:13:46.970438] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.173 [2024-10-30 16:13:46.970555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.173 [2024-10-30 16:13:46.970728] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.173 [2024-10-30 16:13:46.970747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.173 [2024-10-30 16:13:46.970761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.173 [2024-10-30 16:13:46.972666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.173 [2024-10-30 16:13:46.982060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.173 [2024-10-30 16:13:46.982376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.173 [2024-10-30 16:13:46.982496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.173 [2024-10-30 16:13:46.982522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.173 [2024-10-30 16:13:46.982538] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.173 [2024-10-30 16:13:46.982716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.173 [2024-10-30 16:13:46.982884] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.173 [2024-10-30 16:13:46.982909] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.173 [2024-10-30 16:13:46.982922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.173 [2024-10-30 16:13:46.984917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.173 [2024-10-30 16:13:46.994123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.173 [2024-10-30 16:13:46.994481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.173 [2024-10-30 16:13:46.994656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.173 [2024-10-30 16:13:46.994681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.173 [2024-10-30 16:13:46.994697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.173 [2024-10-30 16:13:46.994794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.173 [2024-10-30 16:13:46.994982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.173 [2024-10-30 16:13:46.995001] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.173 [2024-10-30 16:13:46.995014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.173 [2024-10-30 16:13:46.996978] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.173 [2024-10-30 16:13:47.006336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.173 [2024-10-30 16:13:47.006607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.173 [2024-10-30 16:13:47.006780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.173 [2024-10-30 16:13:47.006807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.173 [2024-10-30 16:13:47.006823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.173 [2024-10-30 16:13:47.006973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.173 [2024-10-30 16:13:47.007173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.173 [2024-10-30 16:13:47.007194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.173 [2024-10-30 16:13:47.007207] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.173 [2024-10-30 16:13:47.009115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.173 [2024-10-30 16:13:47.018558] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.173 [2024-10-30 16:13:47.018945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.173 [2024-10-30 16:13:47.019064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.173 [2024-10-30 16:13:47.019090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.173 [2024-10-30 16:13:47.019106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.173 [2024-10-30 16:13:47.019264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.173 [2024-10-30 16:13:47.019444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.173 [2024-10-30 16:13:47.019464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.173 [2024-10-30 16:13:47.019482] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.173 [2024-10-30 16:13:47.021309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.173 [2024-10-30 16:13:47.030817] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.173 [2024-10-30 16:13:47.031177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.173 [2024-10-30 16:13:47.031333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.173 [2024-10-30 16:13:47.031362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.173 [2024-10-30 16:13:47.031379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.173 [2024-10-30 16:13:47.031560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.173 [2024-10-30 16:13:47.031760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.173 [2024-10-30 16:13:47.031781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.173 [2024-10-30 16:13:47.031794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.173 [2024-10-30 16:13:47.033746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.173 [2024-10-30 16:13:47.042889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.173 [2024-10-30 16:13:47.043168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.173 [2024-10-30 16:13:47.043291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.173 [2024-10-30 16:13:47.043319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.173 [2024-10-30 16:13:47.043335] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.173 [2024-10-30 16:13:47.043469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.173 [2024-10-30 16:13:47.043603] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.173 [2024-10-30 16:13:47.043623] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.173 [2024-10-30 16:13:47.043636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.173 [2024-10-30 16:13:47.045882] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.433 [2024-10-30 16:13:47.055289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.433 [2024-10-30 16:13:47.055711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.433 [2024-10-30 16:13:47.055803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.433 [2024-10-30 16:13:47.055830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.433 [2024-10-30 16:13:47.055846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.433 [2024-10-30 16:13:47.056076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.433 [2024-10-30 16:13:47.056229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.433 [2024-10-30 16:13:47.056251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.433 [2024-10-30 16:13:47.056289] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.433 [2024-10-30 16:13:47.058158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.433 [2024-10-30 16:13:47.067464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.433 [2024-10-30 16:13:47.067807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.433 [2024-10-30 16:13:47.067926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.433 [2024-10-30 16:13:47.067952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.433 [2024-10-30 16:13:47.067969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.433 [2024-10-30 16:13:47.068151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.433 [2024-10-30 16:13:47.068358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.433 [2024-10-30 16:13:47.068383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.433 [2024-10-30 16:13:47.068398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.433 [2024-10-30 16:13:47.070757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.433 [2024-10-30 16:13:47.079914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.433 [2024-10-30 16:13:47.080324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.433 [2024-10-30 16:13:47.080449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.433 [2024-10-30 16:13:47.080475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.433 [2024-10-30 16:13:47.080491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.433 [2024-10-30 16:13:47.080641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.434 [2024-10-30 16:13:47.080828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.434 [2024-10-30 16:13:47.080848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.434 [2024-10-30 16:13:47.080860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.434 [2024-10-30 16:13:47.082946] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.434 [2024-10-30 16:13:47.092198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.434 [2024-10-30 16:13:47.092536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.092656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.092681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.434 [2024-10-30 16:13:47.092698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.434 [2024-10-30 16:13:47.092846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.434 [2024-10-30 16:13:47.093017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.434 [2024-10-30 16:13:47.093036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.434 [2024-10-30 16:13:47.093049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.434 [2024-10-30 16:13:47.095041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.434 [2024-10-30 16:13:47.104359] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.434 [2024-10-30 16:13:47.104717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.104806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.104831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.434 [2024-10-30 16:13:47.104848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.434 [2024-10-30 16:13:47.104981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.434 [2024-10-30 16:13:47.105154] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.434 [2024-10-30 16:13:47.105175] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.434 [2024-10-30 16:13:47.105188] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.434 [2024-10-30 16:13:47.107017] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.434 [2024-10-30 16:13:47.116569] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.434 [2024-10-30 16:13:47.116812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.116966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.116993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.434 [2024-10-30 16:13:47.117010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.434 [2024-10-30 16:13:47.117174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.434 [2024-10-30 16:13:47.117388] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.434 [2024-10-30 16:13:47.117411] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.434 [2024-10-30 16:13:47.117425] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.434 [2024-10-30 16:13:47.119367] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.434 [2024-10-30 16:13:47.128667] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.434 [2024-10-30 16:13:47.128992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.129147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.129172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.434 [2024-10-30 16:13:47.129188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.434 [2024-10-30 16:13:47.129347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.434 [2024-10-30 16:13:47.129509] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.434 [2024-10-30 16:13:47.129544] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.434 [2024-10-30 16:13:47.129558] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.434 [2024-10-30 16:13:47.131362] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.434 [2024-10-30 16:13:47.140842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.434 [2024-10-30 16:13:47.141204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.141328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.141355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.434 [2024-10-30 16:13:47.141371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.434 [2024-10-30 16:13:47.141521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.434 [2024-10-30 16:13:47.141695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.434 [2024-10-30 16:13:47.141714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.434 [2024-10-30 16:13:47.141726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.434 [2024-10-30 16:13:47.143662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.434 [2024-10-30 16:13:47.152901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.434 [2024-10-30 16:13:47.153209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.153362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.153390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.434 [2024-10-30 16:13:47.153406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.434 [2024-10-30 16:13:47.153524] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.434 [2024-10-30 16:13:47.153686] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.434 [2024-10-30 16:13:47.153722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.434 [2024-10-30 16:13:47.153736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.434 [2024-10-30 16:13:47.155847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.434 [2024-10-30 16:13:47.165003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.434 [2024-10-30 16:13:47.165336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.165439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.165465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.434 [2024-10-30 16:13:47.165481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.434 [2024-10-30 16:13:47.165645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.434 [2024-10-30 16:13:47.165833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.434 [2024-10-30 16:13:47.165853] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.434 [2024-10-30 16:13:47.165865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.434 [2024-10-30 16:13:47.167917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.434 [2024-10-30 16:13:47.177156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.434 [2024-10-30 16:13:47.177468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.177578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.177611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.434 [2024-10-30 16:13:47.177628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.434 [2024-10-30 16:13:47.177806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.434 [2024-10-30 16:13:47.177975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.434 [2024-10-30 16:13:47.177996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.434 [2024-10-30 16:13:47.178008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.434 [2024-10-30 16:13:47.180065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.434 [2024-10-30 16:13:47.189330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.434 [2024-10-30 16:13:47.189645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.189820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.434 [2024-10-30 16:13:47.189863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.434 [2024-10-30 16:13:47.189878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.434 [2024-10-30 16:13:47.190039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.434 [2024-10-30 16:13:47.190178] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.434 [2024-10-30 16:13:47.190199] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.435 [2024-10-30 16:13:47.190212] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.435 [2024-10-30 16:13:47.192191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.435 [2024-10-30 16:13:47.201599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.435 [2024-10-30 16:13:47.201936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.202081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.202108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.435 [2024-10-30 16:13:47.202125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.435 [2024-10-30 16:13:47.202265] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.435 [2024-10-30 16:13:47.202414] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.435 [2024-10-30 16:13:47.202436] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.435 [2024-10-30 16:13:47.202449] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.435 [2024-10-30 16:13:47.204489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.435 [2024-10-30 16:13:47.213798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.435 [2024-10-30 16:13:47.214057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.214244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.214281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.435 [2024-10-30 16:13:47.214303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.435 [2024-10-30 16:13:47.214470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.435 [2024-10-30 16:13:47.214629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.435 [2024-10-30 16:13:47.214650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.435 [2024-10-30 16:13:47.214662] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.435 [2024-10-30 16:13:47.216558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.435 [2024-10-30 16:13:47.225790] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.435 [2024-10-30 16:13:47.226148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.226300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.226327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.435 [2024-10-30 16:13:47.226344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.435 [2024-10-30 16:13:47.226541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.435 [2024-10-30 16:13:47.226694] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.435 [2024-10-30 16:13:47.226714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.435 [2024-10-30 16:13:47.226726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.435 [2024-10-30 16:13:47.228768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.435 [2024-10-30 16:13:47.237798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.435 [2024-10-30 16:13:47.238119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.238247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.238278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.435 [2024-10-30 16:13:47.238294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.435 [2024-10-30 16:13:47.238459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.435 [2024-10-30 16:13:47.238666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.435 [2024-10-30 16:13:47.238687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.435 [2024-10-30 16:13:47.238699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.435 [2024-10-30 16:13:47.240665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.435 [2024-10-30 16:13:47.249946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.435 [2024-10-30 16:13:47.250229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.250380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.250409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.435 [2024-10-30 16:13:47.250426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.435 [2024-10-30 16:13:47.250597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.435 [2024-10-30 16:13:47.250782] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.435 [2024-10-30 16:13:47.250804] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.435 [2024-10-30 16:13:47.250817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.435 [2024-10-30 16:13:47.252870] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.435 [2024-10-30 16:13:47.261883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.435 [2024-10-30 16:13:47.262164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.262294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.262321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.435 [2024-10-30 16:13:47.262338] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.435 [2024-10-30 16:13:47.262471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.435 [2024-10-30 16:13:47.262620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.435 [2024-10-30 16:13:47.262641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.435 [2024-10-30 16:13:47.262654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.435 [2024-10-30 16:13:47.264590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.435 [2024-10-30 16:13:47.274027] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.435 [2024-10-30 16:13:47.274322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.274504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.274532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.435 [2024-10-30 16:13:47.274548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.435 [2024-10-30 16:13:47.274694] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.435 [2024-10-30 16:13:47.274850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.435 [2024-10-30 16:13:47.274871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.435 [2024-10-30 16:13:47.274884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.435 [2024-10-30 16:13:47.276957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.435 [2024-10-30 16:13:47.286074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.435 [2024-10-30 16:13:47.286403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.286526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.286553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.435 [2024-10-30 16:13:47.286570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.435 [2024-10-30 16:13:47.286702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.435 [2024-10-30 16:13:47.286869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.435 [2024-10-30 16:13:47.286891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.435 [2024-10-30 16:13:47.286904] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.435 [2024-10-30 16:13:47.288952] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.435 [2024-10-30 16:13:47.298214] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.435 [2024-10-30 16:13:47.298650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.298825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.435 [2024-10-30 16:13:47.298851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.435 [2024-10-30 16:13:47.298867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.436 [2024-10-30 16:13:47.299085] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.436 [2024-10-30 16:13:47.299208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.436 [2024-10-30 16:13:47.299228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.436 [2024-10-30 16:13:47.299241] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.436 [2024-10-30 16:13:47.301163] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.436 [2024-10-30 16:13:47.310488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.436 [2024-10-30 16:13:47.310804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.436 [2024-10-30 16:13:47.310950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.436 [2024-10-30 16:13:47.310977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.436 [2024-10-30 16:13:47.310993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.695 [2024-10-30 16:13:47.311111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.695 [2024-10-30 16:13:47.311301] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.695 [2024-10-30 16:13:47.311341] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.695 [2024-10-30 16:13:47.311355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.695 [2024-10-30 16:13:47.313480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.695 [2024-10-30 16:13:47.322956] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.695 [2024-10-30 16:13:47.323270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.695 [2024-10-30 16:13:47.323436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.695 [2024-10-30 16:13:47.323464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.695 [2024-10-30 16:13:47.323480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.695 [2024-10-30 16:13:47.323640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.695 [2024-10-30 16:13:47.323808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.695 [2024-10-30 16:13:47.323839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.695 [2024-10-30 16:13:47.323856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.695 [2024-10-30 16:13:47.326389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.695 [2024-10-30 16:13:47.335794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.695 [2024-10-30 16:13:47.336066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.695 [2024-10-30 16:13:47.336208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.695 [2024-10-30 16:13:47.336234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.695 [2024-10-30 16:13:47.336275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.695 [2024-10-30 16:13:47.336442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.695 [2024-10-30 16:13:47.336649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.695 [2024-10-30 16:13:47.336673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.695 [2024-10-30 16:13:47.336689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.695 [2024-10-30 16:13:47.339037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.695 [2024-10-30 16:13:47.348343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.695 [2024-10-30 16:13:47.348670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.695 [2024-10-30 16:13:47.348803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.695 [2024-10-30 16:13:47.348830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.695 [2024-10-30 16:13:47.348847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.695 [2024-10-30 16:13:47.349005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.695 [2024-10-30 16:13:47.349157] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.695 [2024-10-30 16:13:47.349181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.695 [2024-10-30 16:13:47.349196] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.695 [2024-10-30 16:13:47.351466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.695 [2024-10-30 16:13:47.361000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.695 [2024-10-30 16:13:47.361327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.695 [2024-10-30 16:13:47.361452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.361478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.696 [2024-10-30 16:13:47.361494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.696 [2024-10-30 16:13:47.361649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.696 [2024-10-30 16:13:47.361802] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.696 [2024-10-30 16:13:47.361826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.696 [2024-10-30 16:13:47.361847] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.696 [2024-10-30 16:13:47.364012] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.696 [2024-10-30 16:13:47.373462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.696 [2024-10-30 16:13:47.373751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.373879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.373921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.696 [2024-10-30 16:13:47.373937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.696 [2024-10-30 16:13:47.374079] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.696 [2024-10-30 16:13:47.374274] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.696 [2024-10-30 16:13:47.374300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.696 [2024-10-30 16:13:47.374315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.696 [2024-10-30 16:13:47.376731] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.696 [2024-10-30 16:13:47.385913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.696 [2024-10-30 16:13:47.386220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.386381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.386408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.696 [2024-10-30 16:13:47.386425] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.696 [2024-10-30 16:13:47.386571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.696 [2024-10-30 16:13:47.386780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.696 [2024-10-30 16:13:47.386804] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.696 [2024-10-30 16:13:47.386820] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.696 [2024-10-30 16:13:47.388989] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.696 [2024-10-30 16:13:47.398458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.696 [2024-10-30 16:13:47.398782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.398910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.398939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.696 [2024-10-30 16:13:47.398957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.696 [2024-10-30 16:13:47.399105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.696 [2024-10-30 16:13:47.399286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.696 [2024-10-30 16:13:47.399311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.696 [2024-10-30 16:13:47.399326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.696 [2024-10-30 16:13:47.401680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.696 [2024-10-30 16:13:47.411264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.696 [2024-10-30 16:13:47.411557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.411716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.411743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.696 [2024-10-30 16:13:47.411760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.696 [2024-10-30 16:13:47.411907] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.696 [2024-10-30 16:13:47.412073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.696 [2024-10-30 16:13:47.412098] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.696 [2024-10-30 16:13:47.412114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.696 [2024-10-30 16:13:47.414419] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.696 [2024-10-30 16:13:47.423865] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.696 [2024-10-30 16:13:47.424162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.424352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.424380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.696 [2024-10-30 16:13:47.424397] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.696 [2024-10-30 16:13:47.424588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.696 [2024-10-30 16:13:47.424771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.696 [2024-10-30 16:13:47.424796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.696 [2024-10-30 16:13:47.424812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.696 [2024-10-30 16:13:47.427029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.696 [2024-10-30 16:13:47.436639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.696 [2024-10-30 16:13:47.436931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.437085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.437113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.696 [2024-10-30 16:13:47.437131] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.696 [2024-10-30 16:13:47.437327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.696 [2024-10-30 16:13:47.437498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.696 [2024-10-30 16:13:47.437523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.696 [2024-10-30 16:13:47.437538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.696 [2024-10-30 16:13:47.439934] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.696 [2024-10-30 16:13:47.449184] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.696 [2024-10-30 16:13:47.449469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.449606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.449635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.696 [2024-10-30 16:13:47.449653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.696 [2024-10-30 16:13:47.449783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.696 [2024-10-30 16:13:47.449971] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.696 [2024-10-30 16:13:47.449995] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.696 [2024-10-30 16:13:47.450011] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.696 [2024-10-30 16:13:47.452331] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.696 [2024-10-30 16:13:47.461602] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.696 [2024-10-30 16:13:47.461916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.462082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.462108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.696 [2024-10-30 16:13:47.462125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.696 [2024-10-30 16:13:47.462298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.696 [2024-10-30 16:13:47.462483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.696 [2024-10-30 16:13:47.462507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.696 [2024-10-30 16:13:47.462522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.696 [2024-10-30 16:13:47.464831] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.696 [2024-10-30 16:13:47.474229] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.696 [2024-10-30 16:13:47.474544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.474699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.696 [2024-10-30 16:13:47.474729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.696 [2024-10-30 16:13:47.474746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.696 [2024-10-30 16:13:47.474930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.696 [2024-10-30 16:13:47.475082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.696 [2024-10-30 16:13:47.475106] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.696 [2024-10-30 16:13:47.475121] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.696 [2024-10-30 16:13:47.477406] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.696 [2024-10-30 16:13:47.486977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.696 [2024-10-30 16:13:47.487272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.697 [2024-10-30 16:13:47.487420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.697 [2024-10-30 16:13:47.487462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.697 [2024-10-30 16:13:47.487479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.697 [2024-10-30 16:13:47.487626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.697 [2024-10-30 16:13:47.487801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.697 [2024-10-30 16:13:47.487826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.697 [2024-10-30 16:13:47.487842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.697 [2024-10-30 16:13:47.490286] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.697 [2024-10-30 16:13:47.499565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.697 [2024-10-30 16:13:47.499865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.697 [2024-10-30 16:13:47.500004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.697 [2024-10-30 16:13:47.500030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.697 [2024-10-30 16:13:47.500047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.697 [2024-10-30 16:13:47.500224] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.697 [2024-10-30 16:13:47.500409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.697 [2024-10-30 16:13:47.500435] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.697 [2024-10-30 16:13:47.500450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.697 [2024-10-30 16:13:47.502720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.697 [2024-10-30 16:13:47.512039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.697 [2024-10-30 16:13:47.512388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.697 [2024-10-30 16:13:47.512513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.697 [2024-10-30 16:13:47.512547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.697 [2024-10-30 16:13:47.512565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.697 [2024-10-30 16:13:47.512750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.697 [2024-10-30 16:13:47.512920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.697 [2024-10-30 16:13:47.512945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.697 [2024-10-30 16:13:47.512960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.697 [2024-10-30 16:13:47.515016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.697 [2024-10-30 16:13:47.524524] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.697 [2024-10-30 16:13:47.524809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.697 [2024-10-30 16:13:47.524964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.697 [2024-10-30 16:13:47.525009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.697 [2024-10-30 16:13:47.525028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.697 [2024-10-30 16:13:47.525177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.697 [2024-10-30 16:13:47.525344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.697 [2024-10-30 16:13:47.525369] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.697 [2024-10-30 16:13:47.525384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.697 [2024-10-30 16:13:47.527619] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.697 [2024-10-30 16:13:47.537076] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.697 [2024-10-30 16:13:47.537338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.697 [2024-10-30 16:13:47.537514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.697 [2024-10-30 16:13:47.537541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.697 [2024-10-30 16:13:47.537558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.697 [2024-10-30 16:13:47.537736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.697 [2024-10-30 16:13:47.537896] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.697 [2024-10-30 16:13:47.537921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.697 [2024-10-30 16:13:47.537937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.697 [2024-10-30 16:13:47.540230] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.697 [2024-10-30 16:13:47.549586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.697 [2024-10-30 16:13:47.549900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.697 [2024-10-30 16:13:47.550003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.697 [2024-10-30 16:13:47.550030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.697 [2024-10-30 16:13:47.550047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.697 [2024-10-30 16:13:47.550280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.697 [2024-10-30 16:13:47.550486] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.697 [2024-10-30 16:13:47.550512] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.697 [2024-10-30 16:13:47.550528] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.697 [2024-10-30 16:13:47.552781] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.697 [2024-10-30 16:13:47.562301] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.697 [2024-10-30 16:13:47.562622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.697 [2024-10-30 16:13:47.562754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.697 [2024-10-30 16:13:47.562797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.697 [2024-10-30 16:13:47.562818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.697 [2024-10-30 16:13:47.563022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.697 [2024-10-30 16:13:47.563189] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.697 [2024-10-30 16:13:47.563214] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.697 [2024-10-30 16:13:47.563230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.697 [2024-10-30 16:13:47.565534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.957 [2024-10-30 16:13:47.574895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.957 [2024-10-30 16:13:47.575190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.957 [2024-10-30 16:13:47.575334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.957 [2024-10-30 16:13:47.575360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.957 [2024-10-30 16:13:47.575377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.957 [2024-10-30 16:13:47.575527] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.957 [2024-10-30 16:13:47.575717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.957 [2024-10-30 16:13:47.575743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.957 [2024-10-30 16:13:47.575759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.957 [2024-10-30 16:13:47.577869] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.957 [2024-10-30 16:13:47.587425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.957 [2024-10-30 16:13:47.587739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.957 [2024-10-30 16:13:47.587908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.957 [2024-10-30 16:13:47.587934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.957 [2024-10-30 16:13:47.587950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.957 [2024-10-30 16:13:47.588182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.957 [2024-10-30 16:13:47.588349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.957 [2024-10-30 16:13:47.588375] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.957 [2024-10-30 16:13:47.588391] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.957 [2024-10-30 16:13:47.590627] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.957 [2024-10-30 16:13:47.600046] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.957 [2024-10-30 16:13:47.600434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.957 [2024-10-30 16:13:47.600529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.957 [2024-10-30 16:13:47.600554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.957 [2024-10-30 16:13:47.600571] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.957 [2024-10-30 16:13:47.600752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.957 [2024-10-30 16:13:47.600915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.957 [2024-10-30 16:13:47.600939] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.957 [2024-10-30 16:13:47.600954] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.957 [2024-10-30 16:13:47.603272] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.957 [2024-10-30 16:13:47.612588] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.957 [2024-10-30 16:13:47.612880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.957 [2024-10-30 16:13:47.613009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.957 [2024-10-30 16:13:47.613039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.957 [2024-10-30 16:13:47.613058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.957 [2024-10-30 16:13:47.613224] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.957 [2024-10-30 16:13:47.613407] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.957 [2024-10-30 16:13:47.613434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.957 [2024-10-30 16:13:47.613449] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.957 [2024-10-30 16:13:47.615844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.957 [2024-10-30 16:13:47.625134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.957 [2024-10-30 16:13:47.625475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.957 [2024-10-30 16:13:47.625633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.957 [2024-10-30 16:13:47.625659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.957 [2024-10-30 16:13:47.625676] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.957 [2024-10-30 16:13:47.625888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.957 [2024-10-30 16:13:47.626077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.957 [2024-10-30 16:13:47.626102] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.957 [2024-10-30 16:13:47.626117] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.957 [2024-10-30 16:13:47.628437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.957 [2024-10-30 16:13:47.637654] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.957 [2024-10-30 16:13:47.637990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.957 [2024-10-30 16:13:47.638122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.957 [2024-10-30 16:13:47.638150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.957 [2024-10-30 16:13:47.638169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.957 [2024-10-30 16:13:47.638314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.957 [2024-10-30 16:13:47.638525] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.957 [2024-10-30 16:13:47.638549] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.957 [2024-10-30 16:13:47.638564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.957 [2024-10-30 16:13:47.640851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.957 [2024-10-30 16:13:47.650272] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.957 [2024-10-30 16:13:47.650560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.957 [2024-10-30 16:13:47.650714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.957 [2024-10-30 16:13:47.650740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.957 [2024-10-30 16:13:47.650757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.957 [2024-10-30 16:13:47.650894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.957 [2024-10-30 16:13:47.651099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.957 [2024-10-30 16:13:47.651124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.957 [2024-10-30 16:13:47.651140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.957 [2024-10-30 16:13:47.653587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.957 [2024-10-30 16:13:47.662909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.958 [2024-10-30 16:13:47.663147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.663285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.663331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.958 [2024-10-30 16:13:47.663348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.958 [2024-10-30 16:13:47.663514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.958 [2024-10-30 16:13:47.663660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.958 [2024-10-30 16:13:47.663686] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.958 [2024-10-30 16:13:47.663702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.958 [2024-10-30 16:13:47.666116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.958 [2024-10-30 16:13:47.675501] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.958 [2024-10-30 16:13:47.675772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.675901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.675926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.958 [2024-10-30 16:13:47.675942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.958 [2024-10-30 16:13:47.676157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.958 [2024-10-30 16:13:47.676359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.958 [2024-10-30 16:13:47.676386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.958 [2024-10-30 16:13:47.676407] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.958 [2024-10-30 16:13:47.678895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.958 [2024-10-30 16:13:47.688207] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.958 [2024-10-30 16:13:47.688469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.688597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.688627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.958 [2024-10-30 16:13:47.688645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.958 [2024-10-30 16:13:47.688811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.958 [2024-10-30 16:13:47.689016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.958 [2024-10-30 16:13:47.689041] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.958 [2024-10-30 16:13:47.689057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.958 [2024-10-30 16:13:47.691559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.958 [2024-10-30 16:13:47.700823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.958 [2024-10-30 16:13:47.701136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.701293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.701323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.958 [2024-10-30 16:13:47.701342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.958 [2024-10-30 16:13:47.701507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.958 [2024-10-30 16:13:47.701640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.958 [2024-10-30 16:13:47.701665] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.958 [2024-10-30 16:13:47.701680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.958 [2024-10-30 16:13:47.704096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.958 [2024-10-30 16:13:47.713171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.958 [2024-10-30 16:13:47.713530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.713684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.713726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.958 [2024-10-30 16:13:47.713745] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.958 [2024-10-30 16:13:47.713946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.958 [2024-10-30 16:13:47.714097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.958 [2024-10-30 16:13:47.714122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.958 [2024-10-30 16:13:47.714138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.958 [2024-10-30 16:13:47.716700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.958 [2024-10-30 16:13:47.725655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.958 [2024-10-30 16:13:47.726051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.726188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.726214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.958 [2024-10-30 16:13:47.726230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.958 [2024-10-30 16:13:47.726392] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.958 [2024-10-30 16:13:47.726563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.958 [2024-10-30 16:13:47.726587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.958 [2024-10-30 16:13:47.726602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.958 [2024-10-30 16:13:47.728836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.958 [2024-10-30 16:13:47.738346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.958 [2024-10-30 16:13:47.738699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.738844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.738871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.958 [2024-10-30 16:13:47.738888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.958 [2024-10-30 16:13:47.739036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.958 [2024-10-30 16:13:47.739294] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.958 [2024-10-30 16:13:47.739320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.958 [2024-10-30 16:13:47.739337] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.958 [2024-10-30 16:13:47.741715] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.958 [2024-10-30 16:13:47.750920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.958 [2024-10-30 16:13:47.751231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.751360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.751404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.958 [2024-10-30 16:13:47.751422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.958 [2024-10-30 16:13:47.751566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.958 [2024-10-30 16:13:47.751771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.958 [2024-10-30 16:13:47.751796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.958 [2024-10-30 16:13:47.751812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.958 [2024-10-30 16:13:47.754274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.958 [2024-10-30 16:13:47.763622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.958 [2024-10-30 16:13:47.763919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.764074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.764101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.958 [2024-10-30 16:13:47.764117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.958 [2024-10-30 16:13:47.764326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.958 [2024-10-30 16:13:47.764492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.958 [2024-10-30 16:13:47.764518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.958 [2024-10-30 16:13:47.764533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.958 [2024-10-30 16:13:47.766895] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.958 [2024-10-30 16:13:47.775987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.958 [2024-10-30 16:13:47.776285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.776419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.958 [2024-10-30 16:13:47.776449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.958 [2024-10-30 16:13:47.776467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.958 [2024-10-30 16:13:47.776615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.958 [2024-10-30 16:13:47.776784] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.958 [2024-10-30 16:13:47.776809] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.958 [2024-10-30 16:13:47.776825] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.958 [2024-10-30 16:13:47.779117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.959 [2024-10-30 16:13:47.788564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.959 [2024-10-30 16:13:47.788903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.959 [2024-10-30 16:13:47.789027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.959 [2024-10-30 16:13:47.789053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.959 [2024-10-30 16:13:47.789070] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.959 [2024-10-30 16:13:47.789213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.959 [2024-10-30 16:13:47.789411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.959 [2024-10-30 16:13:47.789438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.959 [2024-10-30 16:13:47.789455] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.959 [2024-10-30 16:13:47.791708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.959 [2024-10-30 16:13:47.801252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.959 [2024-10-30 16:13:47.801631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.959 [2024-10-30 16:13:47.801762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.959 [2024-10-30 16:13:47.801806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.959 [2024-10-30 16:13:47.801824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.959 [2024-10-30 16:13:47.802008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.959 [2024-10-30 16:13:47.802194] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.959 [2024-10-30 16:13:47.802217] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.959 [2024-10-30 16:13:47.802232] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.959 [2024-10-30 16:13:47.804586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.959 [2024-10-30 16:13:47.813841] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.959 [2024-10-30 16:13:47.814157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.959 [2024-10-30 16:13:47.814287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.959 [2024-10-30 16:13:47.814330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.959 [2024-10-30 16:13:47.814346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.959 [2024-10-30 16:13:47.814494] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.959 [2024-10-30 16:13:47.814709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.959 [2024-10-30 16:13:47.814734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.959 [2024-10-30 16:13:47.814750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.959 [2024-10-30 16:13:47.816948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.959 [2024-10-30 16:13:47.826564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.959 [2024-10-30 16:13:47.826911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.959 [2024-10-30 16:13:47.827027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.959 [2024-10-30 16:13:47.827053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:57.959 [2024-10-30 16:13:47.827070] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:57.959 [2024-10-30 16:13:47.827242] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:57.959 [2024-10-30 16:13:47.827443] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.959 [2024-10-30 16:13:47.827470] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.959 [2024-10-30 16:13:47.827486] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.959 [2024-10-30 16:13:47.829848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.218 [2024-10-30 16:13:47.839079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.218 [2024-10-30 16:13:47.839393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.218 [2024-10-30 16:13:47.839526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.218 [2024-10-30 16:13:47.839562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.218 [2024-10-30 16:13:47.839582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.218 [2024-10-30 16:13:47.839767] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.218 [2024-10-30 16:13:47.839918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.218 [2024-10-30 16:13:47.839943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.218 [2024-10-30 16:13:47.839958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.218 [2024-10-30 16:13:47.842435] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.218 [2024-10-30 16:13:47.851897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.218 [2024-10-30 16:13:47.852211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.218 [2024-10-30 16:13:47.852355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.218 [2024-10-30 16:13:47.852397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.218 [2024-10-30 16:13:47.852414] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.218 [2024-10-30 16:13:47.852594] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.218 [2024-10-30 16:13:47.852780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.218 [2024-10-30 16:13:47.852805] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.218 [2024-10-30 16:13:47.852821] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.218 [2024-10-30 16:13:47.855266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.218 [2024-10-30 16:13:47.864398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.218 [2024-10-30 16:13:47.864751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.218 [2024-10-30 16:13:47.864873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.218 [2024-10-30 16:13:47.864914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.219 [2024-10-30 16:13:47.864931] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.219 [2024-10-30 16:13:47.865093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.219 [2024-10-30 16:13:47.865293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.219 [2024-10-30 16:13:47.865319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.219 [2024-10-30 16:13:47.865335] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.219 [2024-10-30 16:13:47.867606] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.219 [2024-10-30 16:13:47.876811] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.219 [2024-10-30 16:13:47.877153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.877310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.877342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.219 [2024-10-30 16:13:47.877369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.219 [2024-10-30 16:13:47.877518] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.219 [2024-10-30 16:13:47.877705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.219 [2024-10-30 16:13:47.877730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.219 [2024-10-30 16:13:47.877746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.219 [2024-10-30 16:13:47.880233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.219 [2024-10-30 16:13:47.889423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.219 [2024-10-30 16:13:47.889773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.889924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.889949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.219 [2024-10-30 16:13:47.889965] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.219 [2024-10-30 16:13:47.890160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.219 [2024-10-30 16:13:47.890380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.219 [2024-10-30 16:13:47.890406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.219 [2024-10-30 16:13:47.890422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.219 [2024-10-30 16:13:47.892854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.219 [2024-10-30 16:13:47.901942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.219 [2024-10-30 16:13:47.902230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.902363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.902389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.219 [2024-10-30 16:13:47.902405] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.219 [2024-10-30 16:13:47.902567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.219 [2024-10-30 16:13:47.902772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.219 [2024-10-30 16:13:47.902797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.219 [2024-10-30 16:13:47.902813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.219 [2024-10-30 16:13:47.905199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.219 [2024-10-30 16:13:47.914461] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.219 [2024-10-30 16:13:47.914713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.914922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.914950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.219 [2024-10-30 16:13:47.914966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.219 [2024-10-30 16:13:47.915135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.219 [2024-10-30 16:13:47.915317] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.219 [2024-10-30 16:13:47.915343] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.219 [2024-10-30 16:13:47.915359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.219 [2024-10-30 16:13:47.917631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.219 [2024-10-30 16:13:47.927059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.219 [2024-10-30 16:13:47.927338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.927472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.927503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.219 [2024-10-30 16:13:47.927521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.219 [2024-10-30 16:13:47.927687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.219 [2024-10-30 16:13:47.927856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.219 [2024-10-30 16:13:47.927882] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.219 [2024-10-30 16:13:47.927898] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.219 [2024-10-30 16:13:47.930207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.219 [2024-10-30 16:13:47.939718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.219 [2024-10-30 16:13:47.940051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.940208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.940238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.219 [2024-10-30 16:13:47.940266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.219 [2024-10-30 16:13:47.940400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.219 [2024-10-30 16:13:47.940586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.219 [2024-10-30 16:13:47.940612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.219 [2024-10-30 16:13:47.940628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.219 [2024-10-30 16:13:47.943025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.219 [2024-10-30 16:13:47.952197] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.219 [2024-10-30 16:13:47.952504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.952640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.952670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.219 [2024-10-30 16:13:47.952689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.219 [2024-10-30 16:13:47.952854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.219 [2024-10-30 16:13:47.953049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.219 [2024-10-30 16:13:47.953075] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.219 [2024-10-30 16:13:47.953091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.219 [2024-10-30 16:13:47.955463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.219 [2024-10-30 16:13:47.964794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.219 [2024-10-30 16:13:47.965101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.965225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.965253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.219 [2024-10-30 16:13:47.965309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.219 [2024-10-30 16:13:47.965493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.219 [2024-10-30 16:13:47.965644] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.219 [2024-10-30 16:13:47.965669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.219 [2024-10-30 16:13:47.965685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.219 [2024-10-30 16:13:47.968099] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.219 [2024-10-30 16:13:47.977332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.219 [2024-10-30 16:13:47.977663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.977790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.219 [2024-10-30 16:13:47.977820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.219 [2024-10-30 16:13:47.977839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.219 [2024-10-30 16:13:47.978005] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.219 [2024-10-30 16:13:47.978211] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.219 [2024-10-30 16:13:47.978235] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.219 [2024-10-30 16:13:47.978251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.219 [2024-10-30 16:13:47.980468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.219 [2024-10-30 16:13:47.989942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.219 [2024-10-30 16:13:47.990222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:47.990371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:47.990397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.220 [2024-10-30 16:13:47.990413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.220 [2024-10-30 16:13:47.990515] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.220 [2024-10-30 16:13:47.990728] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.220 [2024-10-30 16:13:47.990759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.220 [2024-10-30 16:13:47.990777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.220 [2024-10-30 16:13:47.993142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.220 [2024-10-30 16:13:48.002865] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.220 [2024-10-30 16:13:48.003145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.003304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.003335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.220 [2024-10-30 16:13:48.003354] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.220 [2024-10-30 16:13:48.003574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.220 [2024-10-30 16:13:48.003709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.220 [2024-10-30 16:13:48.003734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.220 [2024-10-30 16:13:48.003750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.220 [2024-10-30 16:13:48.006152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.220 [2024-10-30 16:13:48.015527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.220 [2024-10-30 16:13:48.015858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.015959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.015987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.220 [2024-10-30 16:13:48.016005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.220 [2024-10-30 16:13:48.016171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.220 [2024-10-30 16:13:48.016337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.220 [2024-10-30 16:13:48.016363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.220 [2024-10-30 16:13:48.016379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.220 [2024-10-30 16:13:48.018710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.220 [2024-10-30 16:13:48.028190] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.220 [2024-10-30 16:13:48.028491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.028598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.028628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.220 [2024-10-30 16:13:48.028646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.220 [2024-10-30 16:13:48.028795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.220 [2024-10-30 16:13:48.028983] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.220 [2024-10-30 16:13:48.029007] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.220 [2024-10-30 16:13:48.029029] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.220 [2024-10-30 16:13:48.031371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.220 [2024-10-30 16:13:48.040644] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.220 [2024-10-30 16:13:48.040969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.041086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.041115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.220 [2024-10-30 16:13:48.041133] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.220 [2024-10-30 16:13:48.041309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.220 [2024-10-30 16:13:48.041480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.220 [2024-10-30 16:13:48.041504] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.220 [2024-10-30 16:13:48.041520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.220 [2024-10-30 16:13:48.044116] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.220 [2024-10-30 16:13:48.053144] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.220 [2024-10-30 16:13:48.053453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.053580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.053625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.220 [2024-10-30 16:13:48.053642] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.220 [2024-10-30 16:13:48.053773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.220 [2024-10-30 16:13:48.054004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.220 [2024-10-30 16:13:48.054029] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.220 [2024-10-30 16:13:48.054045] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.220 [2024-10-30 16:13:48.056248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.220 [2024-10-30 16:13:48.065628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.220 [2024-10-30 16:13:48.065963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.066086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.066113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.220 [2024-10-30 16:13:48.066131] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.220 [2024-10-30 16:13:48.066294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.220 [2024-10-30 16:13:48.066483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.220 [2024-10-30 16:13:48.066506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.220 [2024-10-30 16:13:48.066521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.220 [2024-10-30 16:13:48.068820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.220 [2024-10-30 16:13:48.078371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.220 [2024-10-30 16:13:48.078680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.078797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.078822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.220 [2024-10-30 16:13:48.078839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.220 [2024-10-30 16:13:48.079030] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.220 [2024-10-30 16:13:48.079184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.220 [2024-10-30 16:13:48.079210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.220 [2024-10-30 16:13:48.079225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.220 [2024-10-30 16:13:48.081708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.220 [2024-10-30 16:13:48.090787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.220 [2024-10-30 16:13:48.091113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.091272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.220 [2024-10-30 16:13:48.091309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.220 [2024-10-30 16:13:48.091343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.220 [2024-10-30 16:13:48.091491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.220 [2024-10-30 16:13:48.091654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.220 [2024-10-30 16:13:48.091680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.220 [2024-10-30 16:13:48.091696] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.220 [2024-10-30 16:13:48.093920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.480 [2024-10-30 16:13:48.103362] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.480 [2024-10-30 16:13:48.103699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.480 [2024-10-30 16:13:48.103830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.480 [2024-10-30 16:13:48.103861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.480 [2024-10-30 16:13:48.103880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.480 [2024-10-30 16:13:48.104064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.480 [2024-10-30 16:13:48.104233] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.480 [2024-10-30 16:13:48.104269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.480 [2024-10-30 16:13:48.104288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.480 [2024-10-30 16:13:48.106622] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.480 [2024-10-30 16:13:48.115920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.480 [2024-10-30 16:13:48.116252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.480 [2024-10-30 16:13:48.116375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.480 [2024-10-30 16:13:48.116399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.480 [2024-10-30 16:13:48.116415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.480 [2024-10-30 16:13:48.116606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.480 [2024-10-30 16:13:48.116794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.480 [2024-10-30 16:13:48.116819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.480 [2024-10-30 16:13:48.116835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.480 [2024-10-30 16:13:48.119236] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.480 [2024-10-30 16:13:48.128590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.480 [2024-10-30 16:13:48.128869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.480 [2024-10-30 16:13:48.129035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.480 [2024-10-30 16:13:48.129062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.480 [2024-10-30 16:13:48.129078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.480 [2024-10-30 16:13:48.129285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.480 [2024-10-30 16:13:48.129439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.480 [2024-10-30 16:13:48.129464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.480 [2024-10-30 16:13:48.129481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.480 [2024-10-30 16:13:48.131933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.480 [2024-10-30 16:13:48.141065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.480 [2024-10-30 16:13:48.141388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.480 [2024-10-30 16:13:48.141519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.480 [2024-10-30 16:13:48.141547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.480 [2024-10-30 16:13:48.141565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.480 [2024-10-30 16:13:48.141749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.480 [2024-10-30 16:13:48.141918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.480 [2024-10-30 16:13:48.141944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.480 [2024-10-30 16:13:48.141960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.480 [2024-10-30 16:13:48.144199] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.480 [2024-10-30 16:13:48.153305] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.480 [2024-10-30 16:13:48.153637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.480 [2024-10-30 16:13:48.153798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.480 [2024-10-30 16:13:48.153828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.480 [2024-10-30 16:13:48.153846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.480 [2024-10-30 16:13:48.154048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.480 [2024-10-30 16:13:48.154181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.480 [2024-10-30 16:13:48.154206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.480 [2024-10-30 16:13:48.154222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.480 [2024-10-30 16:13:48.156595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.480 [2024-10-30 16:13:48.165965] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.481 [2024-10-30 16:13:48.166232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.166371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.166401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.481 [2024-10-30 16:13:48.166420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.481 [2024-10-30 16:13:48.166639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.481 [2024-10-30 16:13:48.166792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.481 [2024-10-30 16:13:48.166818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.481 [2024-10-30 16:13:48.166833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.481 [2024-10-30 16:13:48.169333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.481 [2024-10-30 16:13:48.178539] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.481 [2024-10-30 16:13:48.178897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.179024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.179049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.481 [2024-10-30 16:13:48.179065] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.481 [2024-10-30 16:13:48.179213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.481 [2024-10-30 16:13:48.179395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.481 [2024-10-30 16:13:48.179420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.481 [2024-10-30 16:13:48.179436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.481 [2024-10-30 16:13:48.181727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.481 [2024-10-30 16:13:48.191006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.481 [2024-10-30 16:13:48.191279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.191454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.191490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.481 [2024-10-30 16:13:48.191509] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.481 [2024-10-30 16:13:48.191674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.481 [2024-10-30 16:13:48.191826] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.481 [2024-10-30 16:13:48.191849] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.481 [2024-10-30 16:13:48.191865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.481 [2024-10-30 16:13:48.194487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.481 [2024-10-30 16:13:48.203504] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.481 [2024-10-30 16:13:48.203863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.203948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.203973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.481 [2024-10-30 16:13:48.203988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.481 [2024-10-30 16:13:48.204212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.481 [2024-10-30 16:13:48.204385] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.481 [2024-10-30 16:13:48.204410] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.481 [2024-10-30 16:13:48.204426] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.481 [2024-10-30 16:13:48.206874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.481 [2024-10-30 16:13:48.216121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.481 [2024-10-30 16:13:48.216516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.216674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.216702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.481 [2024-10-30 16:13:48.216719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.481 [2024-10-30 16:13:48.216867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.481 [2024-10-30 16:13:48.217018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.481 [2024-10-30 16:13:48.217042] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.481 [2024-10-30 16:13:48.217056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.481 [2024-10-30 16:13:48.219301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.481 [2024-10-30 16:13:48.228780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.481 [2024-10-30 16:13:48.229130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.229293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.229322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.481 [2024-10-30 16:13:48.229345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.481 [2024-10-30 16:13:48.229475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.481 [2024-10-30 16:13:48.229607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.481 [2024-10-30 16:13:48.229630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.481 [2024-10-30 16:13:48.229645] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.481 [2024-10-30 16:13:48.231879] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.481 [2024-10-30 16:13:48.241293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.481 [2024-10-30 16:13:48.241672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.241805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.241833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.481 [2024-10-30 16:13:48.241850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.481 [2024-10-30 16:13:48.242034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.481 [2024-10-30 16:13:48.242221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.481 [2024-10-30 16:13:48.242246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.481 [2024-10-30 16:13:48.242276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.481 [2024-10-30 16:13:48.244803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.481 [2024-10-30 16:13:48.253897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.481 [2024-10-30 16:13:48.254163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.254301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.254333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.481 [2024-10-30 16:13:48.254351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.481 [2024-10-30 16:13:48.254519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.481 [2024-10-30 16:13:48.254706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.481 [2024-10-30 16:13:48.254730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.481 [2024-10-30 16:13:48.254746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.481 [2024-10-30 16:13:48.257141] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.481 [2024-10-30 16:13:48.266525] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.481 [2024-10-30 16:13:48.266791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.266919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.266946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.481 [2024-10-30 16:13:48.266965] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.481 [2024-10-30 16:13:48.267137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.481 [2024-10-30 16:13:48.267323] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.481 [2024-10-30 16:13:48.267350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.481 [2024-10-30 16:13:48.267366] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.481 [2024-10-30 16:13:48.269943] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.481 [2024-10-30 16:13:48.279099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.481 [2024-10-30 16:13:48.279405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.279536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.481 [2024-10-30 16:13:48.279566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.481 [2024-10-30 16:13:48.279584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.481 [2024-10-30 16:13:48.279715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.481 [2024-10-30 16:13:48.279884] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.481 [2024-10-30 16:13:48.279909] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.481 [2024-10-30 16:13:48.279925] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.482 [2024-10-30 16:13:48.282352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.482 [2024-10-30 16:13:48.291721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.482 [2024-10-30 16:13:48.292054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.482 [2024-10-30 16:13:48.292197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.482 [2024-10-30 16:13:48.292225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.482 [2024-10-30 16:13:48.292241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.482 [2024-10-30 16:13:48.292384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.482 [2024-10-30 16:13:48.292573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.482 [2024-10-30 16:13:48.292598] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.482 [2024-10-30 16:13:48.292614] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.482 [2024-10-30 16:13:48.295063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.482 [2024-10-30 16:13:48.304297] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.482 [2024-10-30 16:13:48.304607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.482 [2024-10-30 16:13:48.304736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.482 [2024-10-30 16:13:48.304765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.482 [2024-10-30 16:13:48.304783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.482 [2024-10-30 16:13:48.304950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.482 [2024-10-30 16:13:48.305125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.482 [2024-10-30 16:13:48.305151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.482 [2024-10-30 16:13:48.305166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.482 [2024-10-30 16:13:48.307487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.482 [2024-10-30 16:13:48.316915] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.482 [2024-10-30 16:13:48.317193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.482 [2024-10-30 16:13:48.317353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.482 [2024-10-30 16:13:48.317384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.482 [2024-10-30 16:13:48.317402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.482 [2024-10-30 16:13:48.317569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.482 [2024-10-30 16:13:48.317719] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.482 [2024-10-30 16:13:48.317745] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.482 [2024-10-30 16:13:48.317761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.482 [2024-10-30 16:13:48.320045] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.482 [2024-10-30 16:13:48.329566] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.482 [2024-10-30 16:13:48.329914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.482 [2024-10-30 16:13:48.330067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.482 [2024-10-30 16:13:48.330093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.482 [2024-10-30 16:13:48.330110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.482 [2024-10-30 16:13:48.330286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.482 [2024-10-30 16:13:48.330424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.482 [2024-10-30 16:13:48.330445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.482 [2024-10-30 16:13:48.330460] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.482 [2024-10-30 16:13:48.332978] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.482 [2024-10-30 16:13:48.342187] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.482 [2024-10-30 16:13:48.342502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.482 [2024-10-30 16:13:48.342672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.482 [2024-10-30 16:13:48.342720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.482 [2024-10-30 16:13:48.342738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.482 [2024-10-30 16:13:48.342921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.482 [2024-10-30 16:13:48.343072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.482 [2024-10-30 16:13:48.343096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.482 [2024-10-30 16:13:48.343118] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.482 [2024-10-30 16:13:48.345443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.482 [2024-10-30 16:13:48.354901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.482 [2024-10-30 16:13:48.355227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.482 [2024-10-30 16:13:48.355359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.482 [2024-10-30 16:13:48.355385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.482 [2024-10-30 16:13:48.355401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.482 [2024-10-30 16:13:48.355566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.482 [2024-10-30 16:13:48.355720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.482 [2024-10-30 16:13:48.355742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.482 [2024-10-30 16:13:48.355756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.746 [2024-10-30 16:13:48.358080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.367280] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.367590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.367744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.367773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.367791] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.367902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.368071] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.368095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.368111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.370558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.379916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.380228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.380410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.380437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.380454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.380585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.380773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.380797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.380819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.383296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.392415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.392743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.392868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.392912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.392928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.393073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.393327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.393352] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.393368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.395566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.404913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.405247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.405423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.405450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.405467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.405680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.405886] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.405910] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.405925] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.408129] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.417450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.417756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.417885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.417914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.417932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.418098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.418250] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.418287] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.418304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.420630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.430094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.430364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.430565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.430591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.430607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.430823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.430939] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.430962] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.430978] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.433346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.442754] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.443101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.443248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.443286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.443319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.443431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.443582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.443606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.443621] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.446020] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.455180] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.455503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.455595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.455623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.455642] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.455807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.455959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.455984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.455999] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.458005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.467845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.468159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.468315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.468346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.468365] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.468496] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.468648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.468671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.468686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.471045] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.480457] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.480781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.480910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.480939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.480957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.481123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.481285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.481310] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.481325] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.483699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.492945] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.493318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.493433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.493459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.493475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.493639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.493824] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.493844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.493857] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.496333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.505686] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.505938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.506149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.506176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.506193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.506407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.506616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.506640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.506656] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.509042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.518363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.518656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.518856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.518882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.518898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.519077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.519229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.519253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.519279] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.521514] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.530875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.531154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.531279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.531309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.531327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.531493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.531681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.531705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.531721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.534006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.543401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.543669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.543809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.543837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.543861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.544009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.544179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.544203] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.544218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.546670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.556228] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.556474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.556610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.556653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.556670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.556816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.557009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.557033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.557048] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.559360] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.569045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.569317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.569420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.569446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.569462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.569667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.569836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.569860] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.569876] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.572253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.581495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.581872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.582008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.582034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.582067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.582238] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.582375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.582398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.582412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.584944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.594124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.594410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.594495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.594521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.594537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.594729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.594899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.594923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.594939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.597015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.606688] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.607033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.607185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.607214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.607232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.607443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.607584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.747 [2024-10-30 16:13:48.607609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.747 [2024-10-30 16:13:48.607624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.747 [2024-10-30 16:13:48.609941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.747 [2024-10-30 16:13:48.619343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.747 [2024-10-30 16:13:48.619678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.619867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.747 [2024-10-30 16:13:48.619908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:58.747 [2024-10-30 16:13:48.619925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:58.747 [2024-10-30 16:13:48.620102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:58.747 [2024-10-30 16:13:48.620270] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.748 [2024-10-30 16:13:48.620295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.748 [2024-10-30 16:13:48.620326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.748 [2024-10-30 16:13:48.622809] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.007 [2024-10-30 16:13:48.632109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.007 [2024-10-30 16:13:48.632443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.632538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.632563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.007 [2024-10-30 16:13:48.632578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.007 [2024-10-30 16:13:48.632725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.007 [2024-10-30 16:13:48.632917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.007 [2024-10-30 16:13:48.632952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.007 [2024-10-30 16:13:48.632965] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.007 [2024-10-30 16:13:48.634863] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.007 [2024-10-30 16:13:48.644734] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.007 [2024-10-30 16:13:48.645026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.645161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.645185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.007 [2024-10-30 16:13:48.645201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.007 [2024-10-30 16:13:48.645392] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.007 [2024-10-30 16:13:48.645598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.007 [2024-10-30 16:13:48.645622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.007 [2024-10-30 16:13:48.645638] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.007 [2024-10-30 16:13:48.648051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.007 [2024-10-30 16:13:48.657555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.007 [2024-10-30 16:13:48.657790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.657980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.658027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.007 [2024-10-30 16:13:48.658044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.007 [2024-10-30 16:13:48.658184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.007 [2024-10-30 16:13:48.658370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.007 [2024-10-30 16:13:48.658401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.007 [2024-10-30 16:13:48.658418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.007 [2024-10-30 16:13:48.660669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.007 [2024-10-30 16:13:48.670227] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.007 [2024-10-30 16:13:48.670574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.670695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.670725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.007 [2024-10-30 16:13:48.670743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.007 [2024-10-30 16:13:48.670891] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.007 [2024-10-30 16:13:48.671097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.007 [2024-10-30 16:13:48.671122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.007 [2024-10-30 16:13:48.671137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.007 [2024-10-30 16:13:48.673492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.007 [2024-10-30 16:13:48.682761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.007 [2024-10-30 16:13:48.683095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.683214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.683241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.007 [2024-10-30 16:13:48.683265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.007 [2024-10-30 16:13:48.683449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.007 [2024-10-30 16:13:48.683602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.007 [2024-10-30 16:13:48.683626] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.007 [2024-10-30 16:13:48.683641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.007 [2024-10-30 16:13:48.685819] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.007 [2024-10-30 16:13:48.695512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.007 [2024-10-30 16:13:48.695930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.696047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.696074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.007 [2024-10-30 16:13:48.696090] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.007 [2024-10-30 16:13:48.696307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.007 [2024-10-30 16:13:48.696493] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.007 [2024-10-30 16:13:48.696517] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.007 [2024-10-30 16:13:48.696538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.007 [2024-10-30 16:13:48.698862] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.007 [2024-10-30 16:13:48.708113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.007 [2024-10-30 16:13:48.708435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.708567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.708594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.007 [2024-10-30 16:13:48.708611] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.007 [2024-10-30 16:13:48.708741] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.007 [2024-10-30 16:13:48.708944] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.007 [2024-10-30 16:13:48.708968] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.007 [2024-10-30 16:13:48.708983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.007 [2024-10-30 16:13:48.711408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.007 [2024-10-30 16:13:48.720644] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.007 [2024-10-30 16:13:48.721006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.721155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.721181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.007 [2024-10-30 16:13:48.721197] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.007 [2024-10-30 16:13:48.721370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.007 [2024-10-30 16:13:48.721583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.007 [2024-10-30 16:13:48.721608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.007 [2024-10-30 16:13:48.721623] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.007 [2024-10-30 16:13:48.723996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.007 [2024-10-30 16:13:48.733284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.007 [2024-10-30 16:13:48.733552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.733682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.733710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.007 [2024-10-30 16:13:48.733727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.007 [2024-10-30 16:13:48.733857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.007 [2024-10-30 16:13:48.734045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.007 [2024-10-30 16:13:48.734069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.007 [2024-10-30 16:13:48.734085] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.007 [2024-10-30 16:13:48.736356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.007 [2024-10-30 16:13:48.745945] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.007 [2024-10-30 16:13:48.746271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.746424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.746465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.007 [2024-10-30 16:13:48.746482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.007 [2024-10-30 16:13:48.746610] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.007 [2024-10-30 16:13:48.746812] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.007 [2024-10-30 16:13:48.746837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.007 [2024-10-30 16:13:48.746853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.007 [2024-10-30 16:13:48.749139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.007 [2024-10-30 16:13:48.758494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.007 [2024-10-30 16:13:48.758843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.759021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.759050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.007 [2024-10-30 16:13:48.759068] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.007 [2024-10-30 16:13:48.759216] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.007 [2024-10-30 16:13:48.759413] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.007 [2024-10-30 16:13:48.759438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.007 [2024-10-30 16:13:48.759453] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.007 [2024-10-30 16:13:48.761668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.007 [2024-10-30 16:13:48.771007] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.007 [2024-10-30 16:13:48.771278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.771421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.771447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.007 [2024-10-30 16:13:48.771463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.007 [2024-10-30 16:13:48.771592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.007 [2024-10-30 16:13:48.771727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.007 [2024-10-30 16:13:48.771752] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.007 [2024-10-30 16:13:48.771767] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.007 [2024-10-30 16:13:48.774018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.007 [2024-10-30 16:13:48.783713] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.007 [2024-10-30 16:13:48.784045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.784196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.784223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.007 [2024-10-30 16:13:48.784240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.007 [2024-10-30 16:13:48.784390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.007 [2024-10-30 16:13:48.784597] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.007 [2024-10-30 16:13:48.784622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.007 [2024-10-30 16:13:48.784638] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.007 [2024-10-30 16:13:48.787032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.007 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 2545123 Killed "${NVMF_APP[@]}" "$@" 00:29:59.007 16:13:48 -- host/bdevperf.sh@36 -- # tgt_init 00:29:59.007 16:13:48 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:59.007 16:13:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:59.007 16:13:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:59.007 16:13:48 -- common/autotest_common.sh@10 -- # set +x 00:29:59.007 16:13:48 -- nvmf/common.sh@469 -- # nvmfpid=2546237 00:29:59.007 16:13:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:59.007 16:13:48 -- nvmf/common.sh@470 -- # waitforlisten 2546237 00:29:59.007 16:13:48 -- common/autotest_common.sh@819 -- # '[' -z 2546237 ']' 00:29:59.007 16:13:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:59.007 16:13:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:59.007 16:13:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:59.007 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:59.007 16:13:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:59.007 16:13:48 -- common/autotest_common.sh@10 -- # set +x 00:29:59.007 [2024-10-30 16:13:48.796334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.007 [2024-10-30 16:13:48.796677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.007 [2024-10-30 16:13:48.796771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.796797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.008 [2024-10-30 16:13:48.796813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.008 [2024-10-30 16:13:48.797011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.008 [2024-10-30 16:13:48.797163] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.008 [2024-10-30 16:13:48.797188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.008 [2024-10-30 16:13:48.797204] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.008 [2024-10-30 16:13:48.799699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.008 [2024-10-30 16:13:48.808782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.008 [2024-10-30 16:13:48.809075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.809169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.809194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.008 [2024-10-30 16:13:48.809210] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.008 [2024-10-30 16:13:48.809368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.008 [2024-10-30 16:13:48.809531] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.008 [2024-10-30 16:13:48.809555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.008 [2024-10-30 16:13:48.809570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.008 [2024-10-30 16:13:48.811886] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.008 [2024-10-30 16:13:48.821095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.008 [2024-10-30 16:13:48.821372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.821485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.821511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.008 [2024-10-30 16:13:48.821527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.008 [2024-10-30 16:13:48.821723] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.008 [2024-10-30 16:13:48.821839] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.008 [2024-10-30 16:13:48.821860] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.008 [2024-10-30 16:13:48.821873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.008 [2024-10-30 16:13:48.823959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.008 [2024-10-30 16:13:48.833321] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.008 [2024-10-30 16:13:48.833651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.833775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.833801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.008 [2024-10-30 16:13:48.833818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.008 [2024-10-30 16:13:48.833968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.008 [2024-10-30 16:13:48.834193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.008 [2024-10-30 16:13:48.834214] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.008 [2024-10-30 16:13:48.834229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.008 [2024-10-30 16:13:48.836536] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.008 [2024-10-30 16:13:48.838558] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:29:59.008 [2024-10-30 16:13:48.838621] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:59.008 [2024-10-30 16:13:48.845478] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.008 [2024-10-30 16:13:48.845847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.845994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.846018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.008 [2024-10-30 16:13:48.846034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.008 [2024-10-30 16:13:48.846198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.008 [2024-10-30 16:13:48.846388] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.008 [2024-10-30 16:13:48.846409] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.008 [2024-10-30 16:13:48.846422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.008 [2024-10-30 16:13:48.848506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.008 [2024-10-30 16:13:48.857672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.008 [2024-10-30 16:13:48.857905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.858093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.858119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.008 [2024-10-30 16:13:48.858135] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.008 [2024-10-30 16:13:48.858279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.008 [2024-10-30 16:13:48.858462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.008 [2024-10-30 16:13:48.858482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.008 [2024-10-30 16:13:48.858495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.008 [2024-10-30 16:13:48.860389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.008 [2024-10-30 16:13:48.869809] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.008 [2024-10-30 16:13:48.870062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.870193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.870220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.008 [2024-10-30 16:13:48.870236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.008 [2024-10-30 16:13:48.870393] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.008 [2024-10-30 16:13:48.870582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.008 [2024-10-30 16:13:48.870601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.008 [2024-10-30 16:13:48.870614] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.008 [2024-10-30 16:13:48.872373] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.008 EAL: No free 2048 kB hugepages reported on node 1 00:29:59.008 [2024-10-30 16:13:48.882373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.008 [2024-10-30 16:13:48.882642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.882738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.008 [2024-10-30 16:13:48.882764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.008 [2024-10-30 16:13:48.882780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.008 [2024-10-30 16:13:48.882880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.008 [2024-10-30 16:13:48.883049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.008 [2024-10-30 16:13:48.883087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.008 [2024-10-30 16:13:48.883103] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.268 [2024-10-30 16:13:48.885597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.268 [2024-10-30 16:13:48.895021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.268 [2024-10-30 16:13:48.895410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.268 [2024-10-30 16:13:48.895525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.268 [2024-10-30 16:13:48.895549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.268 [2024-10-30 16:13:48.895565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.268 [2024-10-30 16:13:48.895745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.268 [2024-10-30 16:13:48.895987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.268 [2024-10-30 16:13:48.896011] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.268 [2024-10-30 16:13:48.896026] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.268 [2024-10-30 16:13:48.898485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.268 [2024-10-30 16:13:48.907544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.268 [2024-10-30 16:13:48.907839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.268 [2024-10-30 16:13:48.907987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.268 [2024-10-30 16:13:48.908012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.268 [2024-10-30 16:13:48.908028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.268 [2024-10-30 16:13:48.908184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.268 [2024-10-30 16:13:48.908384] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.269 [2024-10-30 16:13:48.908404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.269 [2024-10-30 16:13:48.908417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.269 [2024-10-30 16:13:48.909489] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:59.269 [2024-10-30 16:13:48.910598] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.269 [2024-10-30 16:13:48.920135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.269 [2024-10-30 16:13:48.920637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:48.920773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:48.920802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.269 [2024-10-30 16:13:48.920824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.269 [2024-10-30 16:13:48.921020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.269 [2024-10-30 16:13:48.921176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.269 [2024-10-30 16:13:48.921201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.269 [2024-10-30 16:13:48.921222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.269 [2024-10-30 16:13:48.923494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.269 [2024-10-30 16:13:48.932915] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.269 [2024-10-30 16:13:48.933250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:48.933395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:48.933421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.269 [2024-10-30 16:13:48.933439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.269 [2024-10-30 16:13:48.933608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.269 [2024-10-30 16:13:48.933814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.269 [2024-10-30 16:13:48.933838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.269 [2024-10-30 16:13:48.933855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.269 [2024-10-30 16:13:48.936051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.269 [2024-10-30 16:13:48.945328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.269 [2024-10-30 16:13:48.945652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:48.945758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:48.945788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.269 [2024-10-30 16:13:48.945806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.269 [2024-10-30 16:13:48.945972] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.269 [2024-10-30 16:13:48.946125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.269 [2024-10-30 16:13:48.946150] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.269 [2024-10-30 16:13:48.946166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.269 [2024-10-30 16:13:48.948612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.269 [2024-10-30 16:13:48.957535] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.269 [2024-10-30 16:13:48.957883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:48.958037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:48.958089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.269 [2024-10-30 16:13:48.958110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.269 [2024-10-30 16:13:48.958324] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.269 [2024-10-30 16:13:48.958490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.269 [2024-10-30 16:13:48.958512] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.269 [2024-10-30 16:13:48.958528] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.269 [2024-10-30 16:13:48.960830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.269 [2024-10-30 16:13:48.970051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.269 [2024-10-30 16:13:48.970596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:48.970745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:48.970772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.269 [2024-10-30 16:13:48.970793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.269 [2024-10-30 16:13:48.971013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.269 [2024-10-30 16:13:48.971223] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.269 [2024-10-30 16:13:48.971248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.269 [2024-10-30 16:13:48.971277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.269 [2024-10-30 16:13:48.973507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.269 [2024-10-30 16:13:48.982783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.269 [2024-10-30 16:13:48.983105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:48.983234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:48.983269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.269 [2024-10-30 16:13:48.983288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.269 [2024-10-30 16:13:48.983421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.269 [2024-10-30 16:13:48.983572] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.269 [2024-10-30 16:13:48.983610] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.269 [2024-10-30 16:13:48.983627] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.269 [2024-10-30 16:13:48.985915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.269 [2024-10-30 16:13:48.995515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.269 [2024-10-30 16:13:48.995908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:48.996053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:48.996097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.269 [2024-10-30 16:13:48.996125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.269 [2024-10-30 16:13:48.996302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.269 [2024-10-30 16:13:48.996465] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.269 [2024-10-30 16:13:48.996486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.269 [2024-10-30 16:13:48.996500] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.269 [2024-10-30 16:13:48.998768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.269 [2024-10-30 16:13:48.999664] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:59.269 [2024-10-30 16:13:48.999784] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:59.269 [2024-10-30 16:13:48.999801] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:59.269 [2024-10-30 16:13:48.999814] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:59.269 [2024-10-30 16:13:48.999864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:59.269 [2024-10-30 16:13:48.999924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:59.269 [2024-10-30 16:13:48.999927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:59.269 [2024-10-30 16:13:49.007639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.269 [2024-10-30 16:13:49.008078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:49.008219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:49.008246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.269 [2024-10-30 16:13:49.008275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.269 [2024-10-30 16:13:49.008433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.269 [2024-10-30 16:13:49.008586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.269 [2024-10-30 16:13:49.008623] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.269 [2024-10-30 16:13:49.008640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.269 [2024-10-30 16:13:49.010592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.269 [2024-10-30 16:13:49.020081] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.269 [2024-10-30 16:13:49.020549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:49.020667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.269 [2024-10-30 16:13:49.020694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.269 [2024-10-30 16:13:49.020714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.269 [2024-10-30 16:13:49.020891] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.269 [2024-10-30 16:13:49.021076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.270 [2024-10-30 16:13:49.021097] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.270 [2024-10-30 16:13:49.021115] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.270 [2024-10-30 16:13:49.023033] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.270 [2024-10-30 16:13:49.032385] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.270 [2024-10-30 16:13:49.032919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.033047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.033073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.270 [2024-10-30 16:13:49.033093] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.270 [2024-10-30 16:13:49.033294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.270 [2024-10-30 16:13:49.033469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.270 [2024-10-30 16:13:49.033491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.270 [2024-10-30 16:13:49.033509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.270 [2024-10-30 16:13:49.035589] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.270 [2024-10-30 16:13:49.044670] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.270 [2024-10-30 16:13:49.045132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.045239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.045280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.270 [2024-10-30 16:13:49.045302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.270 [2024-10-30 16:13:49.045460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.270 [2024-10-30 16:13:49.045615] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.270 [2024-10-30 16:13:49.045637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.270 [2024-10-30 16:13:49.045654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.270 [2024-10-30 16:13:49.047825] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.270 [2024-10-30 16:13:49.056995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.270 [2024-10-30 16:13:49.057410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.057544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.057575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.270 [2024-10-30 16:13:49.057593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.270 [2024-10-30 16:13:49.057796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.270 [2024-10-30 16:13:49.057974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.270 [2024-10-30 16:13:49.057995] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.270 [2024-10-30 16:13:49.058011] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.270 [2024-10-30 16:13:49.060143] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.270 [2024-10-30 16:13:49.069415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.270 [2024-10-30 16:13:49.069905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.070026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.070053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.270 [2024-10-30 16:13:49.070074] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.270 [2024-10-30 16:13:49.070233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.270 [2024-10-30 16:13:49.070417] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.270 [2024-10-30 16:13:49.070441] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.270 [2024-10-30 16:13:49.070458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.270 [2024-10-30 16:13:49.072766] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.270 [2024-10-30 16:13:49.081765] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.270 [2024-10-30 16:13:49.082052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.082175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.082202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.270 [2024-10-30 16:13:49.082219] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.270 [2024-10-30 16:13:49.082382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.270 [2024-10-30 16:13:49.082566] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.270 [2024-10-30 16:13:49.082588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.270 [2024-10-30 16:13:49.082602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.270 [2024-10-30 16:13:49.084480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.270 [2024-10-30 16:13:49.093999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.270 [2024-10-30 16:13:49.094319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.094436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.094463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.270 [2024-10-30 16:13:49.094480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.270 [2024-10-30 16:13:49.094645] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.270 [2024-10-30 16:13:49.094838] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.270 [2024-10-30 16:13:49.094860] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.270 [2024-10-30 16:13:49.094873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.270 [2024-10-30 16:13:49.097080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.270 [2024-10-30 16:13:49.106205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.270 [2024-10-30 16:13:49.106545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.106687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.106713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.270 [2024-10-30 16:13:49.106730] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.270 [2024-10-30 16:13:49.106896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.270 [2024-10-30 16:13:49.107074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.270 [2024-10-30 16:13:49.107095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.270 [2024-10-30 16:13:49.107108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.270 [2024-10-30 16:13:49.109187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.270 [2024-10-30 16:13:49.118508] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.270 [2024-10-30 16:13:49.118766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.118842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.118867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.270 [2024-10-30 16:13:49.118883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.270 [2024-10-30 16:13:49.119011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.270 [2024-10-30 16:13:49.119127] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.270 [2024-10-30 16:13:49.119163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.270 [2024-10-30 16:13:49.119178] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.270 [2024-10-30 16:13:49.121249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.270 [2024-10-30 16:13:49.130692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.270 [2024-10-30 16:13:49.131034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.131154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.131180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.270 [2024-10-30 16:13:49.131197] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.270 [2024-10-30 16:13:49.131370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.270 [2024-10-30 16:13:49.131552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.270 [2024-10-30 16:13:49.131573] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.270 [2024-10-30 16:13:49.131587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.270 [2024-10-30 16:13:49.133676] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.270 [2024-10-30 16:13:49.143090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.270 [2024-10-30 16:13:49.143376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.143500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.270 [2024-10-30 16:13:49.143531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.270 [2024-10-30 16:13:49.143548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.270 [2024-10-30 16:13:49.143697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.271 [2024-10-30 16:13:49.143866] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.271 [2024-10-30 16:13:49.143888] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.271 [2024-10-30 16:13:49.143903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.529 [2024-10-30 16:13:49.146151] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.529 [2024-10-30 16:13:49.155618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.529 [2024-10-30 16:13:49.155954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.529 [2024-10-30 16:13:49.156079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.529 [2024-10-30 16:13:49.156106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.529 [2024-10-30 16:13:49.156123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.529 [2024-10-30 16:13:49.156265] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.529 [2024-10-30 16:13:49.156454] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.529 [2024-10-30 16:13:49.156476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.529 [2024-10-30 16:13:49.156490] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.529 [2024-10-30 16:13:49.158628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.529 [2024-10-30 16:13:49.167921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.529 [2024-10-30 16:13:49.168251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.529 [2024-10-30 16:13:49.168402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.529 [2024-10-30 16:13:49.168429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.529 [2024-10-30 16:13:49.168446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.529 [2024-10-30 16:13:49.168578] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.529 [2024-10-30 16:13:49.168726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.529 [2024-10-30 16:13:49.168747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.529 [2024-10-30 16:13:49.168760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.529 [2024-10-30 16:13:49.170845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.529 [2024-10-30 16:13:49.180285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.529 [2024-10-30 16:13:49.180558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.529 [2024-10-30 16:13:49.180672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.529 [2024-10-30 16:13:49.180698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.529 [2024-10-30 16:13:49.180720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.529 [2024-10-30 16:13:49.180870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.529 [2024-10-30 16:13:49.181063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.529 [2024-10-30 16:13:49.181084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.529 [2024-10-30 16:13:49.181098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.529 [2024-10-30 16:13:49.183080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.529 [2024-10-30 16:13:49.192709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.529 [2024-10-30 16:13:49.193073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.529 [2024-10-30 16:13:49.193186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.529 [2024-10-30 16:13:49.193213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.529 [2024-10-30 16:13:49.193229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.529 [2024-10-30 16:13:49.193403] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.529 [2024-10-30 16:13:49.193587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.529 [2024-10-30 16:13:49.193608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.529 [2024-10-30 16:13:49.193622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.529 [2024-10-30 16:13:49.195567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.529 [2024-10-30 16:13:49.205009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.529 [2024-10-30 16:13:49.205288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.529 [2024-10-30 16:13:49.205410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.529 [2024-10-30 16:13:49.205438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.529 [2024-10-30 16:13:49.205454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.529 [2024-10-30 16:13:49.205587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.529 [2024-10-30 16:13:49.205781] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.529 [2024-10-30 16:13:49.205802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.530 [2024-10-30 16:13:49.205815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.530 [2024-10-30 16:13:49.207839] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.530 [2024-10-30 16:13:49.217270] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.530 [2024-10-30 16:13:49.217546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.217666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.217692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.530 [2024-10-30 16:13:49.217709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.530 [2024-10-30 16:13:49.217832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.530 [2024-10-30 16:13:49.218029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.530 [2024-10-30 16:13:49.218050] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.530 [2024-10-30 16:13:49.218062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.530 [2024-10-30 16:13:49.220065] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.530 [2024-10-30 16:13:49.229612] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.530 [2024-10-30 16:13:49.229865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.229986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.230012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.530 [2024-10-30 16:13:49.230029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.530 [2024-10-30 16:13:49.230179] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.530 [2024-10-30 16:13:49.230353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.530 [2024-10-30 16:13:49.230375] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.530 [2024-10-30 16:13:49.230389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.530 [2024-10-30 16:13:49.232485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.530 [2024-10-30 16:13:49.242007] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.530 [2024-10-30 16:13:49.242251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.242378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.242404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.530 [2024-10-30 16:13:49.242421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.530 [2024-10-30 16:13:49.242618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.530 [2024-10-30 16:13:49.242795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.530 [2024-10-30 16:13:49.242818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.530 [2024-10-30 16:13:49.242831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.530 [2024-10-30 16:13:49.244901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.530 [2024-10-30 16:13:49.254199] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.530 [2024-10-30 16:13:49.254504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.254625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.254652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.530 [2024-10-30 16:13:49.254668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.530 [2024-10-30 16:13:49.254818] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.530 [2024-10-30 16:13:49.254970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.530 [2024-10-30 16:13:49.254993] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.530 [2024-10-30 16:13:49.255007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.530 [2024-10-30 16:13:49.257135] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.530 [2024-10-30 16:13:49.266361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.530 [2024-10-30 16:13:49.266622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.266767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.266795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.530 [2024-10-30 16:13:49.266811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.530 [2024-10-30 16:13:49.266978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.530 [2024-10-30 16:13:49.267200] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.530 [2024-10-30 16:13:49.267223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.530 [2024-10-30 16:13:49.267237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.530 [2024-10-30 16:13:49.269232] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.530 [2024-10-30 16:13:49.278638] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.530 [2024-10-30 16:13:49.278882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.279031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.279059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.530 [2024-10-30 16:13:49.279075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.530 [2024-10-30 16:13:49.279210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.530 [2024-10-30 16:13:49.279396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.530 [2024-10-30 16:13:49.279418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.530 [2024-10-30 16:13:49.279432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.530 [2024-10-30 16:13:49.281527] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.530 [2024-10-30 16:13:49.291082] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.530 [2024-10-30 16:13:49.291399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.291545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.291572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.530 [2024-10-30 16:13:49.291589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.530 [2024-10-30 16:13:49.291706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.530 [2024-10-30 16:13:49.291873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.530 [2024-10-30 16:13:49.291909] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.530 [2024-10-30 16:13:49.291928] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.530 [2024-10-30 16:13:49.294025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.530 [2024-10-30 16:13:49.303350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.530 [2024-10-30 16:13:49.303653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.303782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.303810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.530 [2024-10-30 16:13:49.303827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.530 [2024-10-30 16:13:49.303961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.530 [2024-10-30 16:13:49.304155] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.530 [2024-10-30 16:13:49.304177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.530 [2024-10-30 16:13:49.304190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.530 [2024-10-30 16:13:49.306420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.530 [2024-10-30 16:13:49.315620] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.530 [2024-10-30 16:13:49.315877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.315990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.316015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.530 [2024-10-30 16:13:49.316031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.530 [2024-10-30 16:13:49.316180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.530 [2024-10-30 16:13:49.316388] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.530 [2024-10-30 16:13:49.316413] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.530 [2024-10-30 16:13:49.316427] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.530 [2024-10-30 16:13:49.318442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.530 [2024-10-30 16:13:49.328038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.530 [2024-10-30 16:13:49.328326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.328448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.530 [2024-10-30 16:13:49.328476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.530 [2024-10-30 16:13:49.328492] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.530 [2024-10-30 16:13:49.328643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.530 [2024-10-30 16:13:49.328848] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.531 [2024-10-30 16:13:49.328870] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.531 [2024-10-30 16:13:49.328884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.531 [2024-10-30 16:13:49.331004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.531 [2024-10-30 16:13:49.340373] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.531 [2024-10-30 16:13:49.340716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.531 [2024-10-30 16:13:49.340816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.531 [2024-10-30 16:13:49.340842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.531 [2024-10-30 16:13:49.340860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.531 [2024-10-30 16:13:49.340994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.531 [2024-10-30 16:13:49.341131] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.531 [2024-10-30 16:13:49.341162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.531 [2024-10-30 16:13:49.341177] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.531 [2024-10-30 16:13:49.343176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.531 [2024-10-30 16:13:49.352673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.531 [2024-10-30 16:13:49.352978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.531 [2024-10-30 16:13:49.353094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.531 [2024-10-30 16:13:49.353120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.531 [2024-10-30 16:13:49.353136] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.531 [2024-10-30 16:13:49.353280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.531 [2024-10-30 16:13:49.353400] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.531 [2024-10-30 16:13:49.353420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.531 [2024-10-30 16:13:49.353433] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.531 [2024-10-30 16:13:49.355401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.531 [2024-10-30 16:13:49.365000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.531 [2024-10-30 16:13:49.365279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.531 [2024-10-30 16:13:49.365427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.531 [2024-10-30 16:13:49.365454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.531 [2024-10-30 16:13:49.365471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.531 [2024-10-30 16:13:49.365604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.531 [2024-10-30 16:13:49.365833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.531 [2024-10-30 16:13:49.365855] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.531 [2024-10-30 16:13:49.365869] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.531 [2024-10-30 16:13:49.368018] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.531 [2024-10-30 16:13:49.377396] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.531 [2024-10-30 16:13:49.377766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.531 [2024-10-30 16:13:49.377843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.531 [2024-10-30 16:13:49.377869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.531 [2024-10-30 16:13:49.377885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.531 [2024-10-30 16:13:49.378050] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.531 [2024-10-30 16:13:49.378285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.531 [2024-10-30 16:13:49.378309] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.531 [2024-10-30 16:13:49.378323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.531 [2024-10-30 16:13:49.380382] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.531 [2024-10-30 16:13:49.389773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.531 [2024-10-30 16:13:49.390077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.531 [2024-10-30 16:13:49.390191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.531 [2024-10-30 16:13:49.390216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.531 [2024-10-30 16:13:49.390233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.531 [2024-10-30 16:13:49.390406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.531 [2024-10-30 16:13:49.390603] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.531 [2024-10-30 16:13:49.390626] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.531 [2024-10-30 16:13:49.390641] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.531 [2024-10-30 16:13:49.392717] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.531 [2024-10-30 16:13:49.401976] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.531 [2024-10-30 16:13:49.402328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.531 [2024-10-30 16:13:49.402416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.531 [2024-10-30 16:13:49.402441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.531 [2024-10-30 16:13:49.402457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.531 [2024-10-30 16:13:49.402575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.531 [2024-10-30 16:13:49.402787] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.531 [2024-10-30 16:13:49.402809] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.531 [2024-10-30 16:13:49.402823] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.531 [2024-10-30 16:13:49.404980] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.790 [2024-10-30 16:13:49.414530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.790 [2024-10-30 16:13:49.414805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.414920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.414947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.790 [2024-10-30 16:13:49.414964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.790 [2024-10-30 16:13:49.415129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.790 [2024-10-30 16:13:49.415346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.790 [2024-10-30 16:13:49.415370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.790 [2024-10-30 16:13:49.415385] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.790 [2024-10-30 16:13:49.417487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.790 [2024-10-30 16:13:49.426842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.790 [2024-10-30 16:13:49.427139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.427252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.427284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.790 [2024-10-30 16:13:49.427300] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.790 [2024-10-30 16:13:49.427465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.790 [2024-10-30 16:13:49.427627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.790 [2024-10-30 16:13:49.427649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.790 [2024-10-30 16:13:49.427663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.790 [2024-10-30 16:13:49.429746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.790 [2024-10-30 16:13:49.439279] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.790 [2024-10-30 16:13:49.439543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.439634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.439659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.790 [2024-10-30 16:13:49.439675] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.790 [2024-10-30 16:13:49.439842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.790 [2024-10-30 16:13:49.439991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.790 [2024-10-30 16:13:49.440014] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.790 [2024-10-30 16:13:49.440029] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.790 [2024-10-30 16:13:49.442102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.790 [2024-10-30 16:13:49.451334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.790 [2024-10-30 16:13:49.451593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.451740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.451768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.790 [2024-10-30 16:13:49.451785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.790 [2024-10-30 16:13:49.451951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.790 [2024-10-30 16:13:49.452145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.790 [2024-10-30 16:13:49.452168] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.790 [2024-10-30 16:13:49.452181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.790 [2024-10-30 16:13:49.454261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.790 [2024-10-30 16:13:49.463541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.790 [2024-10-30 16:13:49.463886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.464009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.464036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.790 [2024-10-30 16:13:49.464053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.790 [2024-10-30 16:13:49.464219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.790 [2024-10-30 16:13:49.464377] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.790 [2024-10-30 16:13:49.464400] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.790 [2024-10-30 16:13:49.464415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.790 [2024-10-30 16:13:49.466495] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.790 [2024-10-30 16:13:49.475858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.790 [2024-10-30 16:13:49.476173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.476323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.476351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.790 [2024-10-30 16:13:49.476368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.790 [2024-10-30 16:13:49.476519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.790 [2024-10-30 16:13:49.476669] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.790 [2024-10-30 16:13:49.476691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.790 [2024-10-30 16:13:49.476705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.790 [2024-10-30 16:13:49.478857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.790 [2024-10-30 16:13:49.488074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.790 [2024-10-30 16:13:49.488400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.488481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.488506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.790 [2024-10-30 16:13:49.488526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.790 [2024-10-30 16:13:49.488693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.790 [2024-10-30 16:13:49.488855] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.790 [2024-10-30 16:13:49.488876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.790 [2024-10-30 16:13:49.488890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.790 [2024-10-30 16:13:49.491025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.790 [2024-10-30 16:13:49.500329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.790 [2024-10-30 16:13:49.500604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.500718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.790 [2024-10-30 16:13:49.500743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.790 [2024-10-30 16:13:49.500760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.790 [2024-10-30 16:13:49.500925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.790 [2024-10-30 16:13:49.501104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.790 [2024-10-30 16:13:49.501126] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.790 [2024-10-30 16:13:49.501140] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.790 [2024-10-30 16:13:49.503276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.790 [2024-10-30 16:13:49.512709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.791 [2024-10-30 16:13:49.513059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.513206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.513233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.791 [2024-10-30 16:13:49.513250] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.791 [2024-10-30 16:13:49.513342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.791 [2024-10-30 16:13:49.513478] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.791 [2024-10-30 16:13:49.513499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.791 [2024-10-30 16:13:49.513513] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.791 [2024-10-30 16:13:49.515538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.791 [2024-10-30 16:13:49.525063] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.791 [2024-10-30 16:13:49.525318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.525442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.525469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.791 [2024-10-30 16:13:49.525485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.791 [2024-10-30 16:13:49.525625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.791 [2024-10-30 16:13:49.525775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.791 [2024-10-30 16:13:49.525813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.791 [2024-10-30 16:13:49.525827] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.791 [2024-10-30 16:13:49.528010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.791 [2024-10-30 16:13:49.537365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.791 [2024-10-30 16:13:49.537671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.537816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.537843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.791 [2024-10-30 16:13:49.537860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.791 [2024-10-30 16:13:49.538010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.791 [2024-10-30 16:13:49.538175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.791 [2024-10-30 16:13:49.538197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.791 [2024-10-30 16:13:49.538211] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.791 [2024-10-30 16:13:49.540326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.791 [2024-10-30 16:13:49.549796] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.791 [2024-10-30 16:13:49.550005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.550139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.550164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.791 [2024-10-30 16:13:49.550181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.791 [2024-10-30 16:13:49.550322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.791 [2024-10-30 16:13:49.550476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.791 [2024-10-30 16:13:49.550498] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.791 [2024-10-30 16:13:49.550511] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.791 [2024-10-30 16:13:49.552810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.791 [2024-10-30 16:13:49.562038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.791 [2024-10-30 16:13:49.562355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.562470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.562497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.791 [2024-10-30 16:13:49.562513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.791 [2024-10-30 16:13:49.562679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.791 [2024-10-30 16:13:49.562894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.791 [2024-10-30 16:13:49.562915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.791 [2024-10-30 16:13:49.562928] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.791 [2024-10-30 16:13:49.565080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.791 [2024-10-30 16:13:49.574320] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.791 [2024-10-30 16:13:49.574531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.574646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.574672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.791 [2024-10-30 16:13:49.574688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.791 [2024-10-30 16:13:49.574870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.791 [2024-10-30 16:13:49.575033] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.791 [2024-10-30 16:13:49.575054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.791 [2024-10-30 16:13:49.575067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.791 [2024-10-30 16:13:49.577288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.791 [2024-10-30 16:13:49.586701] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.791 [2024-10-30 16:13:49.587023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.587163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.587189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.791 [2024-10-30 16:13:49.587205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.791 [2024-10-30 16:13:49.587346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.791 [2024-10-30 16:13:49.587565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.791 [2024-10-30 16:13:49.587587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.791 [2024-10-30 16:13:49.587615] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.791 [2024-10-30 16:13:49.589788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.791 [2024-10-30 16:13:49.599009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.791 [2024-10-30 16:13:49.599285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.599369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.599394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.791 [2024-10-30 16:13:49.599410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.791 [2024-10-30 16:13:49.599591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.791 [2024-10-30 16:13:49.599793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.791 [2024-10-30 16:13:49.599823] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.791 [2024-10-30 16:13:49.599838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.791 [2024-10-30 16:13:49.601880] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.791 [2024-10-30 16:13:49.611266] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.791 [2024-10-30 16:13:49.611543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.611662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.611689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.791 [2024-10-30 16:13:49.611706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.791 [2024-10-30 16:13:49.611871] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.791 [2024-10-30 16:13:49.612009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.791 [2024-10-30 16:13:49.612044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.791 [2024-10-30 16:13:49.612059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.791 [2024-10-30 16:13:49.614143] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.791 [2024-10-30 16:13:49.623435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.791 [2024-10-30 16:13:49.623716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.623839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.791 [2024-10-30 16:13:49.623864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.791 [2024-10-30 16:13:49.623880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.791 [2024-10-30 16:13:49.624013] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.791 [2024-10-30 16:13:49.624197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.791 [2024-10-30 16:13:49.624219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.791 [2024-10-30 16:13:49.624233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.791 [2024-10-30 16:13:49.626409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.792 [2024-10-30 16:13:49.636023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.792 [2024-10-30 16:13:49.636347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.792 [2024-10-30 16:13:49.636461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.792 [2024-10-30 16:13:49.636488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.792 [2024-10-30 16:13:49.636505] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.792 [2024-10-30 16:13:49.636670] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.792 [2024-10-30 16:13:49.636820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.792 [2024-10-30 16:13:49.636842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.792 [2024-10-30 16:13:49.636860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.792 [2024-10-30 16:13:49.638927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.792 [2024-10-30 16:13:49.648355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.792 [2024-10-30 16:13:49.648693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.792 [2024-10-30 16:13:49.648780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.792 [2024-10-30 16:13:49.648805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.792 [2024-10-30 16:13:49.648820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.792 [2024-10-30 16:13:49.648986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.792 [2024-10-30 16:13:49.649152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.792 [2024-10-30 16:13:49.649173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.792 [2024-10-30 16:13:49.649187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.792 [2024-10-30 16:13:49.651312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.792 [2024-10-30 16:13:49.660478] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.792 [2024-10-30 16:13:49.660786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.792 [2024-10-30 16:13:49.660873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.792 [2024-10-30 16:13:49.660898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:29:59.792 [2024-10-30 16:13:49.660915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:29:59.792 [2024-10-30 16:13:49.661031] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:29:59.792 [2024-10-30 16:13:49.661198] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.792 [2024-10-30 16:13:49.661234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.792 [2024-10-30 16:13:49.661248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.792 [2024-10-30 16:13:49.663314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.053 [2024-10-30 16:13:49.672680] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.053 [2024-10-30 16:13:49.672990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.053 [2024-10-30 16:13:49.673110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.053 [2024-10-30 16:13:49.673136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.053 [2024-10-30 16:13:49.673153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.053 [2024-10-30 16:13:49.673359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.053 [2024-10-30 16:13:49.673497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.053 [2024-10-30 16:13:49.673519] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.053 [2024-10-30 16:13:49.673532] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.053 [2024-10-30 16:13:49.675788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.053 [2024-10-30 16:13:49.685212] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.053 [2024-10-30 16:13:49.685511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.053 [2024-10-30 16:13:49.685631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.053 [2024-10-30 16:13:49.685657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.053 [2024-10-30 16:13:49.685673] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.053 [2024-10-30 16:13:49.685806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.053 [2024-10-30 16:13:49.685989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.053 [2024-10-30 16:13:49.686010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.053 [2024-10-30 16:13:49.686022] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.053 [2024-10-30 16:13:49.687945] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.053 [2024-10-30 16:13:49.697495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.053 [2024-10-30 16:13:49.697815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.053 [2024-10-30 16:13:49.697956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.053 [2024-10-30 16:13:49.697982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.053 [2024-10-30 16:13:49.697999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.053 [2024-10-30 16:13:49.698148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.053 [2024-10-30 16:13:49.698321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.053 [2024-10-30 16:13:49.698344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.053 [2024-10-30 16:13:49.698359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.053 [2024-10-30 16:13:49.700357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.053 [2024-10-30 16:13:49.709839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.053 [2024-10-30 16:13:49.710106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.053 [2024-10-30 16:13:49.710184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.053 [2024-10-30 16:13:49.710210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.053 [2024-10-30 16:13:49.710227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.053 [2024-10-30 16:13:49.710401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.053 [2024-10-30 16:13:49.710615] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.053 [2024-10-30 16:13:49.710636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.053 [2024-10-30 16:13:49.710649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.053 [2024-10-30 16:13:49.712905] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.053 [2024-10-30 16:13:49.722069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.053 [2024-10-30 16:13:49.722397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.053 [2024-10-30 16:13:49.722489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.053 [2024-10-30 16:13:49.722515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.053 [2024-10-30 16:13:49.722531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.053 [2024-10-30 16:13:49.722697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.053 [2024-10-30 16:13:49.722860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.053 [2024-10-30 16:13:49.722881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.053 [2024-10-30 16:13:49.722895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.053 [2024-10-30 16:13:49.724703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.053 [2024-10-30 16:13:49.734526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.053 [2024-10-30 16:13:49.734799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.053 [2024-10-30 16:13:49.734910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.053 [2024-10-30 16:13:49.734936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.053 [2024-10-30 16:13:49.734952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.053 [2024-10-30 16:13:49.735103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.053 [2024-10-30 16:13:49.735284] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.053 [2024-10-30 16:13:49.735307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.053 [2024-10-30 16:13:49.735321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.053 [2024-10-30 16:13:49.737143] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.053 [2024-10-30 16:13:49.746992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.053 [2024-10-30 16:13:49.747283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.053 [2024-10-30 16:13:49.747374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.053 [2024-10-30 16:13:49.747400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.053 [2024-10-30 16:13:49.747418] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.053 [2024-10-30 16:13:49.747566] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.053 [2024-10-30 16:13:49.747748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.053 [2024-10-30 16:13:49.747770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.053 [2024-10-30 16:13:49.747798] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.054 [2024-10-30 16:13:49.749860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.054 [2024-10-30 16:13:49.759548] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.054 [2024-10-30 16:13:49.759869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.760019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.760046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.054 [2024-10-30 16:13:49.760062] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.054 [2024-10-30 16:13:49.760163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.054 [2024-10-30 16:13:49.760292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.054 [2024-10-30 16:13:49.760315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.054 [2024-10-30 16:13:49.760330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.054 [2024-10-30 16:13:49.762320] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.054 [2024-10-30 16:13:49.771786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.054 [2024-10-30 16:13:49.772035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.772167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.772194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.054 [2024-10-30 16:13:49.772211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.054 [2024-10-30 16:13:49.772386] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.054 [2024-10-30 16:13:49.772570] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.054 [2024-10-30 16:13:49.772607] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.054 [2024-10-30 16:13:49.772620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.054 [2024-10-30 16:13:49.774614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.054 [2024-10-30 16:13:49.784147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.054 [2024-10-30 16:13:49.784444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.784566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.784592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.054 [2024-10-30 16:13:49.784608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.054 [2024-10-30 16:13:49.784740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.054 [2024-10-30 16:13:49.784922] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.054 [2024-10-30 16:13:49.784943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.054 [2024-10-30 16:13:49.784956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.054 [2024-10-30 16:13:49.787164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.054 [2024-10-30 16:13:49.796391] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.054 [2024-10-30 16:13:49.796611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.796698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.796729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.054 [2024-10-30 16:13:49.796747] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.054 [2024-10-30 16:13:49.796895] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.054 [2024-10-30 16:13:49.797090] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.054 [2024-10-30 16:13:49.797111] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.054 [2024-10-30 16:13:49.797124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.054 [2024-10-30 16:13:49.799313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.054 [2024-10-30 16:13:49.808572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.054 [2024-10-30 16:13:49.808848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.808993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.809018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.054 [2024-10-30 16:13:49.809035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.054 [2024-10-30 16:13:49.809201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.054 [2024-10-30 16:13:49.809409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.054 [2024-10-30 16:13:49.809432] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.054 [2024-10-30 16:13:49.809445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.054 [2024-10-30 16:13:49.811506] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.054 [2024-10-30 16:13:49.820890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.054 [2024-10-30 16:13:49.821204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.821316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.821343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.054 [2024-10-30 16:13:49.821360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.054 [2024-10-30 16:13:49.821509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.054 [2024-10-30 16:13:49.821641] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.054 [2024-10-30 16:13:49.821662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.054 [2024-10-30 16:13:49.821675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.054 [2024-10-30 16:13:49.823743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.054 [2024-10-30 16:13:49.833477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.054 [2024-10-30 16:13:49.833797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.833920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.833947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.054 [2024-10-30 16:13:49.833969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.054 [2024-10-30 16:13:49.834071] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.054 [2024-10-30 16:13:49.834237] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.054 [2024-10-30 16:13:49.834283] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.054 [2024-10-30 16:13:49.834301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.054 [2024-10-30 16:13:49.836468] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.054 16:13:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:00.054 16:13:49 -- common/autotest_common.sh@852 -- # return 0 00:30:00.054 16:13:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:00.054 16:13:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:00.054 16:13:49 -- common/autotest_common.sh@10 -- # set +x 00:30:00.054 [2024-10-30 16:13:49.845974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.054 [2024-10-30 16:13:49.846275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.846398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.846425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.054 [2024-10-30 16:13:49.846442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.054 [2024-10-30 16:13:49.846624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.054 [2024-10-30 16:13:49.846786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.054 [2024-10-30 16:13:49.846807] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.054 [2024-10-30 16:13:49.846820] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.054 [2024-10-30 16:13:49.848935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.054 [2024-10-30 16:13:49.858250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.054 [2024-10-30 16:13:49.858514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.858635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.858662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.054 [2024-10-30 16:13:49.858678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.054 [2024-10-30 16:13:49.858860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.054 [2024-10-30 16:13:49.858998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.054 [2024-10-30 16:13:49.859020] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.054 [2024-10-30 16:13:49.859034] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.054 [2024-10-30 16:13:49.861048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.054 16:13:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:00.054 16:13:49 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:00.054 16:13:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:00.054 16:13:49 -- common/autotest_common.sh@10 -- # set +x 00:30:00.054 [2024-10-30 16:13:49.870516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.054 [2024-10-30 16:13:49.870828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.054 [2024-10-30 16:13:49.870938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.055 [2024-10-30 16:13:49.870965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.055 [2024-10-30 16:13:49.870982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.055 [2024-10-30 16:13:49.871132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.055 [2024-10-30 16:13:49.871353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.055 [2024-10-30 16:13:49.871377] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.055 [2024-10-30 16:13:49.871390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.055 [2024-10-30 16:13:49.873656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.055 [2024-10-30 16:13:49.875414] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:00.055 16:13:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:00.055 16:13:49 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:00.055 16:13:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:00.055 16:13:49 -- common/autotest_common.sh@10 -- # set +x 00:30:00.055 [2024-10-30 16:13:49.882799] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.055 [2024-10-30 16:13:49.883147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.055 [2024-10-30 16:13:49.883269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.055 [2024-10-30 16:13:49.883306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.055 [2024-10-30 16:13:49.883323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.055 [2024-10-30 16:13:49.883490] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.055 [2024-10-30 16:13:49.883702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.055 [2024-10-30 16:13:49.883723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.055 [2024-10-30 16:13:49.883736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.055 [2024-10-30 16:13:49.886136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.055 [2024-10-30 16:13:49.895103] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.055 [2024-10-30 16:13:49.895439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.055 [2024-10-30 16:13:49.895539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.055 [2024-10-30 16:13:49.895564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.055 [2024-10-30 16:13:49.895581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.055 [2024-10-30 16:13:49.895697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.055 [2024-10-30 16:13:49.895861] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.055 [2024-10-30 16:13:49.895882] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.055 [2024-10-30 16:13:49.895895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.055 [2024-10-30 16:13:49.897987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.055 [2024-10-30 16:13:49.907543] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.055 [2024-10-30 16:13:49.907991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.055 [2024-10-30 16:13:49.908132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.055 [2024-10-30 16:13:49.908159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.055 [2024-10-30 16:13:49.908180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.055 [2024-10-30 16:13:49.908430] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.055 [2024-10-30 16:13:49.908619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.055 [2024-10-30 16:13:49.908643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.055 [2024-10-30 16:13:49.908664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.055 [2024-10-30 16:13:49.910657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.055 Malloc0 00:30:00.055 16:13:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:00.055 16:13:49 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:00.055 16:13:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:00.055 16:13:49 -- common/autotest_common.sh@10 -- # set +x 00:30:00.055 [2024-10-30 16:13:49.920093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.055 [2024-10-30 16:13:49.920418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.055 [2024-10-30 16:13:49.920518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.055 [2024-10-30 16:13:49.920545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.055 [2024-10-30 16:13:49.920562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.055 [2024-10-30 16:13:49.920762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.055 [2024-10-30 16:13:49.920893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.055 [2024-10-30 16:13:49.920915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.055 [2024-10-30 16:13:49.920930] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.055 [2024-10-30 16:13:49.923079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.055 16:13:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:00.055 16:13:49 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:00.055 16:13:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:00.055 16:13:49 -- common/autotest_common.sh@10 -- # set +x 00:30:00.313 16:13:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:00.313 16:13:49 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:00.313 16:13:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:00.313 16:13:49 -- common/autotest_common.sh@10 -- # set +x 00:30:00.313 [2024-10-30 16:13:49.932472] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.313 [2024-10-30 16:13:49.932797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-10-30 16:13:49.932920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-10-30 16:13:49.932945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc8b870 with addr=10.0.0.2, port=4420 00:30:00.313 [2024-10-30 16:13:49.932969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc8b870 is same with the state(5) to be set 00:30:00.313 [2024-10-30 16:13:49.933071] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc8b870 (9): Bad file descriptor 00:30:00.313 [2024-10-30 16:13:49.933237] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.313 [2024-10-30 16:13:49.933281] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.313 [2024-10-30 16:13:49.933299] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.313 [2024-10-30 16:13:49.935476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.313 [2024-10-30 16:13:49.935649] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:00.313 16:13:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:00.313 16:13:49 -- host/bdevperf.sh@38 -- # wait 2545432 00:30:00.313 [2024-10-30 16:13:49.944788] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.313 [2024-10-30 16:13:49.971138] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:10.277 00:30:10.277 Latency(us) 00:30:10.277 [2024-10-30T15:14:00.153Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:10.277 [2024-10-30T15:14:00.153Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:10.277 Verification LBA range: start 0x0 length 0x4000 00:30:10.277 Nvme1n1 : 15.01 9175.24 35.84 16544.90 0.00 4962.27 770.65 20680.25 00:30:10.277 [2024-10-30T15:14:00.153Z] =================================================================================================================== 00:30:10.277 [2024-10-30T15:14:00.153Z] Total : 9175.24 35.84 16544.90 0.00 4962.27 770.65 20680.25 00:30:10.277 16:13:58 -- host/bdevperf.sh@39 -- # sync 00:30:10.277 16:13:58 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:10.277 16:13:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:10.277 16:13:58 -- common/autotest_common.sh@10 -- # set +x 00:30:10.277 16:13:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:10.277 16:13:58 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:10.277 16:13:58 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:10.277 16:13:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:10.277 16:13:58 -- nvmf/common.sh@116 -- # sync 00:30:10.277 16:13:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:10.277 16:13:58 -- nvmf/common.sh@119 -- # set +e 00:30:10.277 16:13:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:10.277 16:13:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:10.277 rmmod nvme_tcp 00:30:10.277 rmmod nvme_fabrics 00:30:10.277 rmmod nvme_keyring 00:30:10.277 16:13:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:10.277 16:13:58 -- nvmf/common.sh@123 -- # set -e 00:30:10.277 16:13:58 -- nvmf/common.sh@124 -- # return 0 00:30:10.277 16:13:58 -- nvmf/common.sh@477 -- # '[' -n 2546237 ']' 00:30:10.277 16:13:58 -- nvmf/common.sh@478 -- # killprocess 2546237 00:30:10.277 16:13:58 -- common/autotest_common.sh@926 -- # '[' -z 2546237 ']' 00:30:10.277 16:13:58 -- common/autotest_common.sh@930 -- # kill -0 2546237 00:30:10.277 16:13:58 -- common/autotest_common.sh@931 -- # uname 00:30:10.277 16:13:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:10.277 16:13:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2546237 00:30:10.277 16:13:58 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:30:10.277 16:13:58 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:30:10.277 16:13:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2546237' 00:30:10.277 killing process with pid 2546237 00:30:10.277 16:13:58 -- common/autotest_common.sh@945 -- # kill 2546237 00:30:10.277 16:13:58 -- common/autotest_common.sh@950 -- # wait 2546237 00:30:10.277 16:13:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:10.277 16:13:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:10.277 16:13:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:10.277 16:13:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:10.277 16:13:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:10.277 16:13:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:10.277 16:13:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:10.277 16:13:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:11.211 16:14:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:11.211 00:30:11.211 real 0m23.050s 00:30:11.211 user 1m2.478s 00:30:11.211 sys 0m4.242s 00:30:11.211 16:14:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:11.211 16:14:00 -- common/autotest_common.sh@10 -- # set +x 00:30:11.211 ************************************ 00:30:11.211 END TEST nvmf_bdevperf 00:30:11.211 ************************************ 00:30:11.211 16:14:00 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:11.211 16:14:00 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:30:11.211 16:14:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:11.211 16:14:00 -- common/autotest_common.sh@10 -- # set +x 00:30:11.211 ************************************ 00:30:11.211 START TEST nvmf_target_disconnect 00:30:11.211 ************************************ 00:30:11.211 16:14:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:11.211 * Looking for test storage... 00:30:11.211 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:11.211 16:14:00 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:11.211 16:14:00 -- nvmf/common.sh@7 -- # uname -s 00:30:11.211 16:14:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:11.211 16:14:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:11.211 16:14:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:11.211 16:14:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:11.211 16:14:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:11.211 16:14:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:11.211 16:14:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:11.211 16:14:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:11.211 16:14:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:11.211 16:14:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:11.211 16:14:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:11.211 16:14:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:11.211 16:14:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:11.211 16:14:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:11.211 16:14:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:11.212 16:14:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:11.212 16:14:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:11.212 16:14:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:11.212 16:14:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:11.212 16:14:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:11.212 16:14:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:11.212 16:14:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:11.212 16:14:01 -- paths/export.sh@5 -- # export PATH 00:30:11.212 16:14:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:11.212 16:14:01 -- nvmf/common.sh@46 -- # : 0 00:30:11.212 16:14:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:11.212 16:14:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:11.212 16:14:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:11.212 16:14:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:11.212 16:14:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:11.212 16:14:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:11.212 16:14:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:11.212 16:14:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:11.212 16:14:01 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:11.212 16:14:01 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:11.212 16:14:01 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:11.212 16:14:01 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:11.212 16:14:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:11.212 16:14:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:11.212 16:14:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:11.212 16:14:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:11.212 16:14:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:11.212 16:14:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:11.212 16:14:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:11.212 16:14:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:11.212 16:14:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:11.212 16:14:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:11.212 16:14:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:11.212 16:14:01 -- common/autotest_common.sh@10 -- # set +x 00:30:13.739 16:14:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:13.739 16:14:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:13.739 16:14:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:13.739 16:14:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:13.739 16:14:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:13.739 16:14:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:13.739 16:14:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:13.739 16:14:02 -- nvmf/common.sh@294 -- # net_devs=() 00:30:13.739 16:14:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:13.739 16:14:02 -- nvmf/common.sh@295 -- # e810=() 00:30:13.739 16:14:03 -- nvmf/common.sh@295 -- # local -ga e810 00:30:13.739 16:14:03 -- nvmf/common.sh@296 -- # x722=() 00:30:13.739 16:14:03 -- nvmf/common.sh@296 -- # local -ga x722 00:30:13.739 16:14:03 -- nvmf/common.sh@297 -- # mlx=() 00:30:13.739 16:14:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:13.739 16:14:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:13.739 16:14:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:13.739 16:14:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:13.739 16:14:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:13.739 16:14:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:13.739 16:14:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:13.739 16:14:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:13.739 16:14:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:13.739 16:14:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:13.739 16:14:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:13.739 16:14:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:13.739 16:14:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:13.739 16:14:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:13.739 16:14:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:13.739 16:14:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:13.739 16:14:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:13.739 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:13.739 16:14:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:13.739 16:14:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:13.739 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:13.739 16:14:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:13.739 16:14:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:13.739 16:14:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:13.739 16:14:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:13.739 16:14:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:13.739 16:14:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:13.739 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:13.739 16:14:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:13.739 16:14:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:13.739 16:14:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:13.739 16:14:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:13.739 16:14:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:13.739 16:14:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:13.739 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:13.739 16:14:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:13.739 16:14:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:13.739 16:14:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:13.739 16:14:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:13.739 16:14:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:13.739 16:14:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:13.739 16:14:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:13.739 16:14:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:13.739 16:14:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:13.739 16:14:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:13.739 16:14:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:13.739 16:14:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:13.739 16:14:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:13.739 16:14:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:13.739 16:14:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:13.739 16:14:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:13.739 16:14:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:13.739 16:14:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:13.739 16:14:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:13.739 16:14:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:13.739 16:14:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:13.739 16:14:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:13.739 16:14:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:13.739 16:14:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:13.739 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:13.739 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:30:13.739 00:30:13.739 --- 10.0.0.2 ping statistics --- 00:30:13.739 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:13.739 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:30:13.739 16:14:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:13.739 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:13.739 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:30:13.739 00:30:13.739 --- 10.0.0.1 ping statistics --- 00:30:13.739 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:13.739 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:30:13.739 16:14:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:13.739 16:14:03 -- nvmf/common.sh@410 -- # return 0 00:30:13.739 16:14:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:13.739 16:14:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:13.739 16:14:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:13.739 16:14:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:13.739 16:14:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:13.739 16:14:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:13.739 16:14:03 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:13.739 16:14:03 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:13.739 16:14:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:13.739 16:14:03 -- common/autotest_common.sh@10 -- # set +x 00:30:13.739 ************************************ 00:30:13.739 START TEST nvmf_target_disconnect_tc1 00:30:13.739 ************************************ 00:30:13.739 16:14:03 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc1 00:30:13.739 16:14:03 -- host/target_disconnect.sh@32 -- # set +e 00:30:13.739 16:14:03 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:13.739 EAL: No free 2048 kB hugepages reported on node 1 00:30:13.739 [2024-10-30 16:14:03.241653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.739 [2024-10-30 16:14:03.241902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.739 [2024-10-30 16:14:03.241934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1146df0 with addr=10.0.0.2, port=4420 00:30:13.739 [2024-10-30 16:14:03.241974] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:13.739 [2024-10-30 16:14:03.242005] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:13.739 [2024-10-30 16:14:03.242021] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:13.739 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:13.739 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:13.739 Initializing NVMe Controllers 00:30:13.739 16:14:03 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:13.739 16:14:03 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:13.739 16:14:03 -- common/autotest_common.sh@1132 -- # [[ hxBET =~ e ]] 00:30:13.739 16:14:03 -- common/autotest_common.sh@1132 -- # return 0 00:30:13.739 16:14:03 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:13.739 16:14:03 -- host/target_disconnect.sh@41 -- # set -e 00:30:13.739 00:30:13.739 real 0m0.096s 00:30:13.739 user 0m0.032s 00:30:13.739 sys 0m0.064s 00:30:13.739 16:14:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:13.739 16:14:03 -- common/autotest_common.sh@10 -- # set +x 00:30:13.739 ************************************ 00:30:13.739 END TEST nvmf_target_disconnect_tc1 00:30:13.739 ************************************ 00:30:13.739 16:14:03 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:13.739 16:14:03 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:30:13.739 16:14:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:13.739 16:14:03 -- common/autotest_common.sh@10 -- # set +x 00:30:13.739 ************************************ 00:30:13.739 START TEST nvmf_target_disconnect_tc2 00:30:13.739 ************************************ 00:30:13.739 16:14:03 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc2 00:30:13.739 16:14:03 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:13.739 16:14:03 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:13.739 16:14:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:13.739 16:14:03 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:13.739 16:14:03 -- common/autotest_common.sh@10 -- # set +x 00:30:13.739 16:14:03 -- nvmf/common.sh@469 -- # nvmfpid=2549319 00:30:13.739 16:14:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:13.740 16:14:03 -- nvmf/common.sh@470 -- # waitforlisten 2549319 00:30:13.740 16:14:03 -- common/autotest_common.sh@819 -- # '[' -z 2549319 ']' 00:30:13.740 16:14:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:13.740 16:14:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:13.740 16:14:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:13.740 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:13.740 16:14:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:13.740 16:14:03 -- common/autotest_common.sh@10 -- # set +x 00:30:13.740 [2024-10-30 16:14:03.333794] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:30:13.740 [2024-10-30 16:14:03.333871] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:13.740 EAL: No free 2048 kB hugepages reported on node 1 00:30:13.740 [2024-10-30 16:14:03.402089] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:13.740 [2024-10-30 16:14:03.492452] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:13.740 [2024-10-30 16:14:03.492596] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:13.740 [2024-10-30 16:14:03.492613] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:13.740 [2024-10-30 16:14:03.492625] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:13.740 [2024-10-30 16:14:03.492711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:13.740 [2024-10-30 16:14:03.492745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:13.740 [2024-10-30 16:14:03.492803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:13.740 [2024-10-30 16:14:03.492805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:14.673 16:14:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:14.673 16:14:04 -- common/autotest_common.sh@852 -- # return 0 00:30:14.673 16:14:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:14.673 16:14:04 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:14.673 16:14:04 -- common/autotest_common.sh@10 -- # set +x 00:30:14.673 16:14:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:14.673 16:14:04 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:14.673 16:14:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:14.673 16:14:04 -- common/autotest_common.sh@10 -- # set +x 00:30:14.673 Malloc0 00:30:14.673 16:14:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:14.673 16:14:04 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:14.673 16:14:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:14.673 16:14:04 -- common/autotest_common.sh@10 -- # set +x 00:30:14.673 [2024-10-30 16:14:04.373983] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:14.673 16:14:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:14.673 16:14:04 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:14.673 16:14:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:14.673 16:14:04 -- common/autotest_common.sh@10 -- # set +x 00:30:14.673 16:14:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:14.673 16:14:04 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:14.673 16:14:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:14.673 16:14:04 -- common/autotest_common.sh@10 -- # set +x 00:30:14.673 16:14:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:14.673 16:14:04 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:14.673 16:14:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:14.673 16:14:04 -- common/autotest_common.sh@10 -- # set +x 00:30:14.673 [2024-10-30 16:14:04.402226] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:14.673 16:14:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:14.673 16:14:04 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:14.673 16:14:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:14.673 16:14:04 -- common/autotest_common.sh@10 -- # set +x 00:30:14.673 16:14:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:14.673 16:14:04 -- host/target_disconnect.sh@50 -- # reconnectpid=2549473 00:30:14.673 16:14:04 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:14.673 16:14:04 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:14.673 EAL: No free 2048 kB hugepages reported on node 1 00:30:16.575 16:14:06 -- host/target_disconnect.sh@53 -- # kill -9 2549319 00:30:16.575 16:14:06 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 [2024-10-30 16:14:06.426086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Write completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.575 Read completed with error (sct=0, sc=8) 00:30:16.575 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 [2024-10-30 16:14:06.426406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 [2024-10-30 16:14:06.426725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Write completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 Read completed with error (sct=0, sc=8) 00:30:16.576 starting I/O failed 00:30:16.576 [2024-10-30 16:14:06.427021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:16.576 [2024-10-30 16:14:06.427223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.427367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.427398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.576 qpair failed and we were unable to recover it. 00:30:16.576 [2024-10-30 16:14:06.427503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.427602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.427629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.576 qpair failed and we were unable to recover it. 00:30:16.576 [2024-10-30 16:14:06.427748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.427861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.427904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.576 qpair failed and we were unable to recover it. 00:30:16.576 [2024-10-30 16:14:06.428043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.428157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.428183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.576 qpair failed and we were unable to recover it. 00:30:16.576 [2024-10-30 16:14:06.428274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.428373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.428402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.576 qpair failed and we were unable to recover it. 00:30:16.576 [2024-10-30 16:14:06.428490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.428622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.428650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.576 qpair failed and we were unable to recover it. 00:30:16.576 [2024-10-30 16:14:06.428761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.428881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.428910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.576 qpair failed and we were unable to recover it. 00:30:16.576 [2024-10-30 16:14:06.428998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.429140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.429171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.576 qpair failed and we were unable to recover it. 00:30:16.576 [2024-10-30 16:14:06.429298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.429382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.429409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.576 qpair failed and we were unable to recover it. 00:30:16.576 [2024-10-30 16:14:06.429506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.429609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.429636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.576 qpair failed and we were unable to recover it. 00:30:16.576 [2024-10-30 16:14:06.429745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.429866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.429893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.576 qpair failed and we were unable to recover it. 00:30:16.576 [2024-10-30 16:14:06.430007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.430090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.430116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.576 qpair failed and we were unable to recover it. 00:30:16.576 [2024-10-30 16:14:06.430207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.430427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.576 [2024-10-30 16:14:06.430457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.430593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.430732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.430763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.430888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.431025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.431069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.431185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.431281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.431320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.431403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.431548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.431582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.431725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.431809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.431836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.431956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.432041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.432067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.432191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.432280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.432313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.432429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.432539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.432577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.432713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.432856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.432899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.433011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.433135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.433162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.433248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.433347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.433374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.433464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.433579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.433606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.434417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.434505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.434531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.434657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.434756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.434801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.434905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.435062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.435090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.435200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.435290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.435319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.435401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.435508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.435534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.435663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.435776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.435803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.435920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.436065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.436095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.436230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.436329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.436356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.436466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.436614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.436644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.436745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.436860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.436890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.437017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.437120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.437151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.437290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.437441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.437468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.437555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.437677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.437705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.437816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.437897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.437923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.437999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.438113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.438138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.438285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.438395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.438421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.438530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.438662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.438692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.577 [2024-10-30 16:14:06.438817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.438984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.577 [2024-10-30 16:14:06.439011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.577 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.439123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.439231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.439275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.439363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.439477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.439504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.439621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.439764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.439791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.439935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.440064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.440099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.440231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.440347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.440375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.440467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.440609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.440637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.440720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.440802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.440826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.440934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.441051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.441078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.441190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.441282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.441311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.441451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.441570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.441605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.441717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.441807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.441834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.441975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.442054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.442079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.442156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.442270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.442297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.442441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.442521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.442554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.442675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.442812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.442839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.442978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.443124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.443151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.443293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.443415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.443442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.443595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.443684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.443709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.443822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.443903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.443929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.444019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.444103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.444130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.444278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.444372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.444399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.444515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.444628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.444655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.444767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.444902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.444929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.445045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.445158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.445190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.445273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.445374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.445403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.445524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.445642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.445670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.445788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.445900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.445929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.446059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.446137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.446162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.446243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.446370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.446397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.578 [2024-10-30 16:14:06.446490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.446570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.578 [2024-10-30 16:14:06.446597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.578 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.446704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.446809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.446836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.446978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.447120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.447148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.447264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.447411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.447437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.447552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.447678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.447710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.447831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.447961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.447988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.448074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.448212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.448239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.448369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.448475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.448505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.448660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.448808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.448836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.448979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.449099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.449127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.449241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.449369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.449396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.449509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.449630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.449657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.449770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.449863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.449890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.449978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.450070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.450097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.450211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.450302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.450328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.450418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.450529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.450567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.450675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.450785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.450813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.450955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.451042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.451067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.451155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.451254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.451290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.451392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.451482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.451511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.579 [2024-10-30 16:14:06.451648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.451764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.579 [2024-10-30 16:14:06.451792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.579 qpair failed and we were unable to recover it. 00:30:16.857 [2024-10-30 16:14:06.451905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.857 [2024-10-30 16:14:06.451989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.857 [2024-10-30 16:14:06.452015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.857 qpair failed and we were unable to recover it. 00:30:16.857 [2024-10-30 16:14:06.452132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.857 [2024-10-30 16:14:06.452216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.857 [2024-10-30 16:14:06.452244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.857 qpair failed and we were unable to recover it. 00:30:16.857 [2024-10-30 16:14:06.452376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.857 [2024-10-30 16:14:06.452468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.857 [2024-10-30 16:14:06.452495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.857 qpair failed and we were unable to recover it. 00:30:16.857 [2024-10-30 16:14:06.452622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.452704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.452729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.452849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.452992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.453019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.453097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.453176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.453203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.453321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.453430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.453457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.453653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.453796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.453824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.453914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.454030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.454057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.454141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.454221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.454247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.454398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.454506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.454534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.454649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.454759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.454787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.454897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.455009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.455037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.455146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.455234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.455270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.455390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.455498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.455527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.455639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.455790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.455817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.455930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.456046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.456075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.456188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.456303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.456331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.456454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.456599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.456627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.456742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.456864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.456891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.456970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.457055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.457081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.457191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.457303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.457330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.457471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.457583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.457612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.457733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.457871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.457899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.457991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.458139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.458166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.458277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.458370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.458396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.458506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.458611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.458639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.458724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.458810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.458835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.458975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.459085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.459111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.459226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.459320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.459346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.459460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.459536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.858 [2024-10-30 16:14:06.459562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.858 qpair failed and we were unable to recover it. 00:30:16.858 [2024-10-30 16:14:06.459677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.459790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.459817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.459959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.460074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.460101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.460220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.460317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.460344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.460435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.460520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.460545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.460637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.460752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.460779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.460868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.461005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.461033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.461151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.461227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.461253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.461337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.461421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.461446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.461561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.461633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.461659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.461747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.461855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.461882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.461989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.462130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.462157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.462269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.462413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.462440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.462535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.462649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.462676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.462768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.462911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.462940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.463057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.463201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.463229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.463351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.463435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.463461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.463572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.463683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.463712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.463854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.463968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.463996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.464077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.464220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.464247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.464363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.464478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.464505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.464627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.464708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.464734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.464847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.464950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.464977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.465070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.465154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.465179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.465287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.465416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.465448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.465546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.465658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.465694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.465839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.465953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.465980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.466059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.466143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.466169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.466254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.466404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.466432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.859 [2024-10-30 16:14:06.466548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.466626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.859 [2024-10-30 16:14:06.466651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.859 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.466762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.466872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.466900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.466986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.467160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.467187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.467302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.467442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.467470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.467580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.467689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.467717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.467813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.467955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.467983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.468069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.468178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.468204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.468318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.468461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.468489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.468605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.468717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.468744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.468836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.468918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.468944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.469082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.469225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.469252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.469352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.469436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.469463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.469611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.469700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.469727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.469847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.469932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.469958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.470101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.470193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.470218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.470341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.470438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.470467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.470559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.470698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.470726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.470834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.470951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.470978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.471063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.471152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.471178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.471301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.471431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.471463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.471550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.471663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.471690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.471844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.471988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.472016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.472160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.472271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.472300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.472392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.472480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.472506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.472593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.472710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.472736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.472855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.472950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.472977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.473094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.473197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.473224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.473316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.473408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.473434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.473604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.473746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.473774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.860 qpair failed and we were unable to recover it. 00:30:16.860 [2024-10-30 16:14:06.473908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.474029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.860 [2024-10-30 16:14:06.474061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.474187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.474350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.474380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.474470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.474613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.474640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.474820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.474935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.474962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.475047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.475157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.475184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.475276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.475394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.475421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.475495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.475611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.475655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.475822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.475961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.475989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.476096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.476234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.476268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.476364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.476505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.476533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.476650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.476767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.476794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.476933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.477068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.477113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.477238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.477385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.477414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.477527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.477610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.477636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.477778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.477919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.477950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.478055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.478190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.478218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.478322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.478423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.478449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.478587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.478728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.478756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.478838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.478974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.479002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.479113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.479230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.479267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.479351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.479439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.479466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.479594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.479682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.479711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.479831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.479996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.480024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.480142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.480254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.861 [2024-10-30 16:14:06.480291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.861 qpair failed and we were unable to recover it. 00:30:16.861 [2024-10-30 16:14:06.480384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.480476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.480501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.480614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.480758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.480786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.480922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.481079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.481130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.481248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.481357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.481385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.481562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.481676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.481704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.481850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.481969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.481997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.482143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.482311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.482342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.482488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.482648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.482676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.482789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.482900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.482927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.483044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.483130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.483157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.483271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.483383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.483411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.483529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.483609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.483637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.483759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.483870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.483903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.484021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.484160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.484187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.484269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.484346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.484371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.484507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.484635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.484662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.484804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.484916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.484943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.485032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.485115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.485142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.485247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.485367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.485394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.485509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.485650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.485679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.485793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.485909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.485937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.486044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.486134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.486169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.486278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.486418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.486451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.486563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.486678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.486706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.486798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.486870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.486895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.487045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.487151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.487179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.487287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.487405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.487433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.487522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.487635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.487663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.862 qpair failed and we were unable to recover it. 00:30:16.862 [2024-10-30 16:14:06.487773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.487852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.862 [2024-10-30 16:14:06.487876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.487988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.488101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.488128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.488210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.488334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.488360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.488512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.488650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.488677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.488818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.488900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.488935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.489021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.489140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.489168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.489281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.489396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.489424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.489538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.489623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.489651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.489797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.489877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.489902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.489985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.490103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.490129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.490250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.490360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.490388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.490527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.490637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.490664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.490804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.490897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.490923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.491036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.491124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.491149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.491265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.491350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.491378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.491502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.491622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.491650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.491745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.491886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.491915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.492057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.492170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.492199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.492291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.492377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.492403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.492482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.492585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.492610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.492753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.492869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.492896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.493036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.493157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.493185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.493308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.493420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.493449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.493544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.493633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.493660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.493774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.493916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.493945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.494065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.494177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.494206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.494282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.494395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.494420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.494535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.494627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.494654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.494744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.494853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.494881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.863 [2024-10-30 16:14:06.494997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.495102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.863 [2024-10-30 16:14:06.495130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.863 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.495249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.495362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.495390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.495473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.495562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.495587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.495673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.495814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.495842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.495954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.496069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.496096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.496187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.496269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.496296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.496417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.496530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.496558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.496696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.496841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.496868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.496978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.497119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.497146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.497287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.497408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.497434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.497584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.497674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.497699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.497773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.497880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.497907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.497989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.498132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.498159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.498252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.498342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.498368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.498480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.498594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.498621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.498771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.498886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.498913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.499056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.499168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.499195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.499343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.499461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.499489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.499621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.499754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.499780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.499887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.499966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.499991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.500110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.500192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.500220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.500342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.500448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.500476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.500627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.500741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.500770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.500889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.501001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.501029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.501113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.501206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.501231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.501386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.501505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.501533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.501655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.501767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.501795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.501936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.502050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.502078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.502162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.502279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.502307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.864 qpair failed and we were unable to recover it. 00:30:16.864 [2024-10-30 16:14:06.502393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.864 [2024-10-30 16:14:06.502517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.502544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.502685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.502798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.502825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.502966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.503046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.503071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.503156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.503306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.503334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.503482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.503594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.503621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.503715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.503838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.503867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.503947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.504052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.504077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.504203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.504293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.504319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.504430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.504506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.504530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.504647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.504758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.504786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.504898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.504980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.505009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.505148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.505268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.505297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.505382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.505461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.505487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.505596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.505712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.505739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.505815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.505958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.505984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.506100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.506187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.506213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.506335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.506413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.506437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.506557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.506676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.506703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.506815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.506930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.506957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.507044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.507160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.507197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.507282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.507431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.507462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.507578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.507691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.507720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.507836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.507968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.507995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.865 qpair failed and we were unable to recover it. 00:30:16.865 [2024-10-30 16:14:06.508140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.508266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.865 [2024-10-30 16:14:06.508294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.508401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.508543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.508569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.508664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.508807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.508833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.508949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.509062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.509089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.509208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.509323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.509351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.509473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.509554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.509580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.509716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.509804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.509836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.509954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.510098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.510124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.510204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.510344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.510371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.510508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.510647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.510673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.510760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.510842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.510867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.510948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.511032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.511058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.511207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.511289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.511315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.511438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.511557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.511584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.511721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.511847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.511874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.511983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.512120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.512147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.512238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.512360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.512387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.512525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.512640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.512668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.512789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.512904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.512932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.513024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.513140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.513167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.513281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.513425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.513451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.513546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.513684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.513710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.513855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.513934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.513959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.514098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.514239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.514272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.514402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.514553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.514582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.514684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.514768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.514794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.866 [2024-10-30 16:14:06.514873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.514975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.866 [2024-10-30 16:14:06.515002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.866 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.515142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.515222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.515247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.515377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.515467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.515492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.515608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.515733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.515760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.515876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.515961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.515988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.516081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.516190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.516217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.516345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.516458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.516485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.516603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.516717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.516745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.516826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.516949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.516974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.517058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.517177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.517204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.517334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.517469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.517497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.517612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.517695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.517723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.517817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.517934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.517960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.518038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.518157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.518183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.518296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.518384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.518411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.518525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.518636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.518663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.518774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.518885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.518912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.519051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.519139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.519167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.519282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.519401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.519427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.519518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.519599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.519625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.519720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.519834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.519862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.519970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.520057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.520084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.520223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.520346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.520374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.520462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.520580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.520607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.520722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.520809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.520836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.520941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.521046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.521072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.521177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.521253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.521288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.521404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.521482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.521507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.867 qpair failed and we were unable to recover it. 00:30:16.867 [2024-10-30 16:14:06.521580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.867 [2024-10-30 16:14:06.521701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.521733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.521847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.521958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.521985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.522102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.522193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.522219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.522343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.522462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.522489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.522571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.522683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.522710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.522849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.522952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.522980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.523092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.523207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.523235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.523372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.523531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.523558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.523672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.523788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.523815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.523956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.524071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.524098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.524211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.524293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.524324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.524468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.524583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.524610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.524752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.524861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.524889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.525001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.525105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.525132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.525245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.525393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.525423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.525549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.525635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.525662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.525757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.525869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.525897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.525997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.526106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.526134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.526250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.526398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.526425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.526507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.526620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.526646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.526740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.526852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.526883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.526962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.527073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.527100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.527210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.527283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.527309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.527400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.527486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.527512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.527625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.527743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.527770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.527882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.528019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.528046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.528159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.528274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.868 [2024-10-30 16:14:06.528302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.868 qpair failed and we were unable to recover it. 00:30:16.868 [2024-10-30 16:14:06.528414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.528559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.528586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.528696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.528834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.528862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.529002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.529111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.529138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.529286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.529403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.529430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.529581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.529690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.529717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.529808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.529913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.529939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.530054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.530132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.530159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.530268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.530388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.530416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.530496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.530584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.530609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.530750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.530860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.530886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.530999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.531073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.531097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.531189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.531297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.531325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.531402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.531520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.531547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.531666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.531779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.531808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.531930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.532014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.532041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.532128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.532245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.532282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.532367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.532509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.532536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.532650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.532765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.532791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.532907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.533003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.533029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.533124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.533228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.533285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.533377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.533498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.533524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.533642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.533754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.533781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.533864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.533976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.534002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.534120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.534228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.534262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.534362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.534474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.534501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.534618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.534721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.534748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.534889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.535033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.535060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.535175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.535288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.869 [2024-10-30 16:14:06.535317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.869 qpair failed and we were unable to recover it. 00:30:16.869 [2024-10-30 16:14:06.535403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.535486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.535513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.535629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.535766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.535794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.535930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.536037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.536064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.536171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.536289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.536317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.536414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.536558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.536586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.536678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.536785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.536813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.536959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.537043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.537075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.537194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.537334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.537362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.537442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.537564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.537591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.537733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.537846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.537872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.537988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.538102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.538128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.538212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.538307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.538334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.538477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.538594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.538621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.538730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.538846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.538875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.539020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.539112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.539139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.539269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.539391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.539418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.539532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.539617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.539644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.539785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.539891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.539917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.540027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.540104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.540130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.540245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.540369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.540396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.540483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.540629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.540656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.540789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.540906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.540932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.870 qpair failed and we were unable to recover it. 00:30:16.870 [2024-10-30 16:14:06.541071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.870 [2024-10-30 16:14:06.541186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.541214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.541343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.541457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.541485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.541627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.541732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.541758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.541900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.541987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.542013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.542100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.542173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.542199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.542313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.542400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.542428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.542543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.542649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.542675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.542816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.542957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.542983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.543074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.543188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.543214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.543337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.543415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.543442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.543583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.543692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.543717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.543832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.543916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.543946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.544025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.544133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.544159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.544254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.544347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.544373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.544481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.544564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.544593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.544735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.544852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.544878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.544967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.545080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.545108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.545199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.545346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.545374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.545487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.545572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.545600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.545719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.545833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.545860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.545980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.546093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.546120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.546237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.546339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.546365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.546512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.546596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.546625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.546742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.546856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.546883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.547024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.547152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.547182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.547281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.547370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.547397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.547536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.547624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.547667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.547892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.548028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.548059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.871 qpair failed and we were unable to recover it. 00:30:16.871 [2024-10-30 16:14:06.548201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.871 [2024-10-30 16:14:06.548353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.548380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.548492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.548630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.548659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.548845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.548982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.549029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.549198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.549314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.549341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.549451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.549530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.549556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.549711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.549838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.549867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.549983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.550151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.550177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.550289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.550383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.550411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.550521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.550661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.550690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.550815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.550929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.550958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.551076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.551179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.551208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.551348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.551439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.551466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.551593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.551710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.551738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.551869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.551984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.552012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.552178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.552341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.552368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.552479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.552586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.552616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.552770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.552872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.552901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.553046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.553211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.553240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.553426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.553524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.553554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.553671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.553794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.553824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.554028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.554143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.554172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.554295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.554429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.554455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.554571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.554698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.554727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.554834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.554997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.555026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.555148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.555271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.555314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.555430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.555585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.555613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.555845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.555958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.555985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.556151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.556314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.556341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.556435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.556555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.556584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.872 [2024-10-30 16:14:06.556749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.556885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.872 [2024-10-30 16:14:06.556926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.872 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.557026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.557146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.557174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.557370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.557495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.557525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.557707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.557827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.557858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.557978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.558101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.558130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.558251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.558352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.558378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.558454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.558568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.558593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.558711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.558789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.558824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.558960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.559072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.559101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.559232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.559354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.559381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.559498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.559626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.559654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.559780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.559873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.559904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.560066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.560220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.560249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.560366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.560459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.560486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.560601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.560730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.560773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.560898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.561026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.561055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.561174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.561344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.561371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.561459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.561562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.561592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.561726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.561831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.561857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.561956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.562109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.562137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.562267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.562404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.562431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.562538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.562618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.562644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.562770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.562923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.562952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.563074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.563204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.563229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.563327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.563441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.563467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.563587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.563709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.563738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.563838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.563992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.564021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.564160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.564274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.564301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.564397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.564509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.564551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.564643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.564761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.564789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.873 qpair failed and we were unable to recover it. 00:30:16.873 [2024-10-30 16:14:06.564904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.873 [2024-10-30 16:14:06.564983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.565009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.565151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.565283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.565310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.565426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.565579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.565622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.565737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.565872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.565898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.566030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.566149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.566177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.566333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.566460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.566504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.566597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.566703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.566729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.566812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.566892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.566919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.567037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.567188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.567217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.567338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.567475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.567501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.567622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.567749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.567792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.567906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.568015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.568041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.568154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.568243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.568276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.568418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.568512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.568538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.568646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.568729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.568755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.568893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.569004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.569030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.569124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.569226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.569252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.569352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.569492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.569518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.569654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.569738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.569764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.569871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.570034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.570060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.570219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.570371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.570398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.570506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.570576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.570602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.570754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.570891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.570917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.571018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.571118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.571146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.571281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.571421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.571447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.571591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.571748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.571774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.571917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.572009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.572035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.572142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.572262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.572289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.572422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.572583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.572613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.572786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.572905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.874 [2024-10-30 16:14:06.572931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.874 qpair failed and we were unable to recover it. 00:30:16.874 [2024-10-30 16:14:06.573009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.573145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.573171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.573249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.573360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.573404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.573528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.573641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.573667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.573784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.573869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.573895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.574032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.574194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.574220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.574349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.574436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.574462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.574548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.574622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.574648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.574762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.574867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.574909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.575060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.575151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.575180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.575327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.575442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.575468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.575583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.575713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.575742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.575890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.576042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.576070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.576201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.576304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.576331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.576443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.576565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.576593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.576714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.576838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.576879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.576963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.577103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.577130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.577300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.577413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.577440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.577581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.577671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.577700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.577830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.577914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.577941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.578063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.578145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.578173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.578301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.578447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.578476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.578610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.578717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.578743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.578846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.579004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.579033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.579115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.579240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.579296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.579391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.579504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.579532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.875 qpair failed and we were unable to recover it. 00:30:16.875 [2024-10-30 16:14:06.579659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.579773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.875 [2024-10-30 16:14:06.579802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.579922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.580039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.580068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.580176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.580280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.580307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.580422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.580560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.580589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.580713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.580810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.580838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.580944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.581050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.581075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.581223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.581375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.581402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.581484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.581620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.581649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.581790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.581862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.581888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.582027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.582130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.582158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.582240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.582370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.582401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.582513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.582606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.582631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.582723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.582838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.582884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.583034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.583185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.583214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.583356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.583468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.583494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.583656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.583772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.583801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.583927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.584037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.584080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.584248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.584371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.584398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.584542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.584616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.584659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.584802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.584911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.584937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.585085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.585198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.585224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.585398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.585524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.585551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.585630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.585766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.585792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.585878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.585987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.586013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.586102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.586204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.586237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.586375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.586464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.586493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.586663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.586736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.586761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.586889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.587000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.587029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.587146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.587306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.587333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.587469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.587557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.587583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.876 qpair failed and we were unable to recover it. 00:30:16.876 [2024-10-30 16:14:06.587706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.587830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.876 [2024-10-30 16:14:06.587859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.587977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.588096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.588124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.588261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.588406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.588432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.588572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.588691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.588719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.588805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.588920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.588949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.589061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.589199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.589226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.589370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.589447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.589473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.589587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.589699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.589725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.589803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.589944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.589970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.590101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.590268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.590294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.590384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.590460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.590486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.590596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.590734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.590760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.590890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.591013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.591043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.591145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.591231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.591268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.591373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.591490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.591516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.591660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.591757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.591785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.591867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.591982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.592010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.592143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.592266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.592293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.592456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.592553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.592582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.592729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.592853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.592881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.593018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.593128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.593154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.593272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.593404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.593433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.593572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.593710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.593737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.593826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.593936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.593962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.594085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.594186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.594215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.594380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.594511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.594540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.594703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.594841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.594867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.595008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.595156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.595184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.595315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.595442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.595470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.877 [2024-10-30 16:14:06.595600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.595714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.877 [2024-10-30 16:14:06.595740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.877 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.595829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.595942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.595969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.596054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.596172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.596201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.596326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.596449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.596478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.596641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.596784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.596810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.596949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.597067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.597096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.597248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.597398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.597427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.597579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.597730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.597773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.597861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.598003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.598030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.598194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.598333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.598359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.598442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.598534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.598576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.598730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.598856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.598884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.598992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.599094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.599120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.599216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.599343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.599369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.599454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.599589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.599618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.599741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.599822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.599850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.599959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.600069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.600102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.600230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.600376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.600402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.600520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.600602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.600627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.600745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.600825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.600867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.600978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.601097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.601123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.601236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.601346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.601373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.601486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.601563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.601589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.601663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.601771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.601797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.601911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.601992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.602019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.602159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.602285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.602330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.602448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.602571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.602604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.602757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.602885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.602912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.603064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.603178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.603204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.603320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.603437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.878 [2024-10-30 16:14:06.603462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.878 qpair failed and we were unable to recover it. 00:30:16.878 [2024-10-30 16:14:06.603563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.603713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.603754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.603878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.604001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.604030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.604134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.604218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.604244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.604344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.604464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.604508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.604603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.604766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.604792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.604969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.605107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.605133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.605271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.605385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.605412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.605530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.605692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.605720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.605846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.605928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.605956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.606082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.606215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.606241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.606341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.606427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.606454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.606572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.606677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.606703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.606786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.606864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.606890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.607030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.607124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.607152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.607315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.607420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.607446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.607617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.607734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.607762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.607886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.607981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.608010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.608118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.608242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.608278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.608379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.608488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.608514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.608645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.608762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.608790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.608915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.609065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.609093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.609216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.609398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.609428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.609539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.609620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.609646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.609766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.609929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.609958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.610081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.610203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.610232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.610338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.610487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.879 [2024-10-30 16:14:06.610515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.879 qpair failed and we were unable to recover it. 00:30:16.879 [2024-10-30 16:14:06.610657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.610747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.610772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.610873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.610967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.610996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.611097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.611273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.611300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.611391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.611465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.611491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.611630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.611712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.611738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.611879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.612021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.612046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.612182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.612272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.612299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.612404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.612513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.612556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.612672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.612786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.612811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.612906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.613074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.613102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.613231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.613376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.613405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.613536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.613704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.613730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.613842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.613958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.613984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.614071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.614183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.614209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.614318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.614394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.614420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.614539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.614633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.614676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.614779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.614889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.614915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.615044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.615150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.615177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.615328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.615454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.615480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.615562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.615676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.615701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.615793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.615929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.615954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.616068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.616189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.616222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.616356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.616470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.616498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.616593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.616687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.616716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.616852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.616975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.617002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.617125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.617288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.617316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.617431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.617539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.617565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.617678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.617791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.617834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.880 [2024-10-30 16:14:06.617970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.618078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.880 [2024-10-30 16:14:06.618104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.880 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.618268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.618370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.618399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.618524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.618695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.618721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.618833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.618994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.619023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.619142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.619227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.619253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.619400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.619565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.619594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.619744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.619867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.619896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.620034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.620152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.620181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.620377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.620567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.620596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.620714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.620852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.620878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.621030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.621189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.621218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.621372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.621485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.621511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.621628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.621771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.621797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.621928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.622068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.622094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.622215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.622346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.622391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.622488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.622601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.622645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.622781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.622894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.622920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.623034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.623129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.623158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.623287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.623416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.623444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.623569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.623726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.623755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.623891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.624000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.624026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.624167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.624280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.624309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.624434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.624524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.624552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.624693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.624798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.624824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.624945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.625089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.625115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.625273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.625395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.625424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.625545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.625672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.625715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.625831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.625944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.625969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.626085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.626199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.626225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.881 qpair failed and we were unable to recover it. 00:30:16.881 [2024-10-30 16:14:06.626316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.626423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.881 [2024-10-30 16:14:06.626449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.626531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.626671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.626698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.626812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.626926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.626954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.627089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.627232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.627266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.627403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.627528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.627556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.627681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.627800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.627841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.627962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.628042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.628084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.628226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.628350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.628377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.628515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.628614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.628640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.628748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.628916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.628945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.629082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.629224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.629251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.629350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.629461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.629488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.629572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.629674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.629703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.629876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.629989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.630015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.630121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.630288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.630318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.630422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.630501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.630531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.630651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.630796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.630822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.630943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.631068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.631096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.631201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.631339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.631366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.631481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.631594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.631620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.631770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.631898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.631926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.632055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.632177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.632205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.632303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.632421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.632450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.632578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.632659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.632685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.632813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.632961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.632990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.633113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.633238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.633284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.633378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.633500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.633543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.633618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.633736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.633762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.633889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.633981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.634010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.634102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.634249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.634288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.882 [2024-10-30 16:14:06.634406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.634519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.882 [2024-10-30 16:14:06.634548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.882 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.634716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.634803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.634828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.634966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.635154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.635179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.635328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.635516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.635542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.635669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.635816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.635845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.635982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.636123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.636149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.636324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.636457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.636483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.636650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.636775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.636804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.636999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.637112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.637140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.637283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.637364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.637391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.637485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.637576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.637602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.637687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.637764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.637790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.637882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.638000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.638044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.638239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.638380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.638407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.638597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.638736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.638764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.638853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.638949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.638974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.639083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.639160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.639186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.639297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.639404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.639430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.639521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.639654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.639682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.639837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.639974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.639999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.640093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.640250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.640292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.640427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.640541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.640567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.640677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.640883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.640909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.641084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.641225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.641250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.641408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.641570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.641596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.641710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.641796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.641822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.641932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.642020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.642047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.642193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.642276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.642306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.642440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.642553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.642580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.883 qpair failed and we were unable to recover it. 00:30:16.883 [2024-10-30 16:14:06.642697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.642806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.883 [2024-10-30 16:14:06.642832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.642961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.643081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.643110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.643229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.643337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.643367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.643458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.643539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.643568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.643678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.643800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.643826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.643907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.644043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.644071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.644167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.644318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.644348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.644476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.644561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.644594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.644698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.644808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.644834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.644965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.645130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.645155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.645277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.645414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.645443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.645580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.645706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.645749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.645892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.646007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.646033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.646175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.646351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.646378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.646467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.646591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.646618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.646722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.646800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.646826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.646937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.647046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.647072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.647189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.647272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.647304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.647448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.647585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.647611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.647713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.647898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.647926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.648091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.648207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.648234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.648329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.648423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.648449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.648535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.648634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.648663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.648768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.648880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.648906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.649056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.649162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.649188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.649309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.649394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.649419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.884 [2024-10-30 16:14:06.649536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.649676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.884 [2024-10-30 16:14:06.649704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.884 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.649857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.649952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.649982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.650150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.650233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.650265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.650374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.650460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.650502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.650627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.650771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.650800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.650967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.651061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.651087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.651179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.651305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.651332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.651412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.651552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.651578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.651714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.651851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.651880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.652029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.652172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.652197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.652283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.652400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.652426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.652586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.652708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.652751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.652837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.652944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.652971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.653114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.653278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.653305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.653418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.653526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.653552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.653742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.653871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.653913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.654022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.654175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.654203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.654331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.654451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.654493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.654630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.654747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.654773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.654930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.655027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.655056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.655204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.655322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.655352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.655474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.655601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.655631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.655751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.655867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.655893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.656082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.656179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.656207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.656345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.656450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.656476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.656616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.656704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.656733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.656899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.657015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.657040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.657187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.657318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.657347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.657440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.657554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.657582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.657709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.657858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.885 [2024-10-30 16:14:06.657887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.885 qpair failed and we were unable to recover it. 00:30:16.885 [2024-10-30 16:14:06.658031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.658173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.658199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.658360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.658482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.658511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.658657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.658813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.658842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.658956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.659107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.659136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.659246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.659392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.659418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.659608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.659714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.659739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.659878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.660009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.660052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.660139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.660220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.660246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.660374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.660515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.660541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.660668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.660779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.660808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.660932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.661088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.661117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.661246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.661401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.661431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.661537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.661659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.661690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.661798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.661887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.661915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.662089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.662178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.662205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.662292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.662433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.662462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.662585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.662698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.662724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.662866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.662969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.662997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.663116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.663248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.663281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.663445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.663558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.663586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.663725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.663807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.663833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.663942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.664046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.664088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.664179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.664296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.664326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.664471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.664596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.664627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.664761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.664899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.664924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.665040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.665127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.665152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.665270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.665360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.665403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.665525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.665607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.665636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.665742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.665880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.665905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.886 qpair failed and we were unable to recover it. 00:30:16.886 [2024-10-30 16:14:06.665994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.666132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.886 [2024-10-30 16:14:06.666161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.666312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.666461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.666489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.666584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.666671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.666700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.666802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.666885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.666911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.667001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.667115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.667141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.667264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.667349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.667375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.667463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.667575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.667601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.667708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.667822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.667848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.667996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.668155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.668180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.668267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.668398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.668427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.668574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.668650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.668676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.668785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.668900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.668926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.669065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.669180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.669208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.669355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.669454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.669481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.669608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.669739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.669783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.669900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.670040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.670066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.670235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.670369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.670413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.670502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.670615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.670659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.670755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.670886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.670914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.671054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.671202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.671228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.671380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.671540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.671566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.671706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.671818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.671845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.671931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.672057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.672087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.672222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.672347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.672374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.672535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.672674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.672700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.672841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.672978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.673006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.673156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.673250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.673287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.673428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.673539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.673565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.673677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.673797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.673825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.673915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.674029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.887 [2024-10-30 16:14:06.674057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.887 qpair failed and we were unable to recover it. 00:30:16.887 [2024-10-30 16:14:06.674151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.674246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.674299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.674423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.674547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.674574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.674688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.674812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.674841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.674959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.675068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.675094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.675173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.675284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.675316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.675459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.675569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.675595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.675724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.675823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.675852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.675933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.676049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.676077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.676639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.676780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.676808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.676951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.677035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.677061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.677146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.677299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.677332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.677470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.677624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.677653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.677755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.677848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.677877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.677991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.678138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.678163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.678282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.678471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.678497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.678628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.678758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.678785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.678883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.679001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.679028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.679162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.679253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.679287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.679390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.679504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.679530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.679689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.679815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.679843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.680014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.680100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.680125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.680236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.680337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.680362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.680449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.680574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.680599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.680686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.680776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.680817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.680940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.681062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.681089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.888 [2024-10-30 16:14:06.681203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.681320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.888 [2024-10-30 16:14:06.681346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.888 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.681434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.681559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.681586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.681709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.681801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.681829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.681960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.682082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.682110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.682227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.682318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.682344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.682456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.682539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.682582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.682719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.682797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.682822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.682897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.682981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.683023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.683165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.683249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.683306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.683430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.683518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.683542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.683651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.683729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.683754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.683870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.683992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.684019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.684154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.684299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.684325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.684461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.684553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.684580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.684678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.684800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.684829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.684928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.685050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.685090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.685197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.685321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.685348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.685440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.685520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.685571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.685658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.685741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.685769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.685856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.685983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.686008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.686146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.686267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.686292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.686389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.686460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.686485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.686625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.686762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.686786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.686889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.687020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.687045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.687184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.687314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.687340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.687427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.687513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.687553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.687669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.687790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.687818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.687918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.688032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.688059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.688181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.688267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.688293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.688389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.688469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.688493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.889 qpair failed and we were unable to recover it. 00:30:16.889 [2024-10-30 16:14:06.688606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.688732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.889 [2024-10-30 16:14:06.688765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.688901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.689006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.689031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.689175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.689286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.689321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.689453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.689543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.689570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.689733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.689818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.689844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.689968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.690114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.690139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.690220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.690306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.690333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.690450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.690544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.690569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.690693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.690827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.690854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.690949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.691049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.691091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.691230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.691326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.691352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.691444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.691575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.691602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.691724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.691856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.691884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.692017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.692127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.692153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.692263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.692355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.692381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.692464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.692551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.692576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.692655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.692764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.692789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.692897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.693016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.693042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.693119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.693231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.693264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.693354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.693464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.693489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.693674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.693782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.693806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.693938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.694071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.694098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.694238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.694378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.694404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.694492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.694629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.694654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.694812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.694914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.694940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.695054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.695162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.695190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.695347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.695438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.695464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.695590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.695664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.695689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.695795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.695870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.695895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.696039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.696143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.696168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.890 qpair failed and we were unable to recover it. 00:30:16.890 [2024-10-30 16:14:06.696280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.890 [2024-10-30 16:14:06.696401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.696426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.696594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.696729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.696757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.696854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.696955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.696984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.697080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.697176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.697205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.697356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.697444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.697469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.697598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.697721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.697750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.697848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.697944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.697972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.698120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.698243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.698280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.698409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.698525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.698550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.698672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.698795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.698825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.698990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.699096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.699121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.699220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.699328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.699354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.699466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.699555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.699580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.699709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.699801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.699829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.699956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.700060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.700085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.700187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.700343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.700369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.700486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.700601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.700626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.700729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.700820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.700848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.700997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.701092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.701119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.701238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.701389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.701416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.701538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.701643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.701668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.701800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.701889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.701922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.702024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.702144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.702171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.702343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.702460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.702484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.702599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.702682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.702707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.702827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.702954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.702981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.703137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.703235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.703277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.703356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.703458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.703483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.703565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.703680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.891 [2024-10-30 16:14:06.703706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.891 qpair failed and we were unable to recover it. 00:30:16.891 [2024-10-30 16:14:06.703826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.703937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.703962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.704071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.704182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.704207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.704308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.704444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.704474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.704561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.704672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.704697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.704811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.704902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.704946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.705064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.705162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.705187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.705280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.705365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.705391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.705475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.705633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.705658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.705800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.705934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.705960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.706039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.706153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.706178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.706283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.706428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.706453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.706574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.706685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.706712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.706853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.706936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.706963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.707097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.707186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.707214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.707361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.707454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.707481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.707601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.707694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.707719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.707880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.708039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.708064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.708173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.708287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.708313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.708424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.708530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.708571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.708723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.708868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.708893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.709030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.709157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.709184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.709321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.709404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.709429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.709540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.709620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.709645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.709753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.709840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.709866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.709995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.710125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.710154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.710279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.710400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.710430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.710563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.710683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.710711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.710821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.710933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.710958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.711042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.711156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.711181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.711287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.711400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.711428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.892 qpair failed and we were unable to recover it. 00:30:16.892 [2024-10-30 16:14:06.711522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.711649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.892 [2024-10-30 16:14:06.711678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.711777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.711897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.711922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.712051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.712134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.712163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.712280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.712378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.712408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.712507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.712604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.712637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.712773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.712888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.712914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.713017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.713103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.713131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.713272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.713390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.713415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.713544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.713644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.713669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.713830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.713942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.713982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.714106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.714227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.714275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.714364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.714477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.714502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.714657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.714766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.714791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.714879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.714963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.714988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.715070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.715184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.715211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.715364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.715449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.715475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.715586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.715746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.715774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:16.893 [2024-10-30 16:14:06.715902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.715989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.893 [2024-10-30 16:14:06.716013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:16.893 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.716153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.716238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.716273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.716425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.716516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.716541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.716630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.716746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.716771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.716885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.716985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.717011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.717111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.717194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.717219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.717317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.717402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.717434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.717531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.717655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.717682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.717774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.717866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.717891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.717976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.718092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.718117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.718228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.718331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.718359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.718444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.718535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.718560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.718650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.718773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.718798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.718899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.719005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.719031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.719139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.719220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.719245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.719358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.719447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.719472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.719580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.719667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.719691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.719782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.719939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.719964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.720050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.720146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.720177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.720298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.720411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.720437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.720545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.720652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.720676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.720793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.720904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.195 [2024-10-30 16:14:06.720930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.195 qpair failed and we were unable to recover it. 00:30:17.195 [2024-10-30 16:14:06.721012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.721090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.721115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.721230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.721346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.721371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.721487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.721573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.721597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.721720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.721827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.721852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.721935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.722048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.722073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.722188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.722265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.722291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.722407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.722496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.722521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.722638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.722747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.722772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.722888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.722967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.722992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.723081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.723221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.723246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.723338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.723426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.723452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.723541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.723650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.723676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.723759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.723843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.723867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.723982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.724089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.724113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.724225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.724411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.724437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.724557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.724720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.724748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.724869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.724964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.724993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.725114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.725200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.725243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.725369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.725455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.725481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.725566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.725676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.725701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.725809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.725914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.725939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.726029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.726108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.726133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.726252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.726377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.726402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.726487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.726572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.726596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.726726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.726866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.726894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.727042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.727149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.727174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.727268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.727386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.727410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.727522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.727636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.727661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.727751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.727838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.727862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.727973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.728053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.728078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.196 qpair failed and we were unable to recover it. 00:30:17.196 [2024-10-30 16:14:06.728186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.728289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.196 [2024-10-30 16:14:06.728316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.728401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.728478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.728518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.728633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.728715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.728742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.728867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.728951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.728979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.729149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.729285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.729310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.729396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.729528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.729560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.729685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.729775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.729802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.729890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.730004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.730032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.730165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.730242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.730274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.730390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.730470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.730514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.730629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.730748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.730775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.730868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.730987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.731014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.731143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.732134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.732169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.732344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.732486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.732514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.732599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.732720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.732748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.732916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.733066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.733094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.733207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.733323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.733350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.733438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.733565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.733607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.733740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.733826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.733851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.733925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.734004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.734028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.734123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.734228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.734253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.734385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.734496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.734521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.734633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.734767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.734791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.734883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.734976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.735002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.735108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.735193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.735218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.735310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.735418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.735442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.735536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.735621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.735646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.735734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.735880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.735905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.736017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.736154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.736179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.736270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.736357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.736382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.736467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.736549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.736575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.197 qpair failed and we were unable to recover it. 00:30:17.197 [2024-10-30 16:14:06.736682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.197 [2024-10-30 16:14:06.736767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.736791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.736876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.736956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.736982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.737073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.737182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.737206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.737322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.737403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.737428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.737514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.737594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.737619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.737739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.737822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.737847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.737935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.738046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.738070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.738184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.738326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.738352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.738468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.738573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.738598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.738742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.738824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.738848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.738957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.739033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.739059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.739170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.739286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.739311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.739399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.739478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.739503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.739617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.739694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.739719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.739835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.739912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.739937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.740053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.740144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.740170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.740281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.740397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.740422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.740545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.740664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.740690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.740800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.740870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.740894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.741014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.741122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.741147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.741269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.741383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.741407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.741491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.741577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.741602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.741713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.741824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.741848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.741992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.742101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.742125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.742210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.742294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.742324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.742415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.742535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.742564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.742658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.742739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.742763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.742849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.742983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.743007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.743117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.743200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.743224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.743334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.743441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.743465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.198 qpair failed and we were unable to recover it. 00:30:17.198 [2024-10-30 16:14:06.743591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.198 [2024-10-30 16:14:06.743698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.743722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.743798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.743884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.743908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.743995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.744111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.744135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.744251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.744359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.744384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.744473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.744559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.744584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.744703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.744808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.744837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.744917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.744989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.745014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.745157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.745244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.745278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.745392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.745478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.745503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.745616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.745746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.745771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.745852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.745958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.745984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.746125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.746213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.746238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.746345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.746454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.746479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.746562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.746672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.746698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.746843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.746923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.746948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.747104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.747219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.747244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.747369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.747513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.747541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.747689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.747789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.747814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.747921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.748041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.748067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.748215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.748360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.748386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.748464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.748618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.748652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.748742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.748850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.748874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.199 [2024-10-30 16:14:06.748973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.749054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.199 [2024-10-30 16:14:06.749079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.199 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.749189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.749364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.749390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.749527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.749599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.749624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.749708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.749820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.749846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.749940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.750054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.750078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.750162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.750270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.750296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.750407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.750483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.750508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.750594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.750677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.750701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.750808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.750886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.750912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.751038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.751151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.751176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.751270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.751383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.751407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.751533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.751624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.751649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.751768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.751878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.751903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.751992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.752136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.752161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.752277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.752369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.752395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.752504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.752582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.752608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.752718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.752825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.752850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.752968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.753045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.753070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.753182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.753270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.753296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.753433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.753514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.753538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.753651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.753763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.753787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.753936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.754074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.754099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.754240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.754373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.754399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.754491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.754573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.754597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.754752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.754892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.754917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.755006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.755118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.755145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.755268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.755379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.755403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.755492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.755600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.755625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.755769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.755911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.755936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.756051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.756127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.756153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.756234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.756356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.756382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.200 qpair failed and we were unable to recover it. 00:30:17.200 [2024-10-30 16:14:06.757116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.200 [2024-10-30 16:14:06.757291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.757319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.757418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.757535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.757560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.757650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.757734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.757759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.757835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.757951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.757980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.758086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.758196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.758221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.758322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.758402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.758428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.758577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.758699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.758724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.758843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.758958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.758982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.759071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.759187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.759213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.759305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.759397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.759424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.759543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.759644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.759668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.759752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.759864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.759890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.759973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.760111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.760137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.760251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.760341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.760367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.760458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.760538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.760562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.760711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.760796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.760821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.760905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.760979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.761005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.761112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.761229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.761254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.761348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.761460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.761487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.761578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.761691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.761716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.761806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.761914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.761940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.762027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.762112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.762138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.762221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.762324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.762349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.762460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.762580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.762605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.762764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.762846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.762872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.762959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.763062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.763088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.763198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.763299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.763326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.763449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.763562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.763588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.763698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.763811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.763838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.763926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.764005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.764030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.201 qpair failed and we were unable to recover it. 00:30:17.201 [2024-10-30 16:14:06.764146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.201 [2024-10-30 16:14:06.764226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.764252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.764368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.764439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.764464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.764576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.764660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.764684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.764795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.764874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.764899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.765020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.765133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.765158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.765242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.765387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.765414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.765501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.765588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.765613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.765694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.765769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.765805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.765887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.765993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.766018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.766109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.766191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.766216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.766342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.766479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.766503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.766585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.766695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.766720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.766802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.766913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.766938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.767018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.767160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.767186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.767364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.767480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.767506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.767607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.767705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.767733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.767835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.767943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.767968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.768062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.768197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.768224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.768367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.768506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.768531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.768625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.768776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.768804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.768907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.768986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.769011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.769171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.769338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.769365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.769514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.769595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.769621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.769741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.769874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.769901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.770031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.770142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.770171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.770283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.771064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.771098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.771227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.771342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.771370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.771445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.771557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.771583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.771698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.771814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.771839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.771921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.772012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.772038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.772156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.772242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.202 [2024-10-30 16:14:06.772276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.202 qpair failed and we were unable to recover it. 00:30:17.202 [2024-10-30 16:14:06.772400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.772514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.772539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.772637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.772752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.772777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.772882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.772969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.772994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.773131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.773244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.773280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.773418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.774318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.774351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.774557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.774680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.774707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.774833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.774950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.774975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.775730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.775885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.775912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.776016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.776094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.776119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.776216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.776363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.776390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.776484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.776591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.776620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.776715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.776827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.776854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.776941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.777030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.777056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.777141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.777278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.777304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.777455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.777569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.777595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.777702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.777791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.777817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.777900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.778012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.778038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.778127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.778213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.778239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.778336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.778410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.778447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.778537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.778651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.778678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.778790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.778901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.778927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.779049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.779192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.779217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.779317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.779413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.779439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.779537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.779622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.779648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.779747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.779860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.779886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.779969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.780109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.780135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.780281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.780397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.780423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.780512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.780664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.780693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.780793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.780889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.780918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.781032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.781162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.781190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.203 qpair failed and we were unable to recover it. 00:30:17.203 [2024-10-30 16:14:06.781318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.781400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.203 [2024-10-30 16:14:06.781425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.781517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.781597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.781622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.781734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.781846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.781871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.781999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.782126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.782154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.782269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.782413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.782439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.782523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.782598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.782640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.782759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.782852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.782880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.783054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.783140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.783169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.783341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.783452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.783478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.783595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.783730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.783755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.783869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.783972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.784001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.784187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.784274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.784318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.784411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.784501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.784526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.784614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.784762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.784787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.784884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.784973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.785006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.785104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.785215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.785240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.785366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.785449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.785474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.785557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.785698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.785725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.785874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.785988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.786016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.786172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.786278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.786315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.786456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.786554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.786580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.786725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.786801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.786844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.786936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.787022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.787051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.787203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.787285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.787312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.787403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.787519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.787549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.787636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.787748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.787773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.787909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.788027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-10-30 16:14:06.788055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.204 qpair failed and we were unable to recover it. 00:30:17.204 [2024-10-30 16:14:06.788158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.788307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.788334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.788436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.788578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.788603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.788689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.788821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.788849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.788974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.789073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.789101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.789229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.789325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.789351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.789445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.789537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.789563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.789678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.789835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.789863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.789981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.790109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.790137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.790287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.790370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.790396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.790534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.790650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.790678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.790830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.790955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.790983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.791114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.791270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.791324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.791418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.791528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.791553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.791676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.791795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.791822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.791941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.792062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.792091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.792180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.792315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.792341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.792430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.792542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.792567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.792704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.792854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.792883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.793012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.793125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.793153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.793269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.793375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.793400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.793492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.793603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.793629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.793732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.793880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.793908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.794027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.794142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.794170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.794313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.794401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.794426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.794509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.794646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.794671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.794778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.794900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.794927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.795052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.795171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.795198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.795341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.795459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.795484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.795625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.795728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.795756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.795878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.796052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.796092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.205 qpair failed and we were unable to recover it. 00:30:17.205 [2024-10-30 16:14:06.796223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.796358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-10-30 16:14:06.796384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.796468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.796577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.796605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.796716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.796807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.796836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.796998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.797123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.797148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.797269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.797393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.797419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.797557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.797679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.797707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.797891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.797985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.798017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.798144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.798249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.798302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.798395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.798487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.798518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.798606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.798762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.798790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.798944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.799081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.799109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.799271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.799375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.799400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.799510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.799665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.799703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.799800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.799904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.799929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.800093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.800211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.800237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.800335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.800465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.800492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.800625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.800793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.800817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.800933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.801043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.801068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.801183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.801305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.801339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.801484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.801577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.801603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.801728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.801852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.801877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.801988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.802097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.802123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.802216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.802317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.802342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.802419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.802535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.802560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.802676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.802759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.802784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.802926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.803066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.803091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.803219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.803371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.803400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.803546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.803705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.803730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.803843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.803923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.803948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.804074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.804186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.804212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.804346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.804455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.804480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.206 qpair failed and we were unable to recover it. 00:30:17.206 [2024-10-30 16:14:06.804565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-10-30 16:14:06.804674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.804700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.804793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.804869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.804895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.804992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.805129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.805154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.805279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.805431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.805456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.805567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.805676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.805701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.805815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.805898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.805923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.806036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.806141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.806166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.806267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.806413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.806439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.806563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.806684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.806710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.806845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.806953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.806979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.807105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.807189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.807214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.807312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.807426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.807452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.807531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.807618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.807643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.807722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.807859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.807884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.808030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.808136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.808161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.808322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.808433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.808458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.808578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.808656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.808681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.808759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.808859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.808884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.808965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.809052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.809078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.809223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.809353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.809379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.809488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.809598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.809624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.809710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.809788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.809813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.809953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.810059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.810094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.810181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.810308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.810334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.810471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.810594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.810621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.810764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.810881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.810906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.811043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.811139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.811164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.811284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.811399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.811426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.811567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.811707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.811732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.811822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.811907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.811933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.207 [2024-10-30 16:14:06.812047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.812168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-10-30 16:14:06.812193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.207 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.812318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.812424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.812449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.812589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.812681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.812707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.812844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.812959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.812984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.813116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.813208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.813232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.813373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.813448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.813474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.813553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.813717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.813742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.813862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.814005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.814030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.814183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.814275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.814308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.814424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.814535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.814562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.814703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.814815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.814840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.814960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.815037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.815062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.815197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.815347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.815373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.815489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.815615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.815640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.815778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.815865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.815890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.816035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.816149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.816174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.816264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.816373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.816399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.816493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.816632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.816657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.816747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.816823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.816848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.817001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.817080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.817104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.817199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.817293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.817325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.817423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.817534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.817559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.817645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.817757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.817782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.817924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.818065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.818090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.818228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.818357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.818383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.818464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.818556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.818585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.818675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.818826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.818854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.818947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.819053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.208 [2024-10-30 16:14:06.819081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.208 qpair failed and we were unable to recover it. 00:30:17.208 [2024-10-30 16:14:06.819182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.819328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.819355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.819467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.819592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.819620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.819746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.819872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.819900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.819996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.820081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.820108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.820212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.820383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.820409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.820568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.820659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.820687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.820839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.820956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.820984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.821084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.821232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.821267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.821396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.821515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.821541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.821667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.821826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.821855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.822009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.822177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.822202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.822297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.822382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.822407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.822529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.822653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.822681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.822775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.822880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.822904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.823045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.823134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.823160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.823278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.823370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.823394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.823504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.823639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.823664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.823745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.823825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.823850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.823967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.824078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.824103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.824184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.824327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.824353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.824437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.824514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.824550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.824669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.824781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.824807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.824916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.825055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.825080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.825165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.825282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.825308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.825421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.825559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.825584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.825663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.825797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.825822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.825963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.826072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.826098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.826241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.826343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.826386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.826489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.826569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.826594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.826711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.826821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.826846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.209 qpair failed and we were unable to recover it. 00:30:17.209 [2024-10-30 16:14:06.826992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.827072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.209 [2024-10-30 16:14:06.827097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.827210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.827290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.827321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.827436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.827581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.827607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.827745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.827829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.827854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.827971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.828087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.828112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.828203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.828276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.828302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.828410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.828549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.828575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.828687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.828794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.828819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.828933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.829036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.829061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.829173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.829291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.829326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.829412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.829531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.829557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.829635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.829749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.829774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.829923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.830002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.830028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.830132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.830272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.830321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.830473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.830591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.830633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.830790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.830928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.830953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.831034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.831111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.831136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.831245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.831399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.831433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.831599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.831708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.831734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.831819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.831931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.831956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.832099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.832183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.832209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.832300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.832421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.832447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.832569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.832672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.832700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.832861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.832954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.832982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.833078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.833184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.833209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.833341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.833423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.833448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.833540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.833698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.833725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.833848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.833998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.834026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.834128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.834231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.834264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.834357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.834467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.834492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.834646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.834759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.834792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.210 qpair failed and we were unable to recover it. 00:30:17.210 [2024-10-30 16:14:06.834898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.210 [2024-10-30 16:14:06.835027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.835056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.835231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.835366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.835393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.835493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.835608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.835635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.835726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.835874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.835900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.835985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.836066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.836092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.836208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.836329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.836357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.836474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.836593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.836621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.836734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.836825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.836852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.836945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.837025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.837053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.837168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.837309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.837336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.837438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.837570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.837596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.837680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.837813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.837839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.837960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.838069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.838095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.838206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.838328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.838354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.838502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.838584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.838610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.838722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.838801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.838827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.838907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.838995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.839022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.839134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.839213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.839240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.839394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.839549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.839575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.839689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.839811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.839837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.839958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.840069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.840095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.840177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.840298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.840336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.840436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.840581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.840607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.840745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.840831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.840858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.840938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.841052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.841079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.841189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.841309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.841336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.841462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.841552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.841578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.841693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.841789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.841816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.841902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.841987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.842015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.842097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.842239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.842277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.211 qpair failed and we were unable to recover it. 00:30:17.211 [2024-10-30 16:14:06.842368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.842486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.211 [2024-10-30 16:14:06.842512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.842623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.842741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.842767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.842881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.842994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.843020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.843160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.843289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.843315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.843434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.843558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.843584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.843664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.843774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.843800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.843949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.844030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.844056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.844173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.844263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.844290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.844419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.844502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.844530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.844673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.844787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.844812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.844900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.844984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.845010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.845126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.845213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.845239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.845381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.845499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.845526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.845632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.845743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.845768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.845873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.846011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.846037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.846123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.846239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.846273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.846391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.846474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.846500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.846589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.846733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.846759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.846875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.846967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.846992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.847128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.847214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.847239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.847364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.847504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.847539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.847624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.847710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.847739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.847849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.847989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.848015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.848103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.848239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.848273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.848375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.848491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.848516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.848632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.848718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.848743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.848834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.848946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.848971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.212 qpair failed and we were unable to recover it. 00:30:17.212 [2024-10-30 16:14:06.849091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.212 [2024-10-30 16:14:06.849201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.849226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.849377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.849494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.849521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.849639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.849717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.849743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.849878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.849990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.850034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.850166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.850242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.850281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.850373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.850456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.850482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.850600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.850707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.850733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.850871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.850961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.850988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.851135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.851276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.851307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.851427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.851546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.851572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.851712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.851823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.851849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.851964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.852059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.852085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.852195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.852274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.852310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.852455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.852551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.852577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.852690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.852781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.852811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.852892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.853031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.853058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.853194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.853319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.853346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.853432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.853564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.853590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.853676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.853791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.853816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.853929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.854010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.854036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.854145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.854262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.854295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.854437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.854534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.854560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.854665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.854788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.854813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.854930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.855011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.855037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.855149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.855270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.855310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.855425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.855536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.855562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.855699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.855810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.855838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.855947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.856059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.856086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.856194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.856334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.856361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.856479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.856609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.856634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.213 [2024-10-30 16:14:06.856728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.856810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.213 [2024-10-30 16:14:06.856837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.213 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.856952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.857034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.857059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.857171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.857278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.857316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.857428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.857511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.857542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.857647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.857783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.857814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.857900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.857985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.858011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.858125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.858232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.858264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.858384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.858472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.858497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.858640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.858717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.858742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.858860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.858985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.859010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.859096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.859176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.859204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.859337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.859452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.859478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.859557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.859697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.859726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.859855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.859939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.859965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.860070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.860149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.860175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.860275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.860385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.860411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.860494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.860582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.860608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.860756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.860857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.860882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.860972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.861081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.861106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.861249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.861333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.861359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.861468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.861580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.861607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.861718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.861830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.861855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.861964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.862073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.862099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.862215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.862310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.862337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.862414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.862524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.862551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.862646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.862760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.862787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.862899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.863040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.863066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.863158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.863270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.863297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.863380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.863519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.863545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.863659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.863797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.863823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.863904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.864014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.214 [2024-10-30 16:14:06.864040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.214 qpair failed and we were unable to recover it. 00:30:17.214 [2024-10-30 16:14:06.864158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.864240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.864275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.864392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.864534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.864561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.864651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.864765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.864791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.864875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.864990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.865017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.865170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.865274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.865302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.865409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.865519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.865545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.865632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.865722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.865748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.865835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.865945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.865972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.866091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.866203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.866229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.866325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.866435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.866461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.866548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.866659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.866685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.866800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.866912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.866937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.867051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.867136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.867163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.867299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.867439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.867464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.867593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.867713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.867739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.867825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.867937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.867963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.868043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.868155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.868181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.868322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.868408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.868434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.868574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.868686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.868713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.868822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.868965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.868991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.869114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.869226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.869252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.869375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.869455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.869481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.869560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.869697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.869722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.869812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.869894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.869919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.870058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.870195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.870221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.870313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.870458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.870485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.870627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.870714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.870741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.870819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.870926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.870953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.871076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.871187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.871213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.871329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.871409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.871436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.215 qpair failed and we were unable to recover it. 00:30:17.215 [2024-10-30 16:14:06.871550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.871660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.215 [2024-10-30 16:14:06.871686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.871805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.871913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.871939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.872053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.872125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.872151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.872268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.872381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.872407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.872522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.872606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.872634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.872715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.872831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.872858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.872999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.873086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.873112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.873226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.873334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.873361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.873505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.873591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.873617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.873729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.873873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.873899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.873984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.874075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.874102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.874216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.874312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.874339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.874457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.874548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.874574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.874660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.874775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.874801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.874896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.875005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.875031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.875125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.875270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.875296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.875412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.875523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.875549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.875666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.875745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.875771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.875891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.876003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.876030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.876142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.876223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.876248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.876371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.876460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.876486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.876565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.876671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.876698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.876831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.876917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.876944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.877085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.877162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.877188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.877295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.877411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.877438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.877580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.877694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.877721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.877848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.877931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.877957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.878039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.878152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.878179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.878297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.878414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.878439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.216 qpair failed and we were unable to recover it. 00:30:17.216 [2024-10-30 16:14:06.878561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.878645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.216 [2024-10-30 16:14:06.878671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.878760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.878845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.878873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.878984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.879096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.879122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.879241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.879386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.879412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.879515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.879594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.879620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.879729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.879843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.879870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.879981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.880072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.880099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.880214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.880336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.880363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.880477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.880582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.880608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.880720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.880802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.880828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.880968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.881053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.881079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.881195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.881309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.881337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.881443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.881553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.881578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.881693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.881808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.881834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.881921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.882006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.882032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.882121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.882241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.882299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.882420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.882558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.882584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.882694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.882766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.882793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.882884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.882999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.883025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.883111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.883192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.883217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.883342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.883423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.883451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.883542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.883628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.883655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.883765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.883912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.883937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.884045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.884126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.884153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.884264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.884355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.884382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.884533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.884655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.884681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.884828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.884971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.884997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.885116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.885264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.885291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.885382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.885465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.217 [2024-10-30 16:14:06.885492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.217 qpair failed and we were unable to recover it. 00:30:17.217 [2024-10-30 16:14:06.885603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.885718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.885744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.885825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.885932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.885958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.886041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.886178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.886204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.886299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.886406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.886431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.886517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.886628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.886653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.886746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.886865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.886891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.887001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.887085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.887113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.887268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.887355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.887382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.887499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.887582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.887608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.887688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.887770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.887796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.887926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.888002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.888029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.888118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.888233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.888266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.888387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.888467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.888494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.888576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.888716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.888742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.888853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.888936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.888964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.889070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.889175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.889203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.889294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.889383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.889414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.889560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.889646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.889672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.889805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.889914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.889940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.890050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.890163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.890189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.890305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.890386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.890412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.890551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.890641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.890667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.890757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.890872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.890898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.891035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.891152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.891178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.891267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.891386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.891412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.891527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.891632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.891663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.891776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.891861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.891892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.891984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.892130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.892156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.892248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.892340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.892366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.892481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.892594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.892620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.218 qpair failed and we were unable to recover it. 00:30:17.218 [2024-10-30 16:14:06.892706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.218 [2024-10-30 16:14:06.892813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.892839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.892955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.893060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.893086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.893194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.893284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.893310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.893395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.893503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.893529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.893644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.893780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.893806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.893925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.894064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.894090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.894208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.894295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.894327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.894444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.894556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.894583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.894691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.894833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.894858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.894957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.895074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.895100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.895244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.895359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.895385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.895494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.895586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.895614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.895707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.895821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.895847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.895966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.896053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.896080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.896199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.896290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.896316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.896435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.896544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.896570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.896654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.896766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.896797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.896897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.896979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.897006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.897148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.897235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.897269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.897399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.897484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.897510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.897620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.897758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.897784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.897893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.898031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.898057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.898169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.898275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.898303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.898421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.898534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.898559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.898673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.898813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.898839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.898935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.899073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.899099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.899184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.899300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.899328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.899445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.899525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.899552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.899667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.899780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.899807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.899926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.900038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.900064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.219 [2024-10-30 16:14:06.900176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.900265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.219 [2024-10-30 16:14:06.900292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.219 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.900387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.900470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.900496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.900637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.900719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.900745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.900865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.900960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.900987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.901099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.901178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.901204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.901298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.901387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.901414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.901555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.901697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.901723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.901821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.901937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.901963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.902104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.902239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.902284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.902379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.902462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.902490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.902608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.902695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.902720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.902864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.902974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.902999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.903095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.903241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.903277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.903394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.903484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.903510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.903650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.903732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.903760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.903907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.904054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.904083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.904228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.904327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.904369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.904545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.904647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.904690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.904883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.905026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.905052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.905168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.905282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.905309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.905401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.905507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.905533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.905644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.905725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.905751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.905862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.905975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.906001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.906148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.906290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.906317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.906435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.906532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.906559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.906665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.906771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.906797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.906882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.907019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.907045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.907172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.907286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.907313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.907427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.907576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.907603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.907688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.907811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.907837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.907965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.908074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.220 [2024-10-30 16:14:06.908116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.220 qpair failed and we were unable to recover it. 00:30:17.220 [2024-10-30 16:14:06.908250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.908346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.908372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.908489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.908608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.908634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.908746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.908863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.908889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.908983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.909169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.909196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.909299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.909389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.909415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.909503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.909614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.909641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.909789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.909905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.909932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.910046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.910138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.910165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.910278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.910364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.910390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.910476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.910614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.910639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.910777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.910891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.910918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.911001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.911117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.911143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.911226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.911357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.911386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.911488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.911637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.911679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.911838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.911957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.911984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.912127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.912267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.912294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.912417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.912496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.912523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.912636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.912724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.912752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.912837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.912919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.912946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.913054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.913168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.913193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.913306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.913418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.913444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.913532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.913674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.913699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.913820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.913969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.913994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.914137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.914218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.914245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.914370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.914478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.914504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.914583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.914696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.914722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.914869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.914985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.221 [2024-10-30 16:14:06.915011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.221 qpair failed and we were unable to recover it. 00:30:17.221 [2024-10-30 16:14:06.915123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.915213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.915239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.915338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.915433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.915460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.915572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.915690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.915717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.915831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.915951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.915977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.916113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.916223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.916249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.916350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.916469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.916495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.916612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.916690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.916716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.916835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.916944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.916969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.917056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.917169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.917196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.917360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.917508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.917542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.917697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.917860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.917904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.918047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.918168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.918195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.918313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.918402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.918429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.918572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.918661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.918689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.918801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.918914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.918941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.919028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.919109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.919134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.919253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.919352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.919378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.919500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.919620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.919646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.919733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.919870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.919896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.920011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.920128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.920155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.920235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.920355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.920382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.920470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.920590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.920616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.920734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.920817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.920843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.920954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.921089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.921116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.921204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.921287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.921312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.921451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.921567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.921594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.921723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.921839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.921865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.921958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.922062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.922087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.922173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.922279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.922305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.922425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.922521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.922546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.222 qpair failed and we were unable to recover it. 00:30:17.222 [2024-10-30 16:14:06.922626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.222 [2024-10-30 16:14:06.922753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.922778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.922860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.923002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.923028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.923166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.923280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.923307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.923440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.923552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.923580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.923682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.923800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.923826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.923943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.924055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.924082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.924227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.924339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.924368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.924470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.924557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.924582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.924700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.924814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.924840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.924959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.925076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.925103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.925243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.925365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.925392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.925499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.925604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.925633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.925795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.925914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.925940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.926030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.926145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.926173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.926269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.926381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.926407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.926522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.926658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.926688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.926827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.926968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.926995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.927107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.927218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.927244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.927378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.927532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.927561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.927715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.927849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.927876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.928025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.928138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.928165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.928279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.928415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.928441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.928528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.928635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.928661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.928740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.928829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.928854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.928947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.929090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.929116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.929211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.929357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.929384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.929477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.929589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.929615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.929694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.929833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.929858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.929951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.930024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.930050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.930189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.930317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.930349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.223 qpair failed and we were unable to recover it. 00:30:17.223 [2024-10-30 16:14:06.930465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.223 [2024-10-30 16:14:06.930621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.930647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.930737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.930815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.930840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.930985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.931070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.931095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.931207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.931304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.931331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.931444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.931554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.931580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.931693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.931803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.931829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.931943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.932034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.932061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.932172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.932285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.932311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.932400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.932516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.932542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.932660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.932798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.932828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.932951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.933069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.933094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.933233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.933347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.933373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.933486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.933576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.933603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.933719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.933800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.933826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.933943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.934059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.934085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.934178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.934308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.934336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.934419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.934558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.934584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.934702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.934809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.934836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.934931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.935061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.935088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.935230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.935351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.935381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.935472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.935586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.935612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.935727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.935867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.935893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.935985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.936126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.936151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.936266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.936346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.936372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.936488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.936621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.936647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.936778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.936892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.936919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.937048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.937160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.937188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.937302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.937412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.937438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.937551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.937668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.937694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.937776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.937895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.937921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.224 [2024-10-30 16:14:06.938019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.938156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.224 [2024-10-30 16:14:06.938182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.224 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.938324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.938441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.938468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.938584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.938712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.938738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.938851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.938958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.938984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.939074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.939188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.939216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.939306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.939412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.939439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.939532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.939676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.939702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.939793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.939897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.939923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.940069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.940153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.940180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.940268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.940376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.940402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.940518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.940631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.940657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.940743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.940854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.940879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.941023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.941109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.941135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.941330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.941452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.941479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.941594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.941734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.941760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.941878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.941960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.941985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.942106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.942308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.942336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.942506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.942664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.942690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.942771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.942854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.942880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.943002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.943121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.943148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.943275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.943419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.943444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.943564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.943677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.943702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.943792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.943936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.943962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.944156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.944268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.944295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.944376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.944517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.944543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.944671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.944829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.944856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.944994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.945107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.945133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.945282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.945374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.225 [2024-10-30 16:14:06.945401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.225 qpair failed and we were unable to recover it. 00:30:17.225 [2024-10-30 16:14:06.945544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.945660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.945687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.945797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.945910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.945937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.946054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.946133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.946159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.946279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.946394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.946421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.946578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.946694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.946720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.946829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.946909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.946935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.947057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.947176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.947202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.947349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.947484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.947510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.947656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.947851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.947876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.948013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.948148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.948173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.948289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.948486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.948530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.948655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.948812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.948838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.948938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.949049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.949076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.949188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.949305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.949332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.949442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.949524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.949550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.949637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.949719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.949745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.949886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.949973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.950000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.950113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.950220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.950245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.950367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.950481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.950507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.950592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.950706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.950732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.950875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.950962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.950990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.951102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.951183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.951209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.951366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.951479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.951505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.951590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.951703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.951732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.951930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.952069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.952095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.952209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.952376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.952420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.952550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.952659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.952685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.952803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.952912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.952938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.953051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.953169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.953196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.953336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.953450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.226 [2024-10-30 16:14:06.953476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.226 qpair failed and we were unable to recover it. 00:30:17.226 [2024-10-30 16:14:06.953557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.953674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.953701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.953792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.953983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.954009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.954154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.954278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.954305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.954413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.954529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.954555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.954671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.954784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.954812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.954927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.955018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.955045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.955166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.955249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.955282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.955423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.955561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.955586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.955702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.955813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.955840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.955953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.956036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.956063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.956187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.956306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.956334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.956454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.956646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.956672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.956766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.956906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.956932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.957045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.957156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.957185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.957322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.957503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.957531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.957671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.957777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.957804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.957919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.958036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.958063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.958178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.958270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.958298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.958419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.958533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.958558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.958674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.958811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.958837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.958977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.959059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.959085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.959203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.959282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.959309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.959429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.959548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.959574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.959683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.959760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.959785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.959874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.959986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.960013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.960099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.960237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.960270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.960368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.960505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.960531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.960621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.960756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.960781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.960899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.961005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.961030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.961136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.961246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.961282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.227 qpair failed and we were unable to recover it. 00:30:17.227 [2024-10-30 16:14:06.961405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.227 [2024-10-30 16:14:06.961551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.961577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.961659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.961744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.961771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.961890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.961976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.962002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.962084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.962197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.962224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.962354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.962466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.962492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.962587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.962669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.962695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.962810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.962897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.962923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.963012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.963123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.963149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.963284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.963399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.963426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.963556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.963636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.963662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.963783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.963898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.963924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.964051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.964162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.964190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.964313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.964422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.964449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.964591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.964696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.964722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.964835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.964913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.964939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.965027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.965142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.965167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.965266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.965375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.965401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.965538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.965652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.965679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.965802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.965883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.965908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.966048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.966190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.966216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.966356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.966473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.966501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.966609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.966685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.966712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.966821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.966911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.966938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.967052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.967123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.967149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.967269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.967353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.967380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.967496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.967579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.967605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.967693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.967799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.967825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.967941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.968049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.968074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.968195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.968306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.968333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.968421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.968535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.968562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.228 qpair failed and we were unable to recover it. 00:30:17.228 [2024-10-30 16:14:06.968712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.968829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.228 [2024-10-30 16:14:06.968856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.968997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.969111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.969137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.969289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.969425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.969472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.969615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.969704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.969730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.969844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.969934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.969962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.970101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.970248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.970302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.970436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.970583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.970626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.970734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.970834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.970861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.970977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.971089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.971115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.971237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.971336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.971364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.971460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.971545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.971572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.971693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.971798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.971823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.971917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.972000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.972031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.972120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.972235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.972272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.972408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.972553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.972579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.972693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.972831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.972857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.972987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.973139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.973165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.973284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.973373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.973401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.973520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.973665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.973691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.973800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.973916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.973942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.974052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.974169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.974195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.974331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.974477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.974502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.974617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.974731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.974762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.974877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.974960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.974988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.975107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.975200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.975226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.975345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.975480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.975507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.975654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.975744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.975772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.229 qpair failed and we were unable to recover it. 00:30:17.229 [2024-10-30 16:14:06.975912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.975990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.229 [2024-10-30 16:14:06.976015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.976109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.976199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.976227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.976374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.976483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.976508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.976633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.976749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.976775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.976887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.977031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.977057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.977196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.977314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.977346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.977466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.977551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.977578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.977713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.977833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.977859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.977976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.978058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.978085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.978206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.978314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.978345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.978496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.978677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.978705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.978838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.978953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.978979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.979072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.979152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.979178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.979278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.979391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.979417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.979526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.979661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.979688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.979804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.979944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.979970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.980059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.980173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.980200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.980322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.980466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.980510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.980596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.980710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.980736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.980826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.980946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.980972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.981085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.981193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.981219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.981308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.981419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.981445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.981596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.981683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.981710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.981823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.981931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.981957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.982043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.982185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.982212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.982308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.982421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.982447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.982535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.982674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.982700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.982818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.982956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.982982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.983124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.983215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.983243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.983395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.983555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.983607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.230 qpair failed and we were unable to recover it. 00:30:17.230 [2024-10-30 16:14:06.983725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.983814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.230 [2024-10-30 16:14:06.983840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.983923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.984036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.984063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.984183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.984302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.984330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.984446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.984529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.984555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.984650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.984768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.984795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.984912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.985053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.985079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.985193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.985325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.985352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.985464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.985549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.985575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.985694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.985770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.985797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.985910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.986025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.986051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.986169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.986284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.986323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.986432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.986545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.986571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.986689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.986799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.986825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.986911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.987022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.987049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.987160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.987242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.987278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.987419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.987583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.987625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.987744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.987858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.987886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.987969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.988086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.988112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.988233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.988338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.988364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.988449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.988564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.988590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.988730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.988842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.988868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.988950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.989035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.989062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.989173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.989299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.989325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.989451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.989524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.989549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.989667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.989746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.989771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.989913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.990023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.990048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.990141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.990289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.990316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.990427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.990555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.990580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.990661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.990749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.990775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.990863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.990982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.991008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.991087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.991203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.231 [2024-10-30 16:14:06.991230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.231 qpair failed and we were unable to recover it. 00:30:17.231 [2024-10-30 16:14:06.991342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.991451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.991476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.991593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.991703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.991729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.991842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.991971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.991997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.992097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.992234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.992267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.992400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.992579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.992623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.992757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.992915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.992941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.993053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.993164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.993191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.993333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.993456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.993484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.993619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.993766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.993792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.993884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.994014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.994042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.994159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.994238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.994271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.994418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.994533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.994558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.994645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.994761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.994789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.994906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.994988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.995015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.995099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.995205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.995231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.995333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.995418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.995445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.995571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.995682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.995707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.995824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.995907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.995934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.996047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.996160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.996185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.996344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.996493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.996537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.996649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.996760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.996786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.996873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.997064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.997089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.997198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.997348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.997375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.997497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.997615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.997641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.997736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.997881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.997907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.997995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.998085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.998110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.998194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.998312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.998339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.998484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.998593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.998619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.998763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.998875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.998903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.999041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.999155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.999182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.232 qpair failed and we were unable to recover it. 00:30:17.232 [2024-10-30 16:14:06.999326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.232 [2024-10-30 16:14:06.999460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:06.999486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:06.999583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:06.999720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:06.999745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:06.999837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:06.999911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:06.999936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.000047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.000190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.000216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.000349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.000444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.000470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.000600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.000711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.000737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.000828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.000966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.000992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.001098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.001204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.001230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.001357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.001441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.001468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.001573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.001713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.001740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.001851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.001993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.002019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.002141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.002228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.002272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.002371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.002514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.002540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.002660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.002800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.002825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.002938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.003045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.003071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.003182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.003381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.003410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.003525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.003611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.003638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.003784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.003895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.003921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.004004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.004150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.004176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.004272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.004369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.004399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.004499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.004586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.004611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.004744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.004823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.004849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.004965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.005044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.005070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.005191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.005310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.005337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.005475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.005596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.005623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.005724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.005842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.005870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.005961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.006076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.006103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.006183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.006273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.006301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.006390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.006499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.006525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.006616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.006694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.006721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.233 qpair failed and we were unable to recover it. 00:30:17.233 [2024-10-30 16:14:07.006837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.006947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.233 [2024-10-30 16:14:07.006973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.007057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.007175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.007201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.007351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.007505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.007548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.007642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.007733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.007761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.007841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.007963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.007990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.008105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.008224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.008251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.008372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.008454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.008481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.008599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.008740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.008766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.008880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.008996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.009023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.009142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.009273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.009300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.009424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.009515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.009543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.009659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.009798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.009823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.009940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.010088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.010115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.010226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.010395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.010423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.010540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.010624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.010651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.010795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.010923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.010954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.011104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.011193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.011219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.011361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.011514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.011542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.011686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.011781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.011807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.011927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.012006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.012032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.012149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.012286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.012312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.012400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.012482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.012509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.012602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.012745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.012771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.012864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.013003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.013029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.013172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.013309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.013336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.013453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.013561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.013593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.013708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.013823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.013848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.234 [2024-10-30 16:14:07.013970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.014061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.234 [2024-10-30 16:14:07.014087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.234 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.014227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.014320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.014347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.014426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.014565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.014592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.014733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.014851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.014876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.014969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.015080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.015107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.015219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.015367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.015394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.015527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.015635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.015662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.015767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.015855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.015881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.016029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.016144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.016175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.016288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.016380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.016407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.016499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.016644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.016670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.016786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.016899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.016925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.017043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.017187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.017214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.017354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.017513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.017539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.017620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.017710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.017737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.017857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.017968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.017994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.018081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.018197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.018224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.018320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.018447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.018473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.018582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.018700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.018729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.018854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.018937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.018964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.019092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.019206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.019232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.019399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.019571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.019615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.019724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.019861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.019887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.020006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.020112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.020139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.020247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.020361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.020388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.020529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.020643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.020668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.020763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.020848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.020874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.020995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.021112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.021138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.021247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.021368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.021394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.021546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.021625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.021651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.021790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.021878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.235 [2024-10-30 16:14:07.021904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.235 qpair failed and we were unable to recover it. 00:30:17.235 [2024-10-30 16:14:07.021987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.022081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.022108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.022223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.022362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.022389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.022480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.022562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.022587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.022691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.022775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.022800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.022891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.023029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.023055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.023172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.023264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.023292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.023411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.023496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.023522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.023611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.023719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.023746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.023839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.023977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.024003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.024146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.024231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.024265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.024384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.024498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.024524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.024667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.024752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.024777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.024862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.024937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.024963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.025078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.025190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.025217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.025311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.025427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.025454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.025569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.025679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.025706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.025792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.025907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.025933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.026050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.026166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.026192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.026293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.026405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.026431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.026513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.026659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.026685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.026779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.026864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.026890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.027010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.027095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.027120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.027215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.027299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.027326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.027416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.027531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.027558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.027678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.027789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.027816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.027970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.028109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.028135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.028253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.028371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.028415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.028534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.028645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.028671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.028758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.028873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.028900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.028986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.029126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.029151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.236 qpair failed and we were unable to recover it. 00:30:17.236 [2024-10-30 16:14:07.029265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.236 [2024-10-30 16:14:07.029382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.029408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.029518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.029599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.029624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.029744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.029887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.029913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.030027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.030105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.030131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.030247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.030379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.030406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.030487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.030601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.030627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.030771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.030890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.030916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.030993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.031105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.031132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.031263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.031369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.031398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.031524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.031666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.031693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.031816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.031926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.031951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.032056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.032178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.032205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.032322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.032432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.032458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.032551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.032665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.032691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.032807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.032917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.032943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.033058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.033173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.033199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.033321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.033484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.033528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.033644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.033753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.033780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.033898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.034013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.034039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.034129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.034248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.034282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.034372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.034509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.034535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.034623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.034737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.034763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.034850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.034968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.034995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.035084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.035198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.035224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.035375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.035492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.035518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.035643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.035803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.035829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.035974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.036087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.036113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.036198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.036283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.036310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.036430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.036534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.036560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.036667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.036752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.036777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.237 qpair failed and we were unable to recover it. 00:30:17.237 [2024-10-30 16:14:07.036900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.036982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.237 [2024-10-30 16:14:07.037010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.037092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.037199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.037226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.037367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.037482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.037508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.037590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.037682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.037709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.037801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.037942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.037968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.038042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.038130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.038156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.038281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.038421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.038448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.038536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.038652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.038678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.038766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.038898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.038924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.039041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.039145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.039171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.039266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.039381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.039408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.039518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.039600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.039626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.039744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.039850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.039875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.039970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.040082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.040108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.040220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.040342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.040369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.040451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.040531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.040558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.040681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.040767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.040793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.040907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.041020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.041047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.041162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.041313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.041340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.041450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.041535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.041563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.041658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.041742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.041768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.041851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.041953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.041980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.042065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.042169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.042196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.042307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.042384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.042410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.042547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.042692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.042718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.042862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.042974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.043001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.043095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.043186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.043212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.043313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.043447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.043492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.238 [2024-10-30 16:14:07.043586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.043722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.238 [2024-10-30 16:14:07.043749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.238 qpair failed and we were unable to recover it. 00:30:17.239 [2024-10-30 16:14:07.043887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.521 [2024-10-30 16:14:07.044029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.044055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.044134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.044243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.044277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.044435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.044600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.044626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.044743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.044853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.044879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.044986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.045105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.045131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.045227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.045336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.045363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.045476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.045584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.045610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.045701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.045814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.045842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.045930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.046007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.046033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.046172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.046278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.046310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.046434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.046580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.046607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.046723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.046802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.046827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.046937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.047049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.047076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.047161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.047270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.047297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.047416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.047497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.047530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.047681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.047791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.047818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.047908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.048015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.048041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.048159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.048236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.048275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.048396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.048524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.048550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.048671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.048788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.048814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.048929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.049048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.049077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.049219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.049344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.049371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.049485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.049571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.049598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.049743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.049827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.049853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.049964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.050046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.050073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.050160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.050247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.050283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.050410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.050492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.050519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.050636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.050752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.050778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.050928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.051041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.051068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.522 qpair failed and we were unable to recover it. 00:30:17.522 [2024-10-30 16:14:07.051152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.522 [2024-10-30 16:14:07.051238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.051276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.051368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.051460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.051486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.051643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.051729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.051755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.051836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.051918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.051945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.052034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.052182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.052208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.052366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.052467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.052496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.052650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.052784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.052811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.052959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.053099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.053125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.053229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.053318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.053345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.053476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.053585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.053611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.053687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.053773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.053805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.053891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.054006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.054033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.054173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.054289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.054322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.054409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.054494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.054520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.054637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.054751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.054776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.054877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.054989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.055015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.055091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.055177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.055205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.055314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.055398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.055425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.055550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.055661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.055687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.055776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.055913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.055940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.056079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.056162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.056194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.056309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.056420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.056447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.056573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.056658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.056685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.056801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.056906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.056932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.057074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.057220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.057246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.057398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.057573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.057599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.057731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.057854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.057881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.058002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.058109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.058136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.058214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.058348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.058375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.058493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.058606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.058632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.523 qpair failed and we were unable to recover it. 00:30:17.523 [2024-10-30 16:14:07.058713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.058792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.523 [2024-10-30 16:14:07.058819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.058915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.059057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.059083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.059205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.059353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.059397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.059509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.059627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.059656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.059792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.059900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.059925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.060023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.060138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.060164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.060254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.060401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.060427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.060550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.060631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.060657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.060757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.060838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.060864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.060953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.061090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.061117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.061230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.061321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.061348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.061495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.061587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.061614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.061710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.061820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.061846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.061985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.062080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.062106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.062221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.062319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.062346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.062423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.062568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.062594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.062717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.062798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.062825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.062935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.063040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.063066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.063180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.063271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.063309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.063409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.063520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.063546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.063671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.063811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.063837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.063951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.064071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.064097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.064223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.064319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.064348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.064454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.064557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.064584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.064731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.064845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.064872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.064957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.065073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.065101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.065213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.065343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.065369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.065463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.065548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.065575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.065694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.065776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.065803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.065922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.066004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.066030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.524 [2024-10-30 16:14:07.066140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.066215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.524 [2024-10-30 16:14:07.066241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.524 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.066374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.066492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.066518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.066642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.066722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.066749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.066862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.066970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.066997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.067089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.067201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.067227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.067350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.067433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.067460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.067571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.067680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.067707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.067780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.067921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.067946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.068068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.068176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.068202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.068282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.068416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.068445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.068600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.068744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.068771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.068887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.068998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.069023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.069141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.069277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.069303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.069406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.069502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.069528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.069640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.069757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.069783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.069896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.070006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.070032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.070169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.070271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.070299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.070411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.070502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.070528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.070624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.070702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.070729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.070867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.070976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.071003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.071143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.071254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.071288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.071379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.071485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.071511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.071632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.071717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.071743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.071828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.071937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.071963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.072045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.072150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.072176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.072294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.072404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.072430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.072550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.072657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.072683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.072763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.072836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.072862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.072981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.073072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.073099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.073243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.073330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.073356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.525 [2024-10-30 16:14:07.073505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.073608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.525 [2024-10-30 16:14:07.073635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.525 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.073779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.073887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.073912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.074001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.074137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.074163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.074295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.074414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.074440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.074584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.074667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.074694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.074776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.074861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.074888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.074995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.075078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.075105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.075195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.075311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.075338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.075460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.075544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.075570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.075662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.075746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.075772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.075889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.075996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.076021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.076106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.076247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.076282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.076371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.076519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.076545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.076660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.076743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.076769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.076852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.076948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.076973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.077055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.077174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.077200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.077344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.077457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.077484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.077601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.077722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.077748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.077861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.077944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.077971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.078084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.078224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.078250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.078397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.078514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.078540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.078652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.078735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.078762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.078901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.078987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.079013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.079121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.079232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.079267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.079389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.079535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.079561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.526 [2024-10-30 16:14:07.079676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.079794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.526 [2024-10-30 16:14:07.079820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.526 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.079908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.080021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.080048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.080134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.080214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.080240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.080391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.080464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.080490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.080571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.080712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.080737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.080849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.080990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.081016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.081129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.081219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.081246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.081363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.081467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.081493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.081579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.081688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.081714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.081824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.081931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.081957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.082041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.082150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.082176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.082269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.082362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.082388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.082481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.082600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.082628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.082747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.082831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.082859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.082939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.083054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.083080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.083229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.083377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.083404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.083487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.083632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.083658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.083746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.083861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.083887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.083968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.084042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.084068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.084177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.084286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.084313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.084427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.084537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.084564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.084679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.084770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.084797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.084880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.084957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.084984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.085098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.085237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.085270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.085359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.085448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.085475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.085585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.085668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.085694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.085802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.085895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.085921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.086036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.086117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.086145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.086229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.086389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.086416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.086561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.086676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.086701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.527 [2024-10-30 16:14:07.086791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.086903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.527 [2024-10-30 16:14:07.086928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.527 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.087046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.087163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.087190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.087276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.087390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.087417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.087536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.087652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.087679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.087760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.087901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.087928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.088047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.088127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.088153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.088268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.088380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.088410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.088523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.088660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.088686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.088801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.088940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.088966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.089084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.089201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.089227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.089346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.089460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.089486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.089567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.089658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.089684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.089767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.089873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.089899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.090045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.090129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.090155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.090282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.090404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.090432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.090549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.090638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.090665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.090776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.090882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.090913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.091061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.091134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.091161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.091274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.091400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.091426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.091533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.091631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.091657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.091776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.091856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.091882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.092027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.092140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.092166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.092308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.092417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.092442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.092536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.092645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.092671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.092755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.092835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.092861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.092949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.093055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.093082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.093221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.093337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.093368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.093481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.093593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.093620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.093735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.093823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.093850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.093935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.094048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.094073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.094160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.094303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.528 [2024-10-30 16:14:07.094331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.528 qpair failed and we were unable to recover it. 00:30:17.528 [2024-10-30 16:14:07.094445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.094551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.094577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.094685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.094770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.094799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.094917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.095032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.095058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.095163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.095273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.095300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.095406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.095534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.095560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.095678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.095791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.095822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.095980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.096096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.096121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.096231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.096344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.096370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.096484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.096572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.096599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.096712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.096818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.096845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.096934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.097077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.097103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.097222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.097368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.097395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.097482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.097578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.097605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.097714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.097826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.097851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.097940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.098023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.098049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.098132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.098247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.098283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.098400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.098513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.098539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.098677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.098767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.098795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.098910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.098999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.099025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.099173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.099346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.099373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.099500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.099631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.099658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.099748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.099887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.099913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.099996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.100106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.100132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.100248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.100341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.100368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.100453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.100566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.100591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.100704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.100822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.100848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.100964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.101105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.101132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.101217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.101341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.101368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.101464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.101636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.101662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.529 [2024-10-30 16:14:07.101774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.101889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.529 [2024-10-30 16:14:07.101915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.529 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.102034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.102142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.102168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.102290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.102408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.102434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.102547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.102654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.102680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.102815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.102928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.102954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.103092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.103204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.103231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.103369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.103458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.103486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.103630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.103772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.103798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.103887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.103971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.103996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.104112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.104227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.104253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.104396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.104487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.104512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.104631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.104703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.104729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.104839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.104947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.104973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.105055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.105143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.105168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.105285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.105402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.105428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.105573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.105660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.105686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.105799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.105928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.105955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.106099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.106243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.106275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.106395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.106479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.106505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.106615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.106704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.106730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.106850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.106967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.106992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.107103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.107185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.107210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.107306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.107400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.107426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.107547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.107687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.107713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.107826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.107938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.107965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.108076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.108166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.108193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.108274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.108387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.108413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.530 qpair failed and we were unable to recover it. 00:30:17.530 [2024-10-30 16:14:07.108563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.530 [2024-10-30 16:14:07.108698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.108724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.108804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.108918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.108944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.109058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.109173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.109199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.109328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.109473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.109502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.109636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.109746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.109772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.109875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.109983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.110008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.110128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.110243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.110289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.110435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.110546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.110572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.110683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.110772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.110800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.110916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.111007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.111033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.111158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.111268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.111295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.111405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.111513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.111540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.111682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.111792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.111818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.111911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.112017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.112043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.112163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.112245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.112278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.112400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.112508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.112534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.112649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.112761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.112786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.112896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.112975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.113001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.113115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.113193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.113219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.113341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.113481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.113507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.113651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.113735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.113762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.113838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.113956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.113981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.114095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.114178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.114205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.114339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.114428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.114454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.114566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.114649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.114675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.114795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.114883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.114910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.115022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.115133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.115160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.115299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.115438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.115465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.115544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.115685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.115712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.115824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.115905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.115930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.531 qpair failed and we were unable to recover it. 00:30:17.531 [2024-10-30 16:14:07.116045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.116184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.531 [2024-10-30 16:14:07.116210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.116363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.116452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.116478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.116618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.116698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.116724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.116812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.116929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.116956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.117052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.117196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.117221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.117323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.117403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.117429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.117548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.117660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.117687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.117778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.117892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.117918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.118009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.118124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.118151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.118233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.118380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.118407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.118491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.118605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.118632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.118730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.118816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.118843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.118939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.119016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.119042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.119137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.119251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.119286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.119375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.119460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.119488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.119568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.119660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.119686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.119798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.119883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.119915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.120007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.120089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.120115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.120228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.120348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.120375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.120494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.120583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.120608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.120727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.120844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.120870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.120951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.121069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.121095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.121182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.121323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.121350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.121438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.121547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.121573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.121659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.121801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.121827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.121944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.122052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.122077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.122196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.122276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.122302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.122422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.122554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.122597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.122711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.122855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.122881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.122967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.123114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.123140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.532 [2024-10-30 16:14:07.123229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.123318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.532 [2024-10-30 16:14:07.123345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.532 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.123517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.123635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.123661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.123754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.123860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.123887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.124002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.124145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.124171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.124282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.124374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.124401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.124521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.124659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.124685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.124780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.124870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.124896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.125006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.125083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.125109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.125223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.125320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.125348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.125466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.125576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.125602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.125734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.125856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.125882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.126003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.126109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.126134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.126217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.126333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.126361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.126435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.126542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.126568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.126659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.126769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.126797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.126890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.126994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.127021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.127133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.127246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.127282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.127371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.127508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.127534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.127647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.127759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.127786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.127867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.127979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.128006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.128117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.128226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.128266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.128360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.128436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.128462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.128548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.128630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.128657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.128796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.128879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.128905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.128984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.129092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.129118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.129243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.129361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.129387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.129499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.129623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.129649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.129757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.129839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.129866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.129979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.130057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.130084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.130164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.130272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.130300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.130390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.130474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.533 [2024-10-30 16:14:07.130504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.533 qpair failed and we were unable to recover it. 00:30:17.533 [2024-10-30 16:14:07.130646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.130783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.130808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.130926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.131012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.131039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.131150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.131272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.131300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.131407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.131506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.131532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.131610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.131721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.131746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.131862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.131972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.131998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.132110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.132200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.132227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.132349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.132457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.132482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.132596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.132678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.132704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.132845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.132959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.132989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.133111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.133190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.133216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.133391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.133502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.133529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.133615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.133703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.133730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.133811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.133921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.133949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.134027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.134169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.134197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.134320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.134416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.134443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.134517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.134654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.134680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.134796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.134878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.134904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.134985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.135098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.135124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.135238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.135361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.135392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.135520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.135594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.135621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.135730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.135812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.135838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.135949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.136064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.136091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.136178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.136291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.136318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.136467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.136558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.136584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.136727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.136804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.136829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.136918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.137031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.137056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.137185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.137337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.137364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.137482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.137636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.137662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.534 qpair failed and we were unable to recover it. 00:30:17.534 [2024-10-30 16:14:07.137750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.137861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.534 [2024-10-30 16:14:07.137888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.137973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.138089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.138115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.138234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.138374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.138402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.138479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.138563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.138590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.138709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.138818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.138844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.138957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.139081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.139108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.139267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.139354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.139381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.139494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.139605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.139631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.139770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.139885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.139911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.140023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.140096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.140122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.140232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.140354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.140381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.140524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.140633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.140660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.140750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.140842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.140870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.140952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.141077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.141103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.141247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.141364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.141390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.141502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.141586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.141613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.141763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.141843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.141870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.141985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.142104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.142129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.142227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.142375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.142420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.142534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.142647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.142672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.142756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.142896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.142923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.143067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.143182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.143209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.143380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.143524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.143568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.143726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.143832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.143860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.143977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.144092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.144118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.144198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.144277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.144305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.144435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.144521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.144549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.144656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.144738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.535 [2024-10-30 16:14:07.144763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.535 qpair failed and we were unable to recover it. 00:30:17.535 [2024-10-30 16:14:07.144850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.144962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.144987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.145128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.145216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.145242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.145365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.145445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.145471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.145556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.145663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.145689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.145801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.145914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.145939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.146028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.146111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.146138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.146238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.146383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.146411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.146518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.146631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.146659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.146773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.146886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.146911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.147031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.147114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.147140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.147251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.147346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.147372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.147521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.147601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.147626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.147714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.147824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.147851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.147998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.148074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.148100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.148226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.148322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.148349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.148460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.148543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.148570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.148679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.148818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.148844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.148929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.149013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.149040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.149165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.149277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.149305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.149431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.149544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.149571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.149659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.149775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.149801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.149884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.150022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.150048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.150195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.150280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.150306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.150421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.150507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.150534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.150624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.150767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.150792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.150917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.151031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.151057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.151170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.151280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.151308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.151453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.151533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.151560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.151671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.151755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.151782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.151896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.152002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.152029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.536 qpair failed and we were unable to recover it. 00:30:17.536 [2024-10-30 16:14:07.152112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.152224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.536 [2024-10-30 16:14:07.152250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.152397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.152510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.152536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.152648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.152728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.152754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.152840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.152966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.152991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.153114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.153203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.153228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.153352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.153462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.153490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.153573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.153656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.153683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.153792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.153910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.153935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.154028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.154166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.154193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.154285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.154429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.154455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.154542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.154679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.154706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.154820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.154934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.154960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.155075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.155154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.155181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.155286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.155388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.155419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.155553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.155679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.155709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.155806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.155976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.156002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.156141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.156265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.156310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.156436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.156559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.156588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.156717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.156802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.156831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.156986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.157136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.157164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.157253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.157387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.157431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.157581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.157709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.157738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.157839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.157958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.157987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.158112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.158213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.158242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.158414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.158569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.158597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.158710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.158873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.158902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.159048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.159158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.159186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.159298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.159387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.159415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.159501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.159616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.159643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.159754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.159868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.159894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.159982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.160079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.537 [2024-10-30 16:14:07.160105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.537 qpair failed and we were unable to recover it. 00:30:17.537 [2024-10-30 16:14:07.160194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.160304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.160331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.160485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.160580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.160606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.160752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.160866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.160894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.160983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.161059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.161085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.161197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.161307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.161333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.161422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.161560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.161587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.161666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.161792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.161818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.161937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.162054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.162080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.162167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.162286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.162313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.162407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.162493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.162520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.162628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.162708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.162734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.162821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.162899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.162925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.163037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.163230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.163264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.163390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.163532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.163559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.163640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.163780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.163805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.163887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.163974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.163999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.164112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.164217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.164243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.164350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.164428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.164454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.164597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.164681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.164707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.164792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.164903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.164929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.165014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.165097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.165123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.165274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.165360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.165386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.165504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.165588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.165614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.165727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.165844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.165870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.166009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.166150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.166176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.166291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.166409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.166435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.166522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.166633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.166659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.166771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.166889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.166916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.167001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.167116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.167142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.167223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.167350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.167376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.538 qpair failed and we were unable to recover it. 00:30:17.538 [2024-10-30 16:14:07.167464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.538 [2024-10-30 16:14:07.167551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.167578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.167693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.167775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.167802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.167919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.168029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.168059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.168152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.168239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.168273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.168426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.168539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.168564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.168656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.168774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.168800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.168883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.168994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.169021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.169112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.169197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.169224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.169346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.169434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.169461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.169604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.169718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.169745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.169852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.169959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.169984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.170072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.170217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.170243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.170350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.170459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.170490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.170605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.170719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.170746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.170837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.170942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.170969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.171089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.171198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.171224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.171361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.171476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.171503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.171616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.171721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.171746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.171861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.171973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.171999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.172138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.172248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.172282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.172392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.172471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.172498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.172574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.172663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.172689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.172799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.172917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.172947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.173065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.173174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.173200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.173286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.173400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.173426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.173543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.173657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.173684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.173813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.173929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.539 [2024-10-30 16:14:07.173955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.539 qpair failed and we were unable to recover it. 00:30:17.539 [2024-10-30 16:14:07.174045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.174131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.174158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.174280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.174409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.174453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.174570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.174651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.174678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.174790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.174896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.174922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.175036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.175144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.175170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.175250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.175338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.175365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.175491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.175575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.175602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.175713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.175829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.175854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.175946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.176031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.176059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.176172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.176265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.176292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.176381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.176507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.176534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.176628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.176710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.176737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.176860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.176950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.176977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.177095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.177177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.177204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.177290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.177375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.177401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.177493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.177583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.177610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.177696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.177785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.177811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.177927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.178013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.178039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.178147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.178235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.178286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.178408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.178552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.178578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.178674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.178816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.178842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.178982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.179092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.179118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.179228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.179326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.179352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.179443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.179534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.179561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.179681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.179820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.179846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.179976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.180066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.180091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.180203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.180309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.180337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.180458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.180584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.180613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.180751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.180861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.180886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.180971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.181109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.181135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.540 qpair failed and we were unable to recover it. 00:30:17.540 [2024-10-30 16:14:07.181275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.540 [2024-10-30 16:14:07.181406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.181450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.181536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.181648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.181676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.181760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.181847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.181873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.181961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.182072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.182098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.182182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.182321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.182348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.182493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.182611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.182638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.182763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.182877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.182903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.182982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.183068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.183094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.183182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.183273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.183301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.183388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.183512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.183538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.183616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.183725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.183751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.183890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.183978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.184004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.184119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.184230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.184264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.184376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.184458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.184486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.184605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.184717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.184744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.184831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.184942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.184969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.185093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.185232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.185267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.185382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.185463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.185490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.185590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.185674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.185701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.185809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.185922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.185948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.186032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.186151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.186178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.186292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.186434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.186461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.186579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.186695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.186722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.186838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.186983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.187010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.187128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.187269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.187298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.187433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.187573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.187602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.187765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.187881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.187908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.187989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.188128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.188154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.188267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.188393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.188422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.188547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.188633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.188658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.541 qpair failed and we were unable to recover it. 00:30:17.541 [2024-10-30 16:14:07.188800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.541 [2024-10-30 16:14:07.188887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.188914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.189022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.189160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.189186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.189273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.189387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.189414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.189530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.189649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.189676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.189767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.189911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.189938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.190044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.190153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.190180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.190324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.190467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.190494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.190587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.190673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.190701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.190819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.190928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.190954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.191071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.191181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.191208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.191297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.191387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.191414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.191555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.191644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.191672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.191757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.191866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.191891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.191972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.192062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.192089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.192194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.192347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.192375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.192450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.192562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.192590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.192689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.192802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.192829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.192913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.193031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.193057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.193141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.193225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.193251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.193381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.193496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.193523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.193641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.193755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.193782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.193875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.194013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.194039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.194145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.194232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.194267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.194381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.194522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.194548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.194684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.194761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.194787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.194928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.195037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.195063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.195173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.195268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.195296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.195405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.195550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.195576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.195692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.195768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.195795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.195936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.196046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.196072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.542 [2024-10-30 16:14:07.196165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.196254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.542 [2024-10-30 16:14:07.196289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.542 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.196371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.196448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.196474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.196583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.196695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.196721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.196833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.196922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.196948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.197061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.197169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.197196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.197305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.197419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.197446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.197532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.197680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.197706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.197783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.197866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.197892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.198036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.198152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.198178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.198292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.198376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.198402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.198519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.198600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.198627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.198737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.198852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.198879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.198962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.199101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.199127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.199213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.199303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.199330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.199449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.199572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.199598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.199739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.199847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.199873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.199976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.200092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.200117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.200203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.200282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.200309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.200446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.200572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.200598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.200714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.200821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.200847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.200932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.201014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.201043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.201124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.201231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.201265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.201391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.201505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.201531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.201653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.201801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.201827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.201914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.202025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.202051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.202173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.202290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.202317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.202430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.202554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.202581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.543 [2024-10-30 16:14:07.202664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.202748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.543 [2024-10-30 16:14:07.202776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.543 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.202895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.203011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.203038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.203154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.203294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.203321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.203436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.203517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.203544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.203656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.203763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.203790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.203897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.204004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.204030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.204153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.204244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.204279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.204404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.204555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.204582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.204700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.204843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.204869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.204952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.205034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.205064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.205181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.205267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.205295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.205382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.205486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.205512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.205657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.205732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.205759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.205876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.205987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.206013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.206104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.206220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.206247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.206361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.206444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.206470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.206614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.206723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.206750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.206837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.206954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.206980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.207064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.207159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.207186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.207295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.207420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.207453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.207572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.207661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.207687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.207768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.207855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.207882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.207974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.208088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.208114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.208229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.208353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.208380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.208463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.208573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.208598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.208710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.208819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.208844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.208937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.209081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.209107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.209226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.209325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.209353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.209437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.209529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.209556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.209669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.209755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.209787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.209870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.210008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.544 [2024-10-30 16:14:07.210035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.544 qpair failed and we were unable to recover it. 00:30:17.544 [2024-10-30 16:14:07.210177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.210285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.210313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.210426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.210513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.210539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.210647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.210787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.210814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.210901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.211014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.211039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.211126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.211268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.211295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.211377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.211488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.211515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.211637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.211718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.211744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.211834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.211950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.211976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.212071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.212177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.212208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.212321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.212410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.212436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.212515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.212628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.212653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.212743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.212855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.212882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.212970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.213082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.213109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.213249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.213392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.213419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.213501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.213618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.213644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.213763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.213849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.213876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.213961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.214055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.214082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.214199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.214308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.214335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.214419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.214535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.214562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.214680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.214753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.214779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.214894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.215002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.215029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.215146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.215224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.215251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.215400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.215510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.215536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.215620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.215736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.215762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.215859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.215975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.216001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.216146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.216263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.216290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.216375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.216461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.216488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.216608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.216712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.216738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.216858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.216972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.216998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.217115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.217231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.217264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.545 qpair failed and we were unable to recover it. 00:30:17.545 [2024-10-30 16:14:07.217376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.545 [2024-10-30 16:14:07.217482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.217508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.217625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.217730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.217756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.217867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.217979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.218004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.218117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.218200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.218227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.218319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.218436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.218464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.218585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.218660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.218686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.218803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.218882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.218908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.219052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.219164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.219190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.219276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.219358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.219384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.219530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.219637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.219663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.219777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.219861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.219887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.219967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.220080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.220105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.220217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.220352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.220379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.220485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.220601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.220628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.220741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.220823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.220851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.220974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.221055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.221081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.221198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.221275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.221302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.221419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.221505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.221531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.221640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.221780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.221807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.221929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.222043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.222069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.222155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.222300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.222326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.222444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.222564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.222591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.222714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.222834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.222860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.222969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.223077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.223104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.223210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.223319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.223346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.223439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.223551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.223579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.223698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.223813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.223841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.223960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.224041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.224066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.224206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.224323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.224350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.224449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.224533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.224559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.546 [2024-10-30 16:14:07.224674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.224780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.546 [2024-10-30 16:14:07.224806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.546 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.224922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.225037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.225062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.225146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.225250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.225283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.225393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.225480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.225507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.225600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.225677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.225703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.225794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.225900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.225926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.226065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.226205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.226231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.226348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.226434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.226460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.226574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.226683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.226709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.226824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.226934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.226960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.227072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.227190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.227217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.227338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.227417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.227445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.227559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.227700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.227727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.227801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.227909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.227936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.228050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.228137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.228165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.228290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.228381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.228408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.228523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.228666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.228692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.228832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.228910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.228935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.229047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.229136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.229163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.229248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.229344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.229371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.229494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.229582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.229609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.229717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.229834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.229861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.229978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.230057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.230083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.230195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.230304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.230331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.230453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.230604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.230631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.230711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.230854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.230881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.230966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.231080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.231106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.547 [2024-10-30 16:14:07.231213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.231339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.547 [2024-10-30 16:14:07.231367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.547 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.231483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.231574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.231601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.231750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.231838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.231865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.231956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.232070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.232096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.232213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.232307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.232334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.232480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.232564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.232590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.232690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.232772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.232800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.232932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.233021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.233048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.233138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.233239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.233273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.233379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.233497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.233524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.233622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.233744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.233773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.233889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.234038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.234067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.234159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.234274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.234301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.234419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.234551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.234579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.234704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.234840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.234883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.235002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.235093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.235122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.235243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.235372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.235398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.235483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.235617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.235645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.235767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.235857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.235887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.235980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.236096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.236125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.236248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.236375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.236401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.236480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.236583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.236611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.236780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.236908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.236938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.237065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.237187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.237217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.237384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.237469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.237495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.237641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.237764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.237793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.237882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.238003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.238032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.238124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.238277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.238304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.238451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.238558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.238586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.238753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.238918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.238946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.239093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.239226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.548 [2024-10-30 16:14:07.239250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.548 qpair failed and we were unable to recover it. 00:30:17.548 [2024-10-30 16:14:07.239348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.239482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.239508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.239643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.239775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.239804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.239929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.240086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.240130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.240233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.240343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.240369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.240444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.240557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.240583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.240667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.240796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.240823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.240950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.241066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.241094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.241227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.241313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.241339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.241426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.241593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.241621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.241744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.241892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.241920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.242046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.242169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.242199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.242298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.242441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.242467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.242590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.242711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.242739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.242862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.242964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.242992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.243075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.243244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.243278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.243397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.243482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.243510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.243630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.243799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.243828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.243942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.244070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.244101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.244265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.244385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.244413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.244553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.244644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.244673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.244804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.244920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.244951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.245041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.245136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.245170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.245317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.245434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.245460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.245549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.245666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.245692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.245789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.245876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.245906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.246035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.246149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.246183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.246326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.246470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.246496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.246630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.246743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.246772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.246935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.247025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.247059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.247153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.247278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.247327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.549 qpair failed and we were unable to recover it. 00:30:17.549 [2024-10-30 16:14:07.247451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.549 [2024-10-30 16:14:07.247589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.247620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.247719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.247845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.247883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.248013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.248142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.248170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.248280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.248380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.248405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.248496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.248634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.248664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.248754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.248906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.248935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.249092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.249194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.249227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.249354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.249472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.249497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.249639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.249763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.249792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.249942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.250039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.250069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.250199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.250304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.250332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.250413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.250503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.250537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.250669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.250750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.250793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.250951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.251107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.251136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.251290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.251411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.251437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.251526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.251641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.251682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.251788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.251903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.251932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.252122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.252264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.252292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.252407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.252541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.252570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.252674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.252771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.252802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.252933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.253029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.253059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.253193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.253322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.253358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.253477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.253644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.253671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.253762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.253880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.253916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.254058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.254144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.254169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.254267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.254349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.254376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.254506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.254654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.254683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.254807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.254942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.254969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.255064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.255167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.255195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.255342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.255436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.255461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.550 qpair failed and we were unable to recover it. 00:30:17.550 [2024-10-30 16:14:07.255547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.255662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.550 [2024-10-30 16:14:07.255687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.255836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.255935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.255965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.256112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.256219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.256245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.256339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.256444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.256470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.256582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.256695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.256738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.256824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.256979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.257004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.257100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.257229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.257266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.257403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.257509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.257534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.257689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.257840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.257867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.257995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.258091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.258118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.258234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.258321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.258346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.258486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.258572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.258598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.258697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.258847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.258875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.258990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.259110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.259140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.259242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.259362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.259388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.259529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.259611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.259635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.259759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.259883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.259927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.260053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.260170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.260195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.260282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.260392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.260417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.260538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.260649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.260673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.260801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.260894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.260923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.261014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.261113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.261141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.261316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.261430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.261456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.261567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.261702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.261727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.261856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.261983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.262008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.262090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.262224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.262252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.262389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.262485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.262514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.262640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.262755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.262780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.262876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.262992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.263021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.263107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.263285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.263315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.551 qpair failed and we were unable to recover it. 00:30:17.551 [2024-10-30 16:14:07.263444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.551 [2024-10-30 16:14:07.263575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.263601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.263697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.263845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.263870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.263963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.264126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.264154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.264297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.264421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.264449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.264608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.264731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.264759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.264890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.265035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.265061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.265197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.265325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.265354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.265447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.265581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.265607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.265751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.265858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.265883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.265967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.266049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.266076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.266186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.266304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.266329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.266476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.266645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.266674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.266834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.266989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.267013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.267126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.267249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.267290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.267425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.267547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.267574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.267665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.267768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.267796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.267924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.268016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.268043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.268155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.268269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.268295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.268402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.268539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.268566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.268687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.268813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.268840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.268967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.269063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.269091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.269253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.269343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.269368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.269477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.269598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.269623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.269754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.269879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.269907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.270068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.270187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.270214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.270331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.270414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.270440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.270544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.270645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.270675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.552 qpair failed and we were unable to recover it. 00:30:17.552 [2024-10-30 16:14:07.270824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.552 [2024-10-30 16:14:07.270961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.270986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.271105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.271220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.271274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.271376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.271467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.271492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.271581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.271692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.271718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.271827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.271969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.271994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.272088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.272224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.272250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.272346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.272453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.272479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.272579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.272725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.272754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.272919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.273023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.273048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.273172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.273332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.273361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.273500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.273584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.273610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.273744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.273843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.273871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.274021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.274116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.274143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.274247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.274384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.274409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.274520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.274603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.274629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.274733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.274856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.274884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.275035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.275151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.275179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.275289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.275426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.275451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.275559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.275673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.275699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.275808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.275909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.275937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.276029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.276137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.276165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.276297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.276418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.276446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.276592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.276700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.276725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.276867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.277005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.277030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.277150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.277236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.277271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.277386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.277531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.277558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.277698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.277812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.277837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.277966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.278094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.278121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.278274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.278425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.278467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.278611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.278745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.278773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.553 qpair failed and we were unable to recover it. 00:30:17.553 [2024-10-30 16:14:07.278903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.553 [2024-10-30 16:14:07.279037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.279061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.279169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.279282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.279309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.279453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.279579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.279607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.279765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.279892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.279920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.280086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.280196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.280222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.280412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.280529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.280554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.280669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.280794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.280819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.280940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.281054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.281079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.281242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.281378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.281404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.281490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.281656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.281681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.281816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.281960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.281985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.282103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.282202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.282232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.282359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.282466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.282491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.282639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.282769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.282798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.282896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.283026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.283050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.283144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.283220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.283245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.283366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.283476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.283501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.283612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.283695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.283720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.283836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.283927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.283956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.284084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.284251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.284286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.284375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.284485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.284510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.284669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.284760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.284789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.284917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.285036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.285064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.285199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.285377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.285403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.285523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.285628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.285654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.285783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.285930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.285962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.286130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.286242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.286274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.286384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.286533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.286563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.286658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.286793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.286818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.286917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.287006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.287036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.554 qpair failed and we were unable to recover it. 00:30:17.554 [2024-10-30 16:14:07.287157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.287288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.554 [2024-10-30 16:14:07.287333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.287452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.287555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.287580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.287695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.287804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.287829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.287984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.288133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.288160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.288288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.288431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.288456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.288598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.288732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.288779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.288897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.288973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.288999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.289152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.289277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.289302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.289415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.289495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.289538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.289633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.289713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.289740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.289848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.289951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.289976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.290106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.290252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.290284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.290404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.290476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.290501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.290647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.290791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.290832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.290944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.291022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.291046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.291129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.291216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.291245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.291398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.291490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.291518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.291613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.291700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.291729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.291827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.291940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.291965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.292048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.292183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.292214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.292316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.292436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.292466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.292591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.292718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.292743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.292834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.292973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.292999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.293095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.293217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.293245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.293402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.293504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.293532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.293663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.293754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.293787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.293919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.294027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.294051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.294212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.294327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.294353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.294459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.294603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.294630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.294761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.294900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.294926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.295040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.295123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.555 [2024-10-30 16:14:07.295148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.555 qpair failed and we were unable to recover it. 00:30:17.555 [2024-10-30 16:14:07.295224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.295321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.295347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.295465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.295603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.295644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.295736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.295842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.295869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.295958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.296096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.296122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.296227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.296332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.296362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.296509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.296584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.296610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.296728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.296811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.296837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.296919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.297026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.297051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.297185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.297308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.297338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.297460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.297583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.297626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.297774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.297859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.297899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.298067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.298198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.298235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.298412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.298557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.298598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.298787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.298902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.298929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.299069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.299227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.299252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.299379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.299452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.299476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.299615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.299731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.299758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.299887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.300013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.300040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.300166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.300305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.300333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.556 qpair failed and we were unable to recover it. 00:30:17.556 [2024-10-30 16:14:07.300421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.556 [2024-10-30 16:14:07.300559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.300584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.300699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.300858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.300885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.300989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.301108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.301136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.301238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.301405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.301435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.301572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.301656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.301682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.301791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.301871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.301896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.301991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.302105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.302147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.302274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.302434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.302460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.302551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.302628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.302653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.302760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.302845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.302871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.303009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.303119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.303143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.303229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.303373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.303401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.303532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.303621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.303647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.303758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.303885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.303913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.304000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.304148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.304176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.304274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.304425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.304454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.304571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.304686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.304712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.304843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.304964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.305008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.305097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.305213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.305239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.305362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.305531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.305559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.305658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.305750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.305775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.305855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.305994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.306019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.306146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.306272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.306315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.306402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.306486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.306511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.306652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.306791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.306815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.306949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.307033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.307075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.307177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.307313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.307339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.307420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.307501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.307526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.307649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.307764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.307790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.307903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.308044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.308086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.557 qpair failed and we were unable to recover it. 00:30:17.557 [2024-10-30 16:14:07.308206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.557 [2024-10-30 16:14:07.308340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.308370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.308529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.308663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.308689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.308806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.308892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.308919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.309007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.309167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.309196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.309313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.309463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.309492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.309698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.309847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.309875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.310012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.310099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.310125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.310206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.310351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.310381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.310500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.310624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.310652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.310774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.310903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.310929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.311073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.311158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.311184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.311286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.311440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.311468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.311606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.311718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.311742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.311853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.311943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.311969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.312108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.312219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.312245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.312361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.312507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.312535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.312676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.312804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.312833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.313000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.313124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.313149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.313237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.313360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.313386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.313492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.313601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.313629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.313754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.313852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.313879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.313993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.314126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.314154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.314285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.314403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.314428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.314542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.314644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.314672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.314806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.314890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.314916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.315039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.315185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.315214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.315361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.315450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.315477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.315593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.315676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.315717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.315806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.315929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.315973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.316055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.316190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.316218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.558 qpair failed and we were unable to recover it. 00:30:17.558 [2024-10-30 16:14:07.316367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.316504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.558 [2024-10-30 16:14:07.316530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.316653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.316804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.316832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.316926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.317047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.317077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.317244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.317363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.317390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.317503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.317589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.317615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.317735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.317845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.317889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.317982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.318110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.318138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.318277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.318397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.318423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.318564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.318643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.318668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.318804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.318949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.318977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.319074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.319186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.319210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.319379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.319498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.319525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.319637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.319750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.319776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.319914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.320071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.320099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.320225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.320364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.320409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.320552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.320698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.320726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.320849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.320938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.320962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.321054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.321171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.321196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.321276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.321362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.321387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.321527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.321632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.321674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.321781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.321864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.321890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.322005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.322142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.322169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.322272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.322388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.322415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.322543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.322639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.322667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.322800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.322940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.322965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.323099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.323234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.323267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.323363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.323458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.323483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.323613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.323709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.323738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.323848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.323986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.324011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.324090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.324242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.324282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.324437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.324560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.559 [2024-10-30 16:14:07.324588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.559 qpair failed and we were unable to recover it. 00:30:17.559 [2024-10-30 16:14:07.324717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.324863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.324891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.325009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.325123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.325148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.325268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.325418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.325442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.325524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.325664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.325692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.325828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.325973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.326002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.326132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.326220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.326244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.326375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.326533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.326561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.326676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.326769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.326811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.326922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.327075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.327102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.327240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.327389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.327415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.327516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.327618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.327646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.327752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.327889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.327914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.328029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.328141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.328166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.328247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.328420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.328446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.328577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.328674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.328704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.328858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.328971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.329021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.329138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.329217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.329242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.329442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.329530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.329556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.329637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.329720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.329747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.329889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.330000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.330025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.330117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.330293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.330320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.330465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.330573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.330599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.330702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.330819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.330848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.330980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.331104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.331133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.331238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.331343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.331372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.331504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.331611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.331643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.331772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.331893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.331922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.332023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.332142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.332170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.332280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.332435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.332478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.332588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.332680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.332705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.560 qpair failed and we were unable to recover it. 00:30:17.560 [2024-10-30 16:14:07.332850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.560 [2024-10-30 16:14:07.332962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.332989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.333111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.333236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.333287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.333405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.333567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.333594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.333757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.333839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.333863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.333977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.334104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.334131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.334219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.334358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.334388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.334489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.334619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.334649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.334820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.334907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.334933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.335048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.335177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.335206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.335312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.335460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.335488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.335583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.335673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.335702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.335813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.335928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.335954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.336107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.336203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.336232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.336369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.336468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.336495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.336587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.336681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.336710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.336841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.336976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.337005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.337092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.337229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.337253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.337397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.337552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.337579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.337703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.337833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.337861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.337966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.338045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.338071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.338232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.338331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.338360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.338530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.338621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.338647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.338734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.338871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.338900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.339034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.339145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.339170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.339302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.339437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.339466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.339567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.339660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.339688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.339791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.339943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.339970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.561 qpair failed and we were unable to recover it. 00:30:17.561 [2024-10-30 16:14:07.340102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.561 [2024-10-30 16:14:07.340214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.340239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.340406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.340530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.340558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.340673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.340797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.340825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.340969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.341048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.341072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.341182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.341286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.341312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.341399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.341532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.341559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.341684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.341828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.341855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.341978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.342097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.342125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.342231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.342352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.342377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.342514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.342632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.342660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.342750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.342919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.342943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.343032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.343117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.343158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.343286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.343371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.343396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.343508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.343586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.343630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.343757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.343854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.343880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.344044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.344160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.344186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.344292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.344375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.344401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.344484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.344617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.344644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.344760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.344846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.344875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.344991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.345108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.345135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.345267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.345382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.345407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.345524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.345651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.345679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.345803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.345955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.345982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.346108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.346199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.346228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.346359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.346477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.346502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.346616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.346771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.346799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.346925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.347058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.347083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.347196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.347317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.347343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.347484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.347596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.347621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.347738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.347823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.347866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.562 qpair failed and we were unable to recover it. 00:30:17.562 [2024-10-30 16:14:07.348016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.348139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.562 [2024-10-30 16:14:07.348182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.348303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.348412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.348437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.348545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.348657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.348682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.348788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.348901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.348944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.349031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.349124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.349152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.349278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.349429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.349457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.349568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.349681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.349706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.349818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.349962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.349991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.350114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.350241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.350282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.350448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.350589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.350614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.350697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.350786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.350811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.350930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.351039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.351082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.351206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.351351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.351376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.351466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.351584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.351609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.351722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.351837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.351862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.351984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.352147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.352171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.352289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.352404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.352430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.352545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.352647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.352675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.352804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.352883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.352908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.353054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.353131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.353156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.353268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.353355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.353396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.353493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.353574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.353602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.353740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.353826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.353852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.353928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.354043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.354067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.354180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.354262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.354288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.354456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.354588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.354630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.354742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.354888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.354914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.355028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.355149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.355179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.355339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.355459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.355487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.355647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.355772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.355799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.563 qpair failed and we were unable to recover it. 00:30:17.563 [2024-10-30 16:14:07.355929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.563 [2024-10-30 16:14:07.356045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.356069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.356210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.356317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.356346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.356500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.356616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.356644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.356738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.356821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.356848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.356948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.357029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.357055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.357140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.357308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.357337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.357457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.357596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.357638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.357747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.357831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.357856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.357969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.358104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.358129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.358268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.358406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.358433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.358581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.358702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.358731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.358857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.358980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.359008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.359149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.359266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.359293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.359401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.359517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.359545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.359644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.359758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.359786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.359889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.359985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.360011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.360131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.360251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.360305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.360381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.360488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.360522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.360603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.360748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.360776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.360872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.360967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.360995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.361111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.361193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.361217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.361340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.361494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.361522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.361659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.361770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.361796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.361901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.361997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.362026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.362165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.362250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.362284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.362396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.362523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.362550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.362674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.362791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.362818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.362905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.363020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.363047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.363173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.363285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.363311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.363406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.363496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.363521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.564 qpair failed and we were unable to recover it. 00:30:17.564 [2024-10-30 16:14:07.363636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.564 [2024-10-30 16:14:07.363749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.363791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.363884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.363996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.364020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.364124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.364230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.364287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.364427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.364545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.364574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.364702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.364817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.364842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.364925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.365057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.365084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.365228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.365359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.365386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.365530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.365634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.365661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.365782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.365921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.365945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.366024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.366145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.366189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.366300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.366407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.366432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.366585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.366705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.366734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.366831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.366973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.366997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.367085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.367190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.367232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.367383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.367470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.367496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.367599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.367706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.367734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.367873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.367979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.368004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.368136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.368291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.368334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.368424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.368565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.368590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.368714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.368813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.368842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.368986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.369108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.369133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.369218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.369358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.369387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.369482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.369637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.369662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.369748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.369871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.369899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.369984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.370073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.370101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.370221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.370333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.370361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.565 [2024-10-30 16:14:07.370506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.370617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.565 [2024-10-30 16:14:07.370642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.565 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.370770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.370916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.370942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.371068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.371199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.371224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.371370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.371508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.371540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.371676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.371761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.371787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.371873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.372005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.372034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.372190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.372288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.372314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.372442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.372532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.372558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.372718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.372807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.372832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.372961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.373052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.373081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.373172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.373317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.373343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.373433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.373607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.373635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.373758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.373876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.373903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.374067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.374188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.374221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.374329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.374455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.374484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.374644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.374730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.374755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.374861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.374987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.375014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.375110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.375253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.375285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.375366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.375478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.375505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.375595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.375678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.566 [2024-10-30 16:14:07.375703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.566 qpair failed and we were unable to recover it. 00:30:17.566 [2024-10-30 16:14:07.375827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.375940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.375966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.376139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.376282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.376309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.376390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.376462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.376487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.376572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.376685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.376714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.376829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.376947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.376982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.377101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.377220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.377248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.377383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.377531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.377573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.377674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.377792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.377822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.377947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.378036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.378062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.378164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.378287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.378318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.378445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.378539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.378568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.378665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.378801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.378827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.378940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.379083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.379111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.379276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.379376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.379425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.379515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.379628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.379668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.379811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.379902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.379929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.380041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.380127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.380152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.380306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.380399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.380432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.380558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.380649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.380678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.380843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.380925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.380951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.381066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.381155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.381182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-10-30 16:14:07.381308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-10-30 16:14:07.381432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.381461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.381592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.381726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.381755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.381907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.382103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.382128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.382279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.382392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.382419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.382545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.382639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.382668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.382782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.382880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.382909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.383060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.383196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.383221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.383340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.383421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.383447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.383530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.383641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.383683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.383777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.383931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.383959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.384048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.384133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.384162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.384307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.384430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.384456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.384581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.384730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.384758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.384892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.384987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.385014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.385101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.385216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.385242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.385336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.385423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.385448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.385563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.385724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.385753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.385904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.386061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.386089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.386216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.386361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.386388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.386504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.386622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.386647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.386728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.386843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.386869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.386994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.387100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.387130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.387231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.387349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.387376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.387489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.387581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.387606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.387749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.387897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.387932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.388067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.388204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.388245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.388418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.388569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.388612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.388765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.388895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.388921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.389036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.389112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.389139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.389389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.389480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.852 [2024-10-30 16:14:07.389510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.852 qpair failed and we were unable to recover it. 00:30:17.852 [2024-10-30 16:14:07.389601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.389697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.389725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.389862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.389943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.389968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.390054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.390152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.390181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.390294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.390396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.390425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.390534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.390605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.390629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.390744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.390854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.390880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.390996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.391111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.391135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.391220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.391307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.391333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.391425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.391549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.391577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.391683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.391762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.391789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.391881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.391993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.392018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.392102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.392182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.392207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.392325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.392410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.392435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.392582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.392694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.392720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.392901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.393025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.393049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.393138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.393311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.393341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.393463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.393583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.393613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.393743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.393860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.393885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.393983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.394061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.394090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.394169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.394273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.394301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.394437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.394533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.394561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.394678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.394784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.394809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.394899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.395002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.395026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.395173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.395313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.395343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.395498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.395618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.395645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.395780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.395869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.395894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.396029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.396200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.396224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.396348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.396507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.396535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.396635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.396774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.396801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.396910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.396992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.397016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.853 qpair failed and we were unable to recover it. 00:30:17.853 [2024-10-30 16:14:07.397237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.853 [2024-10-30 16:14:07.397384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.397424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.397508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.397627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.397652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.397736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.397844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.397871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.397974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.398131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.398158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.398247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.398366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.398391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.398506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.398609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.398635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.398708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.398800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.398824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.398909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.399026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.399051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.399165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.399340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.399368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.399490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.399614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.399643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.399797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.399912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.399941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.400078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.400207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.400233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.400388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.400476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.400501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.400619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.400808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.400837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.400957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.401078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.401107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.401284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.401398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.401423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.401529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.401623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.401664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.401779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.401895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.401921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.402029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.402109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.402134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.402251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.402343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.402369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.402478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.402563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.402588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.402672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.402777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.402802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.402938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.403097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.403123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.403231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.403336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.403362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.404743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.404894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.404925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.405033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.405147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.405174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.405303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.405473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.405501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.405608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.405699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.405724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.405812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.405951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.405978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.406074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.406195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.406220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.854 qpair failed and we were unable to recover it. 00:30:17.854 [2024-10-30 16:14:07.406315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.854 [2024-10-30 16:14:07.406401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.406426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.406514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.406626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.406651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.406776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.406868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.406898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.407027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.407135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.407164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.407309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.407397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.407423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.407504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.407622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.407648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.407759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.407870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.407895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.408010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.408178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.408206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.408307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.408453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.408479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.408594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.408705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.408731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.408855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.408978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.409007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.409098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.409214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.409242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.409416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.409512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.409554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.409665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.409810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.409837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.409979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.410129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.410156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.410290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.410392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.410417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.410536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.410627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.410652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.410768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.410857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.410883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.410969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.411104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.411128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.411245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.411346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.411370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.411488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.411589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.411615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.411729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.411841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.411867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.411983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.412071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.412097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.412189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.412313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.412343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.412462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.412580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.412605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.855 qpair failed and we were unable to recover it. 00:30:17.855 [2024-10-30 16:14:07.412718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.412805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.855 [2024-10-30 16:14:07.412832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.412946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.413025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.413051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.413207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.413333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.413362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.413489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.413612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.413641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.413774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.413866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.413892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.414003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.414081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.414107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.414192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.414302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.414344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.414511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.414619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.414645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.414725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.414836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.414867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.414969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.415089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.415119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.415239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.415355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.415382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.415478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.415609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.415635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.415723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.415839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.415864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.415963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.416059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.416086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.416226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.416359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.416388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.416512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.416603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.416631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.416757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.416877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.416901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.417018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.417131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.417174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.417266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.417360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.417394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.417550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.417644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.417672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.417811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.417921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.417946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.418030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.418137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.418165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.418271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.418391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.418419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.418554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.418702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.418742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.418854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.418966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.418993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.419125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.419250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.419298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.419391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.419515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.419540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.419639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.419757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.419799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.419958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.420046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.420075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.420233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.420332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.856 [2024-10-30 16:14:07.420362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.856 qpair failed and we were unable to recover it. 00:30:17.856 [2024-10-30 16:14:07.420464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.420586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.420628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.420745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.420871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.420915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.420999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.421136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.421160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.421292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.421394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.421438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.421525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.421612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.421637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.421779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.421902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.421930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.422036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.422147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.422173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.422315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.422411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.422439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.422559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.422671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.422700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.422841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.422938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.422967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.423102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.423208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.423233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.423345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.423436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.423462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.423574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.423662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.423692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.423854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.424014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.424042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.424203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.424406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.424433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.424523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.424662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.424687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.424769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.424855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.424880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.424996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.425124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.425153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.425298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.425382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.425407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.425506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.425688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.425714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.425858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.425943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.425990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.426085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.426207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.426248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.426410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.426524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.426557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.426670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.426779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.426806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.427007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.427126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.427155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.427280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.427372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.427401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.427518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.427639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.427664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.427755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.427857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.427883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.427982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.428091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.428118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.428233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.428348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.428376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.857 qpair failed and we were unable to recover it. 00:30:17.857 [2024-10-30 16:14:07.428489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.857 [2024-10-30 16:14:07.428608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.428635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.428726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.428831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.428857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.428945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.429023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.429049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.429141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.429225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.429250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.429386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.429463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.429488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.429570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.429680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.429705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.429799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.429873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.429898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.430013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.430115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.430143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.430271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.430353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.430379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.430503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.430639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.430667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.430748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.430866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.430892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.431008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.431144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.431171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.431276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.431358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.431384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.431468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.431554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.431583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.431699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.431823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.431849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.432010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.432091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.432116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.432224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.432347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.432375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.432486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.432613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.432641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.432744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.432834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.432863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.433000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.433098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.433125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.433240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.433359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.433385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.433498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.433679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.433707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.433801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.433895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.433923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.434053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.434170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.434200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.434338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.434450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.434476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.434560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.434731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.434757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.434868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.434997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.435026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.435184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.435303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.435330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.435488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.435613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.435641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.435736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.435869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.435894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.858 qpair failed and we were unable to recover it. 00:30:17.858 [2024-10-30 16:14:07.435985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.436102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.858 [2024-10-30 16:14:07.436127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.436240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.436369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.436412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.436526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.436648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.436673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.436760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.436845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.436871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.437006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.437088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.437113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.437221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.437373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.437405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.437506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.437610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.437638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.437733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.437855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.437879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.437977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.438079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.438106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.438227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.438346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.438372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.438493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.438576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.438602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.438690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.438799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.438825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.438949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.439085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.439111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.439201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.439340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.439367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.439454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.439581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.439620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.439738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.439840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.439868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.439964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.440059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.440087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.440185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.440307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.440334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.440422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.440571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.440596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.440711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.440876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.440905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.441000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.441122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.441149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.441242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.441352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.441376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.441488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.441582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.441610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.441715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.441828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.441869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.441986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.442105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.442131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.442217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.442333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.442358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.442448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.442527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.442551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.442665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.442757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.442801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.859 qpair failed and we were unable to recover it. 00:30:17.859 [2024-10-30 16:14:07.442898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.442993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.859 [2024-10-30 16:14:07.443021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.443116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.443226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.443251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.443391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.443476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.443502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.443708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.443852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.443892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.444019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.444114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.444142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.444271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.444414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.444440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.444529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.444643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.444668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.444786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.444881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.444908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.444996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.445084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.445112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.445248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.445352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.445377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.445489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.445635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.445663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.445765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.445879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.445908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.446001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.446126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.446170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.446295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.446382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.446407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.446493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.446582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.446606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.446688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.446796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.446822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.446905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.447027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.447068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.447153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.447282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.447319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.447403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.447514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.447542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.447656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.447750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.447777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.447902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.448030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.448062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.448186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.448303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.448328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.448410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.448495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.448521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.448686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.448819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.448861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.448954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.449074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.449101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.449197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.449317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.449341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.449427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.449537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.449588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.449747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.449863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.449887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.450051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.450172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.450200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.860 qpair failed and we were unable to recover it. 00:30:17.860 [2024-10-30 16:14:07.450356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.860 [2024-10-30 16:14:07.450443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.450466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.450610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.450732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.450771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.450908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.451030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.451057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.451184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.451321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.451346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.451428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.451515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.451539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.451615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.451728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.451753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.451877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.452035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.452063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.452153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.452306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.452332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.452451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.452540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.452574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.452667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.452824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.452853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.452983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.453090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.453120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.453214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.453348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.453374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.453469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.453596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.453626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.453719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.453832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.453861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.453964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.454067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.454094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.454185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.454323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.454349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.454488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.454628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.454652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.454749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.454865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.454894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.455063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.455156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.455184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.455277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.455383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.455409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.455496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.455595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.455620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.455730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.455819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.455863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.456003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.456105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.456150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.456231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.456349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.456375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.456461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.456536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.456561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.456669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.456761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.456789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.456877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.456973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.457001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.457100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.457188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.457218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.457322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.457406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.457431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.457511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.457592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.457617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.861 [2024-10-30 16:14:07.457719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.457814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.861 [2024-10-30 16:14:07.457842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.861 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.457972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.458065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.458093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.458183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.458279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.458329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.458419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.458532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.458568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.458684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.458775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.458803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.458885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.459008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.459036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.459162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.459276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.459320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.459434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.459564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.459593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.459705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.459821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.459849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.460008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.460107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.460147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.460229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.460347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.460372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.460462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.460575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.460617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.460812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.460909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.460941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.461063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.461167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.461191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.461302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.461417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.461442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.461564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.461643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.461667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.461820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.461940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.461968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.462054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.462217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.462244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.462373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.462480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.462505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.462649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.462775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.462804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.462923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.463053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.463081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.463210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.463308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.463335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.463471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.463612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.463655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.463741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.463870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.463899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.464092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.464209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.464237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.464437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.464543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.464580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.464663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.464740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.464782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.464912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.465006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.465034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.465140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.465248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.465305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.465389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.465483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.465509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.465610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.465753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.862 [2024-10-30 16:14:07.465778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.862 qpair failed and we were unable to recover it. 00:30:17.862 [2024-10-30 16:14:07.465941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.466036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.466064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.466167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.466265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.466292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.466387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.466500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.466526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.466664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.466756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.466783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.466898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.467011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.467038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.467155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.467246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.467299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.467386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.467467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.467492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.467636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.467748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.467775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.467898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.467995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.468023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.468127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.468283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.468320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.468436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.468580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.468607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.468691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.468789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.468816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.468910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.469021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.469045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.469146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.469226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.469251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.469399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.469485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.469510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.469684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.469773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.469798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.469910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.469991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.470017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.470126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.470207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.470231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.470323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.470428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.470453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.470573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.470689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.470715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.470826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.470938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.470963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.471048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.471159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.471184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.471305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.471431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.471456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.471544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.471655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.471681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.471824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.471916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.471941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.472052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.472166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.472190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.472334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.472448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.472474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.472604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.472690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.472715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.472833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.472947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.472973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.473112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.473226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.473250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.863 qpair failed and we were unable to recover it. 00:30:17.863 [2024-10-30 16:14:07.473347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.863 [2024-10-30 16:14:07.473491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.473515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.473677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2311980 is same with the state(5) to be set 00:30:17.864 [2024-10-30 16:14:07.473844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.473959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.473995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.474087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.474174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.474201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.474359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.474472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.474498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.474627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.474736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.474763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.474872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.474991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.475017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.475109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.475220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.475248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.475374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.475491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.475516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.475637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.475725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.475750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.475890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.475970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.475996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.476108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.476220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.476246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.476346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.476454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.476483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.476625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.476737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.476763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.476872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.476987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.477012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.477128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.477241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.477305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.477398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.477480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.477506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.477657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.477741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.477766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.477882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.477969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.477996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.478085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.478189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.478215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.478346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.478427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.478452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.478570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.478678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.478703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.478780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.478884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.478908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.479017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.479127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.479151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.479270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.479349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.479375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.479458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.479527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.479561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.479639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.479756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.479781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.864 [2024-10-30 16:14:07.479894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.479981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.864 [2024-10-30 16:14:07.480006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.864 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.480123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.480265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.480300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.480388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.480494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.480519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.480639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.480718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.480744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.480832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.480945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.480970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.481081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.481170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.481195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.481284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.481400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.481425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.481539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.481625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.481650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.481734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.481846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.481872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.481966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.482054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.482081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.482198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.482279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.482304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.482411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.482520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.482545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.482643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.482731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.482757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.482865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.482943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.482969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.483086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.483161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.483186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.483278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.483373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.483399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.483490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.483576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.483602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.483714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.483819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.483844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.483926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.484036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.484060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.484145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.484224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.484249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.484387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.484468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.484494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.484632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.484718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.484743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.484835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.484917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.484942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.485027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.485113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.485138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.485254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.485373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.485398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.485484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.485566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.485590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.485702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.485787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.485812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.485920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.486032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.486057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.486167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.486281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.486308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.486412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.486533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.486562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.486681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.486791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.865 [2024-10-30 16:14:07.486817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.865 qpair failed and we were unable to recover it. 00:30:17.865 [2024-10-30 16:14:07.486903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.486985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.487012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.487122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.487236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.487268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.487388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.487501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.487529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.487646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.487784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.487810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.487928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.488043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.488070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.488166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.488251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.488290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.488397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.488514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.488539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.488626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.488699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.488725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.488808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.488918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.488946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.489059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.489146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.489174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.489288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.489402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.489428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.489517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.489605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.489632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.489724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.489824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.489850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.489960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.490075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.490102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.490220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.490335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.490361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.490460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.490550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.490576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.490650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.490740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.490766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.490850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.490961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.490988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.491074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.491210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.491236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.491340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.491420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.491446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.491530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.491644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.491671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.491766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.491886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.491911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.491995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.492110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.492136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.492218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.492312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.492339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.492432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.492522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.492548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.492667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.492752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.492779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.492921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.493016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.493043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.493125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.493204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.493230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.493368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.493486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.493512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.493594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.493677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.493703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.866 qpair failed and we were unable to recover it. 00:30:17.866 [2024-10-30 16:14:07.493816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.866 [2024-10-30 16:14:07.493952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.493977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.494062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.494144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.494170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.494279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.494413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.494440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.494557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.494634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.494660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.494813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.494907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.494932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.495062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.495192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.495222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.495349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.495440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.495467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.495553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.495632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.495658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.495772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.495852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.495877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.495962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.496075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.496101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.496175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.496289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.496316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.496432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.496518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.496546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.496656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.496746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.496773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.496885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.496969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.496996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.497141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.497224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.497250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.497372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.497453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.497480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.497593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.497690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.497716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.497811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.497923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.497949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.498064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.498177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.498202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.498310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.498441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.498469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.498592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.498704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.498729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.498842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.498955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.498981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.499067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.499149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.499174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.499265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.499380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.499406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.499480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.499613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.499638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.499747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.499892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.499918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.500003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.500114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.500139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.500250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.500338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.500363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.500478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.500621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.500647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.500735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.500856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.500882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.867 qpair failed and we were unable to recover it. 00:30:17.867 [2024-10-30 16:14:07.500968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.501074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.867 [2024-10-30 16:14:07.501100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.501185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.501321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.501348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.501434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.501555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.501580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.501664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.501747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.501772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.501890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.501972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.501997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.502088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.502205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.502231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.502356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.502452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.502479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.502622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.502703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.502728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.502849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.502956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.502982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.503070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.503154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.503179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.503272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.503378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.503404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.503486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.503577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.503602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.503689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.503804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.503830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.503905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.504020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.504045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.504126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.504202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.504227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.504349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.504443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.504469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.504583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.504665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.504690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.504801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.504883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.504910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.504995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.505072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.505097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.505217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.505338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.505365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.505448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.505562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.505587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.505699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.505811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.505836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.505958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.506066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.506095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.506215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.506336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.506363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.506454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.506569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.506595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.506682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.506797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.506830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.506927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.507038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.507063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.868 qpair failed and we were unable to recover it. 00:30:17.868 [2024-10-30 16:14:07.507146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.868 [2024-10-30 16:14:07.507225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.507250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.507369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.507453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.507479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.507588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.507694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.507719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.507805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.507877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.507902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.507984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.508063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.508089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.508180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.508302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.508338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.508479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.508592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.508618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.508709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.508789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.508815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.508904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.509019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.509050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.509165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.509304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.509331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.509439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.509524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.509550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.509631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.509705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.509731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.509841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.509921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.509948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.510034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.510121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.510146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.510236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.510363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.510389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.510500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.510584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.510610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.510698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.510775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.510802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.510914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.511001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.511028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.511117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.511230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.511270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.511373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.511459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.511485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.511591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.511708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.511734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.511824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.511962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.511988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.512071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.512155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.512180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.512344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.512426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.512452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.512573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.512648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.512674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.512798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.512909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.512935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.513019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.513129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.513155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.513266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.513345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.513371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.513505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.513590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.513620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.513703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.513819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.513846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.869 qpair failed and we were unable to recover it. 00:30:17.869 [2024-10-30 16:14:07.513956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.514034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.869 [2024-10-30 16:14:07.514060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.514185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.514340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.514371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.514487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.514626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.514652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.514763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.514850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.514876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.514966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.515044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.515068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.515157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.515233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.515266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.515378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.515471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.515499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.515601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.515699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.515725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.515817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.515929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.515955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.516044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.516121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.516145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.516235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.516359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.516386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.516468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.516580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.516606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.516685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.516801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.516825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.516935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.517021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.517046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.517130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.517208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.517233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.517333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.517443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.517468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.517557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.517641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.517666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.517775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.517915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.517940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.518053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.518161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.518187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.518307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.518394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.518420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.518568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.518651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.518677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.518767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.518855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.518881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.518960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.519069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.519095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.519172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.519281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.519318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.519408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.519489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.519515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.519630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.519719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.519745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.519827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.519912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.519938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.520048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.520137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.520163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.520247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.520374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.520400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.520493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.520614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.520640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.870 [2024-10-30 16:14:07.520788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.520873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.870 [2024-10-30 16:14:07.520898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.870 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.521014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.521095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.521120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.521207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.521299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.521326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.521448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.521562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.521587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.521679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.521790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.521816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.521924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.522005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.522032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.522148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.522233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.522268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.522367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.522479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.522505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.522622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.522725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.522751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.522863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.522948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.522973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.523083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.523164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.523189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.523299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.523402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.523432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.523528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.523610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.523639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.523762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.523845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.523874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.524016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.524104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.524131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.524242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.524336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.524362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.524447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.524531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.524556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.524698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.524783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.524808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.524891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.524975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.525003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.525124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.525223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.525252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.525379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.525457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.525483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.525597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.525677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.525702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.525812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.525923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.525948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.526056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.526143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.526167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.526250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.526370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.526397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.526480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.526605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.526631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.526719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.526797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.526822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.526906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.527044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.527069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.527180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.527271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.527298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.527418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.527503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.527529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.527614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.527724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.527749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.871 qpair failed and we were unable to recover it. 00:30:17.871 [2024-10-30 16:14:07.527832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.871 [2024-10-30 16:14:07.527916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.527944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.528028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.528113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.528139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.528248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.528370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.528396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.528493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.528608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.528634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.528718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.528831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.528857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.529005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.529085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.529111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.529198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.529288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.529315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.529426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.529539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.529564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.529647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.529735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.529760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.529870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.529944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.529969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.530058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.530151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.530177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.530267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.530381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.530407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.530520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.530630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.530657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.530738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.530845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.530872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.530982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.531092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.531118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.531232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.531363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.531390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.531482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.531561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.531588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.531679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.531787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.531814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.531925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.532014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.532042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.532153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.532228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.532254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.532408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.532494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.532520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.532659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.532769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.532794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.532906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.532989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.533014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.533098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.533193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.533218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.533334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.533423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.533449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.533556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.533641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.533667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.533743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.533823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.533850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.872 qpair failed and we were unable to recover it. 00:30:17.872 [2024-10-30 16:14:07.533931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.872 [2024-10-30 16:14:07.534041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.534067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.534179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.534299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.534327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.534441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.534519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.534545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.534660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.534744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.534771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.534887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.534978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.535004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.535114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.535201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.535227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.535359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.535449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.535477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.535565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.535678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.535705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.535821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.535936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.535962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.536043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.536127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.536153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.536238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.536361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.536388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.536471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.536593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.536620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.536703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.536789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.536817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.536901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.537012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.537039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.537121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.537211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.537238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.537356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.537443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.537470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.537580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.537662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.537688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.537778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.537884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.537910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.537995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.538078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.538106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.538220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.538350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.538377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.538488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.538619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.538645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.538728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.538842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.538871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.538984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.539074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.539100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.539210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.539324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.539351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.539444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.539556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.539582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.539690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.539801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.539826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.539908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.540020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.540046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.540159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.540239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.540274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.540360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.540477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.540503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.540615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.540730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.540756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.873 qpair failed and we were unable to recover it. 00:30:17.873 [2024-10-30 16:14:07.540897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.873 [2024-10-30 16:14:07.541006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.541033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.541174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.541288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.541329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.541423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.541558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.541585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.541672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.541810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.541836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.541924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.542006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.542033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.542118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.542201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.542228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.542362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.542446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.542472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.542584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.542705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.542732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.542815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.542949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.542975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.543091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.543202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.543228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.543349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.543427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.543454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.543560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.543716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.543746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.543860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.543971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.543997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.544134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.544217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.544243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.544342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.544433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.544461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.544581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.544701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.544727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.544818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.544909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.544935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.545024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.545110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.545136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.545246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.545375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.545401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.545542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.545658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.545683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.545801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.545883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.545909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.546020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.546158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.546189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.546273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.546369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.546394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.546486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.546581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.546607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.546716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.546804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.546830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.546968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.547046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.547072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.547184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.547268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.547295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.547374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.547457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.547484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.547575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.547717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.547744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.547861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.547941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.547967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.874 [2024-10-30 16:14:07.548045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.548124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.874 [2024-10-30 16:14:07.548149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.874 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.548290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.548382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.548408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.548497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.548580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.548606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.548697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.548809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.548837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.548945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.549034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.549060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.549173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.549265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.549292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.549413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.549494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.549521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.549631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.549714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.549740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.549821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.549934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.549959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.550044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.550160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.550185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.550301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.550418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.550443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.550545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.550618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.550643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.550763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.550847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.550873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.550961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.551071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.551097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.551204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.551317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.551345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.551451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.551579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.551609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.551696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.551785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.551811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.551901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.552027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.552055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.552169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.552312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.552339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.552482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.552559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.552584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.552676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.552794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.552820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.552931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.553037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.553063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.553211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.553339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.553366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.553450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.553563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.553589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.553678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.553791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.553818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.553914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.554057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.554082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.554169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.554253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.554290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.554380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.554460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.554486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.554607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.554722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.554748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.554864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.554946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.554973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.555057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.555172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.555199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.875 qpair failed and we were unable to recover it. 00:30:17.875 [2024-10-30 16:14:07.555315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.875 [2024-10-30 16:14:07.555429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.555457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.555551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.555674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.555700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.555788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.555909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.555935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.556029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.556144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.556170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.556282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.556382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.556408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.556528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.556645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.556672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.556763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.556844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.556870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.556982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.557067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.557093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.557177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.557296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.557322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.557416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.557513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.557546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.557634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.557715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.557741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.557830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.557937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.557964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.558072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.558158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.558184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.558268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.558382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.558408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.558522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.558642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.558676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.558783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.558868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.558893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.558977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.559059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.559085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.559199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.559281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.559309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.559405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.559516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.559550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.559684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.559800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.559826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.559909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.560034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.560061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.560207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.560309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.560337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.560455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.560546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.560572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.560694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.560809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.560835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.560925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.561034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.561061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.561142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.561252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.561287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.561372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.561479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.561506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.561605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.561718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.561745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.561832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.561917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.561942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.562057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.562136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.562162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.876 qpair failed and we were unable to recover it. 00:30:17.876 [2024-10-30 16:14:07.562282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.876 [2024-10-30 16:14:07.562371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.562398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.562516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.562625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.562651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.562761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.562839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.562865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.562949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.563062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.563088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.563179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.563290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.563317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.563399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.563507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.563534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.563648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.563737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.563763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.563876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.563992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.564018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.564106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.564234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.564266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.564372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.564512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.564548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.564661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.564754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.564779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.564917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.565008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.565035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.565121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.565211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.565237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.565358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.565447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.565474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.565588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.565674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.565701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.565814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.565890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.565916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.566020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.566100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.566126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.566238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.566361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.566389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.566469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.566577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.566603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.566695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.566807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.566832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.566944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.567082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.567107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.567194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.567311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.567338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.567423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.567515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.567540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.567652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.567746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.567772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.567884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.568000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.568026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.568137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.568223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.568248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.568342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.568420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.568446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.877 qpair failed and we were unable to recover it. 00:30:17.877 [2024-10-30 16:14:07.568567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.877 [2024-10-30 16:14:07.568673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.568699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.568813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.568904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.568930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.569061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.569162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.569192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.569287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.569421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.569448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.569560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.569656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.569683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.569779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.569923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.569949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.570033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.570152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.570178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.570298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.570419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.570446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.570563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.570646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.570672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.570766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.570851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.570879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.570993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.571072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.571098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.571181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.571271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.571303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.571417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.571507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.571544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.571632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.571725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.571751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.571880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.571969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.571996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.572106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.572194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.572220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.572314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.572431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.572459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.572605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.572694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.572721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.572808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.572897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.572923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.573012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.573127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.573152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.573236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.573330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.573357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.573472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.573551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.573578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.573668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.573767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.573793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.573873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.573955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.573981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.574120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.574208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.574240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.574336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.574449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.574475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.574567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.574682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.574708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.574795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.574883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.574910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.575021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.575099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.575124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.575279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.575391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.575417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.878 qpair failed and we were unable to recover it. 00:30:17.878 [2024-10-30 16:14:07.575537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.878 [2024-10-30 16:14:07.575648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.575674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.575752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.575865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.575891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.575972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.576112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.576139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.576246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.576342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.576368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.576461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.576574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.576605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.576696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.576771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.576797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.576924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.577013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.577039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.577194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.577292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.577318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.577404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.577518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.577544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.577681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.577759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.577786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.577930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.578040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.578065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.578151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.578267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.578295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.578390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.578501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.578526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.578639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.578719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.578746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.578845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.578935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.578967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.579082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.579166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.579192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.579319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.579401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.579426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.579531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.579658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.579682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.579815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.579896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.579922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.580008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.580122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.580150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.580266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.580358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.580385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.580467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.580575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.580602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.580711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.580787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.580814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.580897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.580983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.581011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.581090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.581203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.581234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.581326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.581408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.581435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.581516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.581594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.581621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.581736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.581877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.581903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.581985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.582096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.582123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.582266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.582354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.582393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.879 qpair failed and we were unable to recover it. 00:30:17.879 [2024-10-30 16:14:07.582541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.582656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.879 [2024-10-30 16:14:07.582684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.582779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.582859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.582885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.582976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.583092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.583119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.583231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.583345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.583373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.583517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.583657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.583683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.583776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.583894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.583921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.584033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.584148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.584175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.584287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.584404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.584431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.584522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.584642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.584669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.584776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.584888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.584915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.585006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.585114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.585140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.585259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.585348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.585376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.585492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.585604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.585631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.585715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.585832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.585859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.585973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.586089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.586115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.586202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.586322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.586350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.586460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.586573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.586600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.586717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.586798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.586824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.586930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.587070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.587096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.587183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.587295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.587322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.587398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.587478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.587505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.587623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.587708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.587734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.587814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.587898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.587925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.588007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.588148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.588175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.588322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.588437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.588465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.588560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.588675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.588703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.588818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.588907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.588934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.589029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.589154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.589180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.589270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.589411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.589439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.589554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.589674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.589700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.880 [2024-10-30 16:14:07.589804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.589962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.880 [2024-10-30 16:14:07.589992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.880 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.590111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.590228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.590253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.590376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.590488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.590518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.590631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.590742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.590767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.590887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.590999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.591025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.591121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.591211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.591237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.591329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.591444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.591470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.591582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.591673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.591698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.591827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.591942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.591967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.592074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.592183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.592210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.592300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.592414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.592441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.592558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.592638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.592664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.592778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.592894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.592920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.593037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.593109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.593136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.593249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.593336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.593361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.593450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.593562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.593588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.593701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.593837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.593863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.593946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.594033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.594058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.594139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.594226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.594252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.594385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.594462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.594487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.594642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.594757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.594784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.594899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.594984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.595010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.595120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.595205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.595231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.595357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.595435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.595462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.595548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.595653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.595679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.595780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.595896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.595921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.596050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.596132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.596158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.881 [2024-10-30 16:14:07.596299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.596385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.881 [2024-10-30 16:14:07.596412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.881 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.596497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.596611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.596637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.596757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.596909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.596936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.597029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.597141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.597169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.597252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.597383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.597410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.597526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.597635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.597662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.597801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.597884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.597909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.598024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.598133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.598158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.598263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.598379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.598405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.598492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.598579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.598606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.598685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.598780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.598806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.598917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.599028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.599054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.599166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.599275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.599302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.599389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.599502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.599527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.599621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.599701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.599727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.599838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.599915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.599941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.600048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.600190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.600217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.600365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.600482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.600508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.600625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.600708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.600743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.600857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.600971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.600998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.601084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.601197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.601223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.601324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.601405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.601430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.601520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.601601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.601628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.601770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.601847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.601873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.601959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.602101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.602127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.602235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.602378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.602405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.602499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.602608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.602635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.602743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.602865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.602891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.603006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.603126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.603152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.603284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.603372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.603399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.882 [2024-10-30 16:14:07.603480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.603597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.882 [2024-10-30 16:14:07.603623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.882 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.603706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.603817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.603845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.603958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.604042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.604069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.604157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.604299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.604325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.604436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.604540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.604567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.604650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.604763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.604789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.604867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.604955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.604982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.605099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.605181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.605208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.605303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.605421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.605447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.605522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.605632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.605658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.605740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.605852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.605878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.605995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.606073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.606099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.606208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.606321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.606348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.606435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.606545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.606572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.606655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.606765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.606791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.606904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.606998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.607024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.607165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.607320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.607351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.607499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.607590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.607616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.607696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.607816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.607843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.607958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.608066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.608093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.608231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.608353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.608390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.608511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.608637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.608662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.608772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.608858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.608884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.609004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.609086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.609112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.609191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.609281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.609307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.609423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.609530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.609556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.609664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.609776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.609802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.609891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.609999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.610025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.610106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.610208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.610238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.610324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.610433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.610458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.883 [2024-10-30 16:14:07.610543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.610622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.883 [2024-10-30 16:14:07.610649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.883 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.610795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.610912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.610938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.611085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.611201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.611226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.611358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.611449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.611475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.611561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.611674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.611700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.611797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.611887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.611913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.611996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.612109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.612135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.612215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.612342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.612369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.612514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.612621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.612647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.612787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.612903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.612928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.613014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.613105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.613131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.613213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.613303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.613331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.613468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.613580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.613606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.613726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.613829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.613855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.613977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.614096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.614121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.614216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.614359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.614386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.614497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.614612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.614645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.614756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.614858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.614883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.614992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.615099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.615125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.615246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.615373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.615400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.615479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.615591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.615617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.615734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.615858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.615884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.615972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.616061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.616086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.616165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.616250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.616288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.616427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.616550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.616576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.616690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.616799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.616826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.616932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.617042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.617068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.617183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.617284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.617312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.617426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.617546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.617572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.617740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.617863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.617889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.617996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.618102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.618127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.884 qpair failed and we were unable to recover it. 00:30:17.884 [2024-10-30 16:14:07.618233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.884 [2024-10-30 16:14:07.618372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.618398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.618510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.618645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.618670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.618781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.618869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.618894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.619002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.619074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.619100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.619217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.619309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.619335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.619420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.619502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.619527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.619645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.619724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.619749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.619829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.619909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.619935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.620047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.620187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.620212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.620315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.620422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.620447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.620547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.620671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.620697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.620781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.620863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.620889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.620972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.621081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.621106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.621180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.621294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.621321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.621462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.621545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.621570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.621658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.621741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.621766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.621870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.621950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.621974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.622087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.622204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.622230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.622352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.622445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.622476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.622590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.622676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.622702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.622800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.622915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.622940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.623080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.623210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.623237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.623330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.623414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.623440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.623527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.623631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.623656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.623765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.623861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.623886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.623971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.624086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.624113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.624226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.624328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.624355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.885 qpair failed and we were unable to recover it. 00:30:17.885 [2024-10-30 16:14:07.624464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.885 [2024-10-30 16:14:07.624579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.624605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.624740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.624821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.624846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.624970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.625053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.625080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.625168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.625266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.625292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.625406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.625518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.625545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.625621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.625755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.625779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.625865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.625939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.625964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.626049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.626180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.626205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.626316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.626393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.626419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.626506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.626616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.626642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.626784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.626863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.626891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.627031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.627144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.627170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.627253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.627347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.627373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.627497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.627586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.627611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.627726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.627839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.627865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.627985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.628098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.628123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.628245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.628369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.628394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.628512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.628600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.628626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.628738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.628823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.628848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.628956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.629031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.629055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.629136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.629243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.629275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.629355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.629443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.629469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.629609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.629722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.629748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.629834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.629916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.629941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.630059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.630171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.630197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.630281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.630372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.630397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.630475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.630621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.630646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.630732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.630835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.630860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.630972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.631112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.631137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.631248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.631370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.631394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.886 qpair failed and we were unable to recover it. 00:30:17.886 [2024-10-30 16:14:07.631535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.631629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.886 [2024-10-30 16:14:07.631655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.631795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.631868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.631893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.632006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.632121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.632147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.632269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.632352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.632378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.632487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.632594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.632620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.632730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.632867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.632893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.633006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.633096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.633122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.633212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.633302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.633328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.633413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.633515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.633540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.633626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.633743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.633769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.633882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.633990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.634015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.634094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.634207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.634232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.634355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.634472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.634502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.634614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.634707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.634732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.634816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.634900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.634925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.635039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.635142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.635168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.635312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.635398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.635436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.635557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.635642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.635679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.635774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.635883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.635908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.636048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.636162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.636188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.636277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.636383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.636409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.636519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.636605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.636630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.636775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.636886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.636917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.637034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.637120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.637145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.637263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.637347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.637372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.637463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.637602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.637628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.637772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.637858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.637884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.637976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.638085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.638110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.638203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.638278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.638310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.638420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.638532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.638558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.638648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.638757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.887 [2024-10-30 16:14:07.638783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.887 qpair failed and we were unable to recover it. 00:30:17.887 [2024-10-30 16:14:07.638889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.638973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.639001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.639140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.639250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.639283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.639384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.639524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.639550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.639667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.639777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.639810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.639929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.640041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.640066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.640180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.640281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.640317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.640434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.640560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.640585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.640707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.640820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.640846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.640973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.641063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.641087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.641171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.641266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.641292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.641367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.641463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.641488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.641602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.641728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.641754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.641904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.642042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.642067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.642182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.642267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.642295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.642416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.642558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.642585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.642696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.642803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.642827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.642918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.643007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.643033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.643154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.643230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.643260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.643345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.643467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.643493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.643584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.643709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.643735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.643828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.643935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.643960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.644043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.644155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.644181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.644298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.644448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.644484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.644571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.644689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.644725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.644801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.644880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.644906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.644981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.645068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.645093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.645174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.645270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.645309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.645418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.645506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.645544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.645660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.645804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.645830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.645911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.646025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.646051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.888 qpair failed and we were unable to recover it. 00:30:17.888 [2024-10-30 16:14:07.646190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.646275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.888 [2024-10-30 16:14:07.646304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.646425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.646562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.646588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.646670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.646749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.646774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.646884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.646988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.647013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.647095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.647199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.647225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.647379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.647494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.647521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.647640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.647751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.647777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.647854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.647971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.647997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.648080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.648187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.648212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.648321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.648446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.648475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.648560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.648673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.648700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.648819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.648936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.648965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.649112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.649201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.649235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.649358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.649473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.649502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.649590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.649731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.649758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.649843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.649953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.649980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.650068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.650143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.650170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.650279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.650366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.650393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.650502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.650613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.650640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.650747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.650828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.650855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.650966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.651071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.651098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.651186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.651280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.651307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.651424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.651508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.651542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.651633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.651750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.651777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.651918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.652030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.652057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.652169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.652288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.652315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.652390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.652509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.652535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.652623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.652725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.652751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.652844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.652928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.652954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.653048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.653133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.653162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.653252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.653377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.889 [2024-10-30 16:14:07.653404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.889 qpair failed and we were unable to recover it. 00:30:17.889 [2024-10-30 16:14:07.653543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.653629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.653655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.653735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.653854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.653886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.654000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.654105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.654132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.654220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.654342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.654369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.654484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.654600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.654627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.654740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.654879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.654906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.655047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.655159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.655188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.655300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.655441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.655468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.655583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.655664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.655692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.655773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.655886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.655913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.656031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.656149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.656176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.656320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.656411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.656439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.656535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.656648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.656674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.656784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.656869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.656896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.657015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.657106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.657133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.657220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.657369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.657396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.657513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.657624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.657650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.657736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.657873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.657901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.658014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.658104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.890 [2024-10-30 16:14:07.658132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.890 qpair failed and we were unable to recover it. 00:30:17.890 [2024-10-30 16:14:07.658222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.658372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.658400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.658483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.658569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.658597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.658675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.658812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.658839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.658989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.659080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.659107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.659222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.659374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.659412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.659537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.659648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.659675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.659782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.659897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.659924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.660000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.660071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.660098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.660187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.660269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.660299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.660386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.660525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.660552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.660666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.660776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.660804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.660882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.661003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.661030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.661114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.661196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.661223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.661343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.661431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.661459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.661570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.661687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.661714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.661861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.661985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.662012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.662122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.662214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.662241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.662345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.662469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.662496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.662621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.662730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.662756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.662868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.662949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.662976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.663059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.663170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.663197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.663315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.663395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.663423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.663515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.663607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.663633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.663735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.663828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.663854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.663934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.664041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.664068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.664152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.664231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.664265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.664350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.664437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.664467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.664610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.664735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.664762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.891 qpair failed and we were unable to recover it. 00:30:17.891 [2024-10-30 16:14:07.664850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.664933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.891 [2024-10-30 16:14:07.664961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.665044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.665163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.665190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.665274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.665416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.665443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.665566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.665671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.665699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.665809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.665919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.665945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.666069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.666184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.666210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.666321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.666401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.666428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.666509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.666654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.666680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.666769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.666885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.666911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.667031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.667145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.667172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.667268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.667390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.667417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.667561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.667642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.667669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.667793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.667921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.667948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.668062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.668178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.668207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.668308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.668392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.668419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.668533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.668612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.668639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.668757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.668863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.668890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.669031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.669125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.669152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.669278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.669390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.669417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.669525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.669667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.669694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.669811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.669921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.669948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.670028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.670125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.670152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.670244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.670399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.892 [2024-10-30 16:14:07.670426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.892 qpair failed and we were unable to recover it. 00:30:17.892 [2024-10-30 16:14:07.670541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.670651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.670678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.670790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.670902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.670928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.671023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.671150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.671180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.671274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.671378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.671413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.671529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.671643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.671670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.671820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.671907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.671934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.672051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.672173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.672201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.672344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.672422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.672450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.672537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.672620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.672647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.672760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.672841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.672868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.672959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.673084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.673111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.673225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.673319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.673346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.673507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.673607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.673638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.673731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.673838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.673864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.674008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.674094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.674124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.674214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.674306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.674334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.674444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.674553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.674580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.674689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.674776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.674802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.674915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.675026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.675053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.675135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.675240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.675276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.675363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.675472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.675498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.675588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.675731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.675757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.675846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.675931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.675958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.893 qpair failed and we were unable to recover it. 00:30:17.893 [2024-10-30 16:14:07.676047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.893 [2024-10-30 16:14:07.676162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.676187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.676301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.676410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.676435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.676516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.676626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.676652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.676788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.676924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.676950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.677071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.677162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.677187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.677315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.677428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.677455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.677532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.677620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.677646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.677751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.677834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.677864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.677956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.678074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.678100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.678215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.678360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.678388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.678473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.678556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.678583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.678697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.678781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.678806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.678894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.679031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.679057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.679171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.679267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.679294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.679410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.679492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.679518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.679611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.679697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.679723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.679870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.679984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.680009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.680092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.680176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.680203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.680294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.680406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.680432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.680517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.680629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.680655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.680755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.680881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.680910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.680996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.681105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.681131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.681215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.681364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.681391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.681473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.681576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.894 [2024-10-30 16:14:07.681601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.894 qpair failed and we were unable to recover it. 00:30:17.894 [2024-10-30 16:14:07.681687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.681764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.681789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.681876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.681986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.682012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.682125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.682236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.682269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.682396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.682514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.682540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.682625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.682717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.682743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.682864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.682951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.682982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.683095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.683184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.683210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.683362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.683468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.683493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.683612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.683700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.683727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.683819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.683930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.683955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.684036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.684142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.684167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.684297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.684424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.684453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.684578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.684692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.684719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.684838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.684943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.684970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.685057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.685133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.685158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.685268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.685394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.685420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.685525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.685684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.685710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.685823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.685931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.685958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.686074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.686179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.686206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.689343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.689437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.689462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.689552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.689694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.689719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.895 qpair failed and we were unable to recover it. 00:30:17.895 [2024-10-30 16:14:07.689809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.689881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.895 [2024-10-30 16:14:07.689907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.896 qpair failed and we were unable to recover it. 00:30:17.896 [2024-10-30 16:14:07.690021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.690107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.690132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.896 qpair failed and we were unable to recover it. 00:30:17.896 [2024-10-30 16:14:07.690244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.690340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.690366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.896 qpair failed and we were unable to recover it. 00:30:17.896 [2024-10-30 16:14:07.690502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.690620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.690647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.896 qpair failed and we were unable to recover it. 00:30:17.896 [2024-10-30 16:14:07.690763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.690878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.690904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.896 qpair failed and we were unable to recover it. 00:30:17.896 [2024-10-30 16:14:07.691002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.691141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.691167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.896 qpair failed and we were unable to recover it. 00:30:17.896 [2024-10-30 16:14:07.691277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.691367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.691394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.896 qpair failed and we were unable to recover it. 00:30:17.896 [2024-10-30 16:14:07.691474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.691594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.691621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.896 qpair failed and we were unable to recover it. 00:30:17.896 [2024-10-30 16:14:07.691735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.691852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.691878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.896 qpair failed and we were unable to recover it. 00:30:17.896 [2024-10-30 16:14:07.691961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.692098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.692123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.896 qpair failed and we were unable to recover it. 00:30:17.896 [2024-10-30 16:14:07.692238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.692363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.692391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.896 qpair failed and we were unable to recover it. 00:30:17.896 [2024-10-30 16:14:07.692504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.692623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.692649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.896 qpair failed and we were unable to recover it. 00:30:17.896 [2024-10-30 16:14:07.692761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.692897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.692923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.896 qpair failed and we were unable to recover it. 00:30:17.896 [2024-10-30 16:14:07.693036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.693147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.693174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.896 qpair failed and we were unable to recover it. 00:30:17.896 [2024-10-30 16:14:07.693284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.693394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.896 [2024-10-30 16:14:07.693423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.693547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.693659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.693686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.693777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.693857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.693883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.694001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.694083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.694108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.694189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.694301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.694327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.694411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.694504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.694534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.694647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.694719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.694744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.694853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.694955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.694980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.695071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.695183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.695209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.695315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.695392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.695419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.695499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.695641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.695668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.695764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.695850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.695875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.696022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.696108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.696133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.696245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.696344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.696371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.696494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.696613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.696640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.696776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.696888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.696915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.697030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.697146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.697172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.697296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.697381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.697408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.697528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.697641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.697668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.697775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.697862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.697887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.697976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.698090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.698116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.698265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.698361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.698387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.698480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.698602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.698628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.698768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.698854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.698879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.698988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.699064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.699089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.699201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.699295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.699321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.699407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.699495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.699528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.699640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.699733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.699761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.699868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.700006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.700036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.897 [2024-10-30 16:14:07.700183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.700277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.897 [2024-10-30 16:14:07.700305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.897 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.700400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.700479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.700506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.700589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.700712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.700740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.700881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.701018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.701045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.701163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.701266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.701303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.701402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.701515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.701542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.701631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.701715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.701742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.701858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.701969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.701997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.702084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.702171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.702198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.702343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.702433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.702461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.702561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.702675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.702702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.702818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.702905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.702933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.703078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.703165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.703192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.703334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.703446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.703473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.703623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.703707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.703733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.703848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.703966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.703993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.704100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.704217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.704244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.704337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.704451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.704478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:17.898 qpair failed and we were unable to recover it. 00:30:17.898 [2024-10-30 16:14:07.704616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.898 [2024-10-30 16:14:07.704698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.704725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.704839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.704920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.704948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.705068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.705177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.705203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.705296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.705377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.705404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.705495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.705610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.705637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.705725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.705838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.705865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.705980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.706091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.706117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.706231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.706351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.706378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.706470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.706578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.706605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.706718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.706844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.706871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.706990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.707132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.707159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.707275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.707388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.707415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.707500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.707620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.707647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.707764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.707850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.707878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.707967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.708055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.708082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.708221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.708311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.708338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.708419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.708526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.708553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.708644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.708725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.708753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.708875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.708985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.709011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.709126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.709238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.709273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.709367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.709482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.709509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.709621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.709706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.709733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.709850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.709962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.709988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.710068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.710182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.710210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.710333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.710439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.710470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.710586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.710711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.710738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.710852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.710934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.710961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.182 [2024-10-30 16:14:07.711076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.711195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.182 [2024-10-30 16:14:07.711221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.182 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.711348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.711437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.711464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.711609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.711693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.711720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.711815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.711936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.711964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.712075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.712188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.712215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.712307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.712420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.712446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.712587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.712674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.712700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.712842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.712949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.712980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.713118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.713243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.713278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.713391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.713506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.713533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.713644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.713753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.713780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.713871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.713967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.713993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.714107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.714188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.714215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.714312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.714450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.714476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.714561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.714678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.714706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.714798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.714936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.714962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.715050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.715162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.715189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.715305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.715416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.715447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.715540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.715657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.715683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.715825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.715914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.715941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.716022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.716132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.716158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.716241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.716368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.716396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.716505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.716621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.716649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.716765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.716888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.716914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.717027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.717108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.717134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.717246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.717352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.717379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.717491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.717602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.717629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.717743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.717854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.717886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.718030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.718118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.718144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.718226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.718322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.718349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.183 qpair failed and we were unable to recover it. 00:30:18.183 [2024-10-30 16:14:07.718467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.183 [2024-10-30 16:14:07.718550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.718577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.718661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.718765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.718791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.718933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.719013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.719039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.719182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.719267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.719295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.719410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.719552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.719579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.719697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.719803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.719829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.719942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.720079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.720106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.720224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.720345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.720373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.720496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.720605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.720632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.720778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.720864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.720892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.721035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.721112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.721138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.721228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.721353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.721381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.721462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.721613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.721639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.721727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.721861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.721888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.721966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.722046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.722073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.722211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.722300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.722327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.722407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.722544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.722571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.722683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.722810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.722836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.722955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.723069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.723097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.723181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.723291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.723317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.723402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.723538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.723563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.723639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.723718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.723745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.723854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.723967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.723994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.724112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.724274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.724303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.724422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.724506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.724532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.724644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.724798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.724825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.724912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.725034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.725061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.725201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.725315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.725343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.725461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.725579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.725605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.725694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.725841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.184 [2024-10-30 16:14:07.725867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.184 qpair failed and we were unable to recover it. 00:30:18.184 [2024-10-30 16:14:07.725980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.726067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.726094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.726213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.726302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.726329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.726443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.726556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.726582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.726691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.726802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.726828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.726965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.727050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.727076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.727213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.727330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.727356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.727447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.727522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.727548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.727691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.727781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.727808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.727888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.727976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.728002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.728085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.728194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.728222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.728340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.728450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.728477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.728562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.728699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.728725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.728848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.728938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.728966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.729104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.729220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.729246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.729347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.729463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.729490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.729603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.729683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.729710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.729794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.729931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.729957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.730079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.730221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.730248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.730404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.730548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.730575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.730649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.730733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.730761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.730878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.730995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.731022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.731137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.731243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.731277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.731390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.731474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.731501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.731617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.731735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.731762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.731906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.731990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.732017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.732111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.732201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.732227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.732327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.732471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.732498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.732612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.732762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.732789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.732881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.733021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.733047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.733133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.733246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.733288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.185 qpair failed and we were unable to recover it. 00:30:18.185 [2024-10-30 16:14:07.733409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.185 [2024-10-30 16:14:07.733525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.733551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.733665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.733787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.733814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.733936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.734033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.734060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.734177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.734275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.734303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.734419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.734550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.734577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.734724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.734840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.734867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.734954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.735059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.735086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.735169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.735292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.735320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.735468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.735557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.735584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.735673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.735761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.735787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.735899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.736012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.736039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.736125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.736212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.736238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.736328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.736439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.736466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.736557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.736673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.736699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.736810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.736891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.736917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.737024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.737131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.737157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.737248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.737331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.737359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.737445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.737554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.737581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.737691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.737832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.737859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.737975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.738088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.738115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.738254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.738365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.738392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.738483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.738566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.738592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.738709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.738825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.738851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.738964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.739054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.739079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.739226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.739356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.739384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.186 [2024-10-30 16:14:07.739459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.739597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.186 [2024-10-30 16:14:07.739623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.186 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.739706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.739818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.739843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.740037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.740180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.740206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.740328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.740425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.740451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.740561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.740648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.740674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.740789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.740867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.740893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.740977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.741066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.741094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.741235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.741399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.741427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.741521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.741663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.741689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.741831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.741908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.741934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.742046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.742136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.742161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.742239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.742350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.742376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.742456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.742595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.742622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.742764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.742882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.742909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.742998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.743112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.743138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.743253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.743376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.743402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.743479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.743582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.743608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.743723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.743814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.743840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.743952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.744091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.744118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.744197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.744282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.744310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.744395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.744516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.744543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.744659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.744774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.744801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.744917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.745026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.745052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.745137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.745287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.745315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.745404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.745515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.745541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.745710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.745851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.745876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.745964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.746051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.746078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.746192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.746301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.746328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.746446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.746590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.746616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.746731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.746870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.746897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.187 [2024-10-30 16:14:07.746988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.747100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.187 [2024-10-30 16:14:07.747128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.187 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.747216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.747363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.747390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.747478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.747616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.747643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.747759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.747878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.747905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.747989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.748097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.748123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.748280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.748405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.748432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.748541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.748647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.748673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.748781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.748921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.748948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.749023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.749129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.749155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.749272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.749386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.749413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.749531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.749671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.749697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.749838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.749919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.749947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.750064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.750152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.750177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.750290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.750374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.750405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.750488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.750598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.750624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.750713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.750829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.750857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.750942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.751017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.751042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.751219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.751341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.751368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.751459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.751538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.751564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.751704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.751816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.751843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.751959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.752072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.752099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.752213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.752335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.752362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.752445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.752556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.752584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.752698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.752788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.752820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.752965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.753048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.753074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.753157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.753290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.753318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.753460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.753584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.753611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.753733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.753846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.753874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.754013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.754148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.754175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.754292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.754410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.754438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.754526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.754664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.754690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.188 qpair failed and we were unable to recover it. 00:30:18.188 [2024-10-30 16:14:07.754835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.188 [2024-10-30 16:14:07.754945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.754973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.755078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.755220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.755247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.755403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.755512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.755544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.755740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.755860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.755887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.755977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.756089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.756116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.756265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.756354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.756380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.756494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.756610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.756637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.756746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.756853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.756879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.756967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.757070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.757097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.757212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.757347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.757374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.757516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.757605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.757631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.757720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.757800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.757828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.757916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.758061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.758095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.758206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.758292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.758318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.758458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.758539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.758566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.758678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.758769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.758795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.758886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.758998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.759025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.759135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.759254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.759286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.759400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.759538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.759567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.759658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.759743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.759770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.759890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.760032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.760059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.760171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.760280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.760307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.760418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.760535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.760562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.760794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.760904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.760930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.761079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.761171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.761199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.761319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.761439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.761465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.761550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.761662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.761689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.761803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.761917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.761943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.762086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.762198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.762225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.762375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.762487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.762514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.189 qpair failed and we were unable to recover it. 00:30:18.189 [2024-10-30 16:14:07.762625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.762705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.189 [2024-10-30 16:14:07.762731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.762827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.762936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.762962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.763049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.763137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.763164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.763253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.763343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.763371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.763489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.763602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.763629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.763749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.763862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.763890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.763981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.764100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.764127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.764224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.764321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.764347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.764437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.764573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.764600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.764714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.764800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.764827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.764913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.765033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.765059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.765172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.765261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.765289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.765404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.765554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.765581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.765728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.765818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.765845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.765952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.766068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.766095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.766204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.766285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.766313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.766408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.766522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.766549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.766664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.766799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.766825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.766911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.767017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.767043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.767162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.767275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.767302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.767414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.767493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.767519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.767634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.767723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.767749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.767867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.767977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.768003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.768122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.768235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.768268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.768384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.768479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.768506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.768644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.768762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.768789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.768937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.769023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.769049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.190 qpair failed and we were unable to recover it. 00:30:18.190 [2024-10-30 16:14:07.769168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.190 [2024-10-30 16:14:07.769309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.769337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.769421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.769527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.769554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.769669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.769787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.769813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.769894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.770003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.770031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.770141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.770232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.770266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.770362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.770477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.770504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.770627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.770767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.770794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.770938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.771024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.771050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.771136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.771282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.771310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.771452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.771566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.771593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.771678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.771787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.771814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.771930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.772093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.772120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.772235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.772407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.772434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.772549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.772689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.772716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.772829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.772943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.772969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.773108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.773193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.773219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.773331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.773440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.773466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.773574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.773681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.773707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.773815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.773927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.773953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.774027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.774138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.774166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.774245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.774329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.774356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.774470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.774587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.774614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.774725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.774844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.774870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.774995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.775107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.775133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.775221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.775369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.775396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.775511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.775649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.775675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.775790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.775931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.775957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.776063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.776178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.776204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.776321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.776414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.776441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.776565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.776703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.776730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.191 qpair failed and we were unable to recover it. 00:30:18.191 [2024-10-30 16:14:07.776818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.191 [2024-10-30 16:14:07.776966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.776993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.777121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.777206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.777233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.777375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.777489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.777516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.777612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.777754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.777780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.777869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.777980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.778006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.778121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.778234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.778268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.778367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.778447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.778473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.778590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.778667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.778692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.778805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.778916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.778943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.779063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.779153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.779180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.779300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.779416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.779443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.779561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.779696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.779722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.779837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.779931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.779957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.780045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.780135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.780162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.780284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.780426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.780453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.780570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.780658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.780686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.780798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.780945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.780972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.781088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.781208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.781234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.781378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.781488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.781514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.781629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.781768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.781794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.781934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.782078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.782104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.782194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.782278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.782305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.782427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.782574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.782600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.782718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.782803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.782829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.782968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.783077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.783103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.783214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.783330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.783358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.783472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.783595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.783622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.783707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.783814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.783840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.783955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.784097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.784123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.784207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.784323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.784350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.192 [2024-10-30 16:14:07.784469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.784592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.192 [2024-10-30 16:14:07.784618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.192 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.784731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.784870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.784896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.785011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.785094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.785120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.785231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.785348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.785375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.785488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.785604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.785630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.785742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.785856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.785883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.785998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.786140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.786166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.786287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.786403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.786430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.786521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.786662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.786689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.786808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.786891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.786918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.787034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.787154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.787179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.787298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.787414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.787440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.787551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.787662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.787688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.787801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.787908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.787934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.788050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.788168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.788194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.788282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.788360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.788387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.788499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.788646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.788673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.788815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.788932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.788957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.789105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.789247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.789289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.789410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.789550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.789577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.789692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.789819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.789846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.789934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.790046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.790073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.790185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.790288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.790314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.790434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.790550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.790578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.790673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.790792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.790819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.790930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.791037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.791063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.791211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.791330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.791361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.791480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.791565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.791592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.791709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.791820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.791846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.791933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.792070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.792096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.193 qpair failed and we were unable to recover it. 00:30:18.193 [2024-10-30 16:14:07.792239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.193 [2024-10-30 16:14:07.792332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.792359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.792449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.792531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.792557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.792646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.792758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.792785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.792897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.793013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.793039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.793153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.793297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.793325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.793445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.793583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.793609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.793728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.793809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.793840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.793966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.794105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.794133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.794265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.794352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.794379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.794491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.794632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.794659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.794778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.794893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.794919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.795034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.795120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.795147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.795266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.795381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.795408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.795553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.795670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.795697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.795780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.795891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.795918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.796001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.796148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.796175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.796293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.796435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.796469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.796584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.796700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.796727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.796818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.796907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.796935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.797040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.797155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.797182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.797288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.797407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.797433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.797525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.797609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.797635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.797753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.797843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.797869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.797983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.798120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.798147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.798265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.798351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.798378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.798492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.798607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.798634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.798711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.798819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.798845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.798928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.799043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.799069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.799161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.799274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.799302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.799419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.799507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.799533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.194 [2024-10-30 16:14:07.799644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.799793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.194 [2024-10-30 16:14:07.799819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.194 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.799935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.800027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.800054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.800145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.800265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.800292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.800385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.800468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.800495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.800582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.800663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.800689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.800805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.800894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.800922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.801067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.801178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.801204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.801305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.801390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.801418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.801534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.801623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.801649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.801763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.801855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.801882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.801997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.802104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.802131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.802222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.802369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.802397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.802511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.802630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.802658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.802771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.802851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.802879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.803017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.803129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.803156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.803268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.803385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.803413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.803505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.803589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.803616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.803706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.803820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.803847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.803956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.804047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.804073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.804189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.804296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.804323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.804407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.804483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.804510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.804619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.804725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.804752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.804862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.804936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.804962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.805085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.805172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.805199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.805319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.805408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.805435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.805551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.805667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.805693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.805809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.805884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.805911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.195 qpair failed and we were unable to recover it. 00:30:18.195 [2024-10-30 16:14:07.806031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.806114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.195 [2024-10-30 16:14:07.806141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.806279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.806376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.806403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.806518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.806626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.806653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.806771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.806863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.806890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.807002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.807152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.807179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.807298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.807387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.807415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.807534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.807615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.807643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.807762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.807902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.807928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.808020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.808130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.808157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.808308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.808446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.808473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.808590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.808674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.808701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.808811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.808955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.808981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.809060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.809172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.809199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.809335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.809422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.809451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.809538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.809683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.809710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.809796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.809901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.809927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.810016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.810124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.810150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.810234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.810354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.810382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.810498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.810635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.810662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.810780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.810865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.810893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.810980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.811134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.811161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.811245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.811373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.811400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.811482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.811574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.811601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.811695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.811835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.811862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.811951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.812091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.812118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.812240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.812364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.812392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.812498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.812586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.812614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.812693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.812783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.812809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.812929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.813036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.813063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.813174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.813281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.813308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.813452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.813536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.196 [2024-10-30 16:14:07.813562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.196 qpair failed and we were unable to recover it. 00:30:18.196 [2024-10-30 16:14:07.813676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.813790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.813817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.813910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.814025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.814052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.814192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.814300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.814328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.814419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.814534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.814562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.814678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.814794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.814821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.814931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.815041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.815067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.815158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.815245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.815278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.815358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.815469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.815497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.815587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.815706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.815733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.815877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.815963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.815990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.816101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.816213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.816240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.816333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.816448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.816475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.816619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.816728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.816755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.816842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.816957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.816983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.817091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.817206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.817233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.817352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.817435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.817462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.817578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.817691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.817717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.817826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.817906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.817932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.818020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.818157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.818184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.818328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.818450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.818477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.818560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.818646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.818673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.818770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.818849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.818876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.819021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.819134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.819160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.819239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.819333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.819361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.819474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.819603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.819630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.819712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.819785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.819812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.819927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.820042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.820070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.820188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.820304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.820332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.820449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.820540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.820566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.820704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.820785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.820811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.197 qpair failed and we were unable to recover it. 00:30:18.197 [2024-10-30 16:14:07.820926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.197 [2024-10-30 16:14:07.821035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.821062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.821206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.821357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.821385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.821525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.821640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.821666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.821761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.821835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.821862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.821972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.822118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.822145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.822287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.822445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.822472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.822608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.822720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.822746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.822831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.822973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.822999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.823114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.823225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.823253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.823387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.823487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.823513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.823657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.823763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.823791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.823872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.824013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.824040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.824116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.824197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.824224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.824320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.824404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.824430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.824524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.824638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.824665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.824747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.824858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.824883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.824971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.825086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.825112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.825261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.825345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.825372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.825490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.825616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.825643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.825719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.825833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.825860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.825978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.826093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.826121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.826241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.826357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.826384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.826474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.826577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.826603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.826697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.826776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.826802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.826913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.826994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.827021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.827131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.827244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.827278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.827431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.827560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.827588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.827707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.827817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.827843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.827962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.828040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.828066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.828183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.828324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.828356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.198 [2024-10-30 16:14:07.828473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.828557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.198 [2024-10-30 16:14:07.828583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.198 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.828704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.828818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.828845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.828989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.829101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.829129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.829247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.829406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.829433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.829549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.829662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.829689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.829772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.829912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.829939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.830076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.830166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.830197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.830308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.830396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.830424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.830506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.830611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.830637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.830745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.830886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.830917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.831037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.831155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.831182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.831277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.831389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.831416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.831529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.831610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.831642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.831757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.831870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.831897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.832008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.832094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.832120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.832209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.832332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.832359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.832475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.832587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.832613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.832696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.832800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.832826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.832934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.833049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.833074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.833185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.833329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.833363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.833449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.833533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.833560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.833678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.833804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.833831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.833942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.834030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.834056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.834172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.834267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.834306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.834398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.834505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.834531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.834646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.834725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.834751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.834833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.834951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.834978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.199 qpair failed and we were unable to recover it. 00:30:18.199 [2024-10-30 16:14:07.835059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.835178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.199 [2024-10-30 16:14:07.835205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.835326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.835407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.835433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.835545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.835646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.835677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.835795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.835911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.835936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.836025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.836174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.836210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.836366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.836474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.836501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.836611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.836724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.836751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.836898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.837017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.837043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.837136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.837224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.837251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.837410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.837552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.837579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.837660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.837740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.837767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.837888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.838002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.838029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.838150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.838269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.838297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.838380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.838497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.838524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.838627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.838747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.838774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.838879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.838964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.838991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.839079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.839203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.839230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.839347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.839430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.839455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.839564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.839678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.839706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.839821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.839941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.839968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.840085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.840168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.840194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.840275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.840382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.840408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.840550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.840632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.840659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.840747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.840860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.840886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.840979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.841066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.841093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.841185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.841272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.841299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.841439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.841549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.841576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.841692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.841773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.841800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.841876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.841955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.841981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.842097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.842206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.842231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.200 [2024-10-30 16:14:07.842356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.842500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.200 [2024-10-30 16:14:07.842526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.200 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.842612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.842702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.842728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.842841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.842957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.842984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.843106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.843214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.843239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.843388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.843503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.843530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.843614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.843698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.843725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.843810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.843889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.843915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.844030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.844141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.844168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.844275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.844360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.844387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.844477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.844599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.844627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.844745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.844839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.844865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.844952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.845094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.845121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.845234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.845332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.845358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.845476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.845594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.845621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.845738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.845881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.845908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.846024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.846141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.846168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.846263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.846350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.846377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.846485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.846599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.846626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.846735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.846849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.846877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.846987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.847098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.847126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.847246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.847361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.847388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.847535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.847647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.847673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.847759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.847870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.847897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.848041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.848130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.848157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.848237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.848335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.848362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.848475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.848567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.848593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.848697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.848814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.848841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.848958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.849101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.849128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.849220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.849378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.849407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.849516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.849601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.849628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.849769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.849885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.201 [2024-10-30 16:14:07.849912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.201 qpair failed and we were unable to recover it. 00:30:18.201 [2024-10-30 16:14:07.850030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.850115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.850142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.850225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.850312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.850340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.850498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.850612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.850640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.850752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.850869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.850895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.850990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.851106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.851134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.851282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.851399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.851427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.851540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.851626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.851652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.851770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.851909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.851936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.852021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.852102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.852130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.852271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.852358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.852385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.852495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.852610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.852637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.852744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.852884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.852911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.853297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.853451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.853481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.853568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.853694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.853723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.854053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.854188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.854217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.854324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.854417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.854444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.854560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.854672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.854700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.854845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.854984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.855010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.855090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.855201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.855227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.855361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.855474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.855501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.855620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.855737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.855764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.855877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.855997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.856024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.856114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.856231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.856266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.856353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.856471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.856498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.856576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.856696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.856723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.856814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.856928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.856955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.857066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.857184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.857212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.857352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.857438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.857465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.857551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.857633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.857660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.857803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.857914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.857941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.202 qpair failed and we were unable to recover it. 00:30:18.202 [2024-10-30 16:14:07.858058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.202 [2024-10-30 16:14:07.858141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.858168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.858252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.858408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.858436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.858547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.858646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.858683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.858767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.858845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.858872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.858976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.859065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.859093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.859204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.859297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.859325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.859416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.859509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.859542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.859656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.859743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.859771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.859881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.859985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.860012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.860126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.860212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.860238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.860366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.860445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.860472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.860587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.860699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.860726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.860845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.860965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.860992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.861102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.861224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.861251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.861383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.861502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.861540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.861681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.861770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.861796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.861877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.861995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.862022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.862132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.862238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.862274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.862373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.862457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.862484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.862579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.862719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.862745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.862856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.862938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.862964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.863071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.863159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.863186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.863299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.863390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.863417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.863535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.863675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.863701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.863794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.863909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.863936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.864045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.864138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.864164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.864283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.864403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.864430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.203 qpair failed and we were unable to recover it. 00:30:18.203 [2024-10-30 16:14:07.864541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.203 [2024-10-30 16:14:07.864626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.864652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.864796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.864904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.864930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.865019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.865163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.865190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.865274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.865393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.865419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.865502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.865595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.865622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.865762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.865878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.865904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.865992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.866138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.866165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.866254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.866343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.866369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.866451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.866569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.866596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.866703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.866812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.866841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.866931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.867008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.867035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.867126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.867239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.867277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.867375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.867519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.867545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.867660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.867738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.867764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.867874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.868014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.868040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.868123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.868213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.868244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.868396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.868515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.868542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.868657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.868736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.868763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.868850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.868937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.868965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.869077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.869154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.869181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.869284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.869366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.869393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.869511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.869634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.869660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.869773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.869867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.869894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.870033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.870121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.870148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.870247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.870369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.870396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.870512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.870619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.870662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.870747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.870832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.870861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.870935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.871047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.871074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.871156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.871243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.871277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.871376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.871516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.871544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.204 [2024-10-30 16:14:07.871653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.871800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.204 [2024-10-30 16:14:07.871828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.204 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.871945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.872028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.872056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.872141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.872220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.872247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.872402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.872511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.872543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.872667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.872781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.872808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.872921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.873041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.873072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.873148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.873266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.873305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.873420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.873498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.873537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.873645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.873752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.873779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.873898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.873980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.874006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.874156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.874269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.874296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.874415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.874537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.874563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.874654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.874772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.874799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.874888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.875000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.875026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.875139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.875265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.875293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.875425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.875563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.875594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.875722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.875806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.875832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.875909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.876026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.876054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.876143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.876232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.876283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.876377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.876455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.876481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.876591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.876709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.876735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.876852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.876928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.876954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.877042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.877146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.877172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.877282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.877367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.877395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.877502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.877628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.877655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.877744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.877830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.877856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.877979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.878103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.878130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.878269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.878371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.878397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.878488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.878578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.878604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.878718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.878800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.878829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.878941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.879061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.879088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.205 qpair failed and we were unable to recover it. 00:30:18.205 [2024-10-30 16:14:07.879215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.205 [2024-10-30 16:14:07.879323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.879350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.879457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.879596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.879623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.879731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.879812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.879839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.879965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.880077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.880103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.880222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.880337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.880365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.880481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.880562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.880590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.880744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.880862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.880889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.880997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.881138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.881165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.881246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.881341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.881369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.881455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.881577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.881604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.881723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.881801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.881828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.881941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.882020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.882047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.882164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.882283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.882319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.882460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.882619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.882646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.882736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.882855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.882884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.883008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.883150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.883177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.883267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.883386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.883413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.883539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.883656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.883684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.883773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.883887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.883914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.884038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.884142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.884170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.884284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.884433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.884461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.884597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.884716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.884743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.884860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.884982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.885009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.885095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.885183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.885209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.885322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.885439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.885467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.885602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.885743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.885770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.885851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.885993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.886020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.886135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.886216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.886242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.886380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.886455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.886482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.886625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.886767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.886794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.206 qpair failed and we were unable to recover it. 00:30:18.206 [2024-10-30 16:14:07.886935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.887050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.206 [2024-10-30 16:14:07.887077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.887154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.887238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.887273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.887378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.887493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.887527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.887639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.887719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.887747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.887859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.887973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.887999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.888089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.888202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.888228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.888363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.888479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.888505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.888624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.888769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.888797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.888910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.889025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.889052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.889164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.889273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.889311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.889402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.889542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.889568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.889686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.889772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.889799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.889937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.890018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.890044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.890162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.890237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.890271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.890365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.890473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.890499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.890624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.890763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.890789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.890899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.891006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.891032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.891117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.891227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.891254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.891420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.891536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.891563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.891675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.891818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.891845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.891954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.892066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.892093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.892208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.892329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.892356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.892466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.892560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.892586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.892696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.892812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.892838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.892921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.893001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.893028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.893138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.893300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.893331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.893463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.893551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.893578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.893693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.893780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.893807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.207 qpair failed and we were unable to recover it. 00:30:18.207 [2024-10-30 16:14:07.893921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.893996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.207 [2024-10-30 16:14:07.894022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.894138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.894226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.894253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.894375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.894460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.894486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.894581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.894693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.894719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.894801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.894910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.894937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.895052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.895160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.895185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.895313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.895425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.895451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.895602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.895731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.895760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.895910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.896017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.896043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.896171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.896302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.896331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.896421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.896536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.896562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.896680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.896763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.896788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.896877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.896993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.897019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.897130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.897244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.897279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.897368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.897475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.897501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.897623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.897734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.897770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.897884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.897989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.898015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.898092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.898203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.898229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.898325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.898435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.898461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.898580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.898671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.898697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.898784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.898898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.898923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.899011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.899098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.899123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.899205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.899321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.899348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.899456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.899550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.899576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.899714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.899825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.899851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.899962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.900050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.900078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.900192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.900307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.900333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.900419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.900504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.900544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.900657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.900793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.900818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.900928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.901041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.208 [2024-10-30 16:14:07.901066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.208 qpair failed and we were unable to recover it. 00:30:18.208 [2024-10-30 16:14:07.901179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.901272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.901305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.901442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.901546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.901571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.901654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.901760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.901785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.901872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.901989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.902014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.902129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.902244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.902275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.902369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.902482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.902508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.902652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.902796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.902833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.902975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.903058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.903083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.903201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.903322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.903349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.903467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.903586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.903613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.903697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.903781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.903806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.903920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.904012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.904038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.904145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.904232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.904268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.904387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.904491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.904516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.904597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.904735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.904760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.904874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.904984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.905010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.905147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.905231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.905264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.905392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.905474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.905499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.905597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.905766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.905791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.905902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.905982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.906008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.906116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.906224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.906249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.906380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.906460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.906485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.906604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.906689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.906714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.906853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.906929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.906955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.907032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.907117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.907143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.907232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.907363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.907389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.907501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.907587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.907613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.907760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.907858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.907883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.907973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.908081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.908115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.908229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.908343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.908371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.209 [2024-10-30 16:14:07.908478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.908584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.209 [2024-10-30 16:14:07.908609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.209 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.908715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.908809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.908834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.908925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.909014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.909042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.909158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.909268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.909306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.909387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.909499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.909531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.909644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.909784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.909810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.909961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.910074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.910100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.910190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.910281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.910317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.910461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.910569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.910594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.910746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.910832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.910856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.910967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.911057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.911082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.911167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.911290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.911327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.911443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.911521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.911547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.911662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.911771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.911798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.911938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.912018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.912044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.912157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.912272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.912310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.912422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.912564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.912590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.912710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.912824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.912851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.912928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.913041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.913072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.913155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.913245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.913277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.913389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.913481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.913506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.913606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.913715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.913740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.913852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.913938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.913964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.914074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.914190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.914217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.914327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.914433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.914460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.914599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.914717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.914742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.914853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.914944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.914969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.915076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.915186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.915213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.915341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.915492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.915517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.915640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.915755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.915780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.915871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.915984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.916010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.210 qpair failed and we were unable to recover it. 00:30:18.210 [2024-10-30 16:14:07.916118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.210 [2024-10-30 16:14:07.916231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.916262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.916348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.916457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.916482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.916572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.916653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.916679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.916763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.916879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.916905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.916996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.917111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.917137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.917261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.917362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.917387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.917496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.917620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.917645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.917754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.917868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.917893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.918015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.918107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.918134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.918245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.918346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.918371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.918483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.918595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.918620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.918704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.918787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.918813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.918888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.918975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.919000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.919121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.919234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.919274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.919396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.919473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.919498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.919612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.919727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.919752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.919861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.919941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.919966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.920084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.920189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.920214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.920374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.920467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.920492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.920587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.920700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.920725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.920851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.920968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.920993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.921072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.921157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.921183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.921304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.921423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.921449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.921567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.921677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.921704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.921846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.921961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.921987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.922063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.922173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.922200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.922306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.922419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.922445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.922567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.922699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.922725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.922839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.922941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.922967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.923082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.923187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.923213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.211 [2024-10-30 16:14:07.923339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.923480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.211 [2024-10-30 16:14:07.923506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.211 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.923593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.923699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.923725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.923840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.923977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.924003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.924116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.924254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.924285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.924399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.924481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.924507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.924602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.924715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.924741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.924893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.924977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.925002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.925095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.925236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.925270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.925395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.925539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.925569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.925681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.925767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.925794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.925907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.926026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.926052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.926143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.926266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.926292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.926401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.926514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.926539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.926645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.926733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.926758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.926870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.927013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.927038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.927152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.927269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.927295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.928060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.928204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.928231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.928368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.928488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.928513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.928656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.928729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.928759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.928873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.928956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.928981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.929089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.929203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.929230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.929338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.929446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.929472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.929614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.929718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.929743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.929828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.929941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.929969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.930087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.930178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.930204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.930311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.930450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.930476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.930590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.930698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.930723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.930807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.930884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.212 [2024-10-30 16:14:07.930910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.212 qpair failed and we were unable to recover it. 00:30:18.212 [2024-10-30 16:14:07.930993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.931128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.931154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.931238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.931365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.931390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.931517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.931627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.931652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.931772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.931854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.931879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.931970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.932054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.932080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.932170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.932254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.932286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.932373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.932480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.932507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.932581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.932671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.932697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.932811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.932924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.932949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.933073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.933187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.933212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.933306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.933396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.933421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.933565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.933647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.933672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.933751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.933830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.933855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.933972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.934700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.934732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.934849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.934968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.934994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.935083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.935167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.935193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.935307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.935422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.935448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.935563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.935688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.935715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.935858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.935963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.935989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.936106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.936191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.936217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.936378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.936494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.936528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.936658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.936780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.936806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.936897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.937016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.937042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.937129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.937243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.937275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.937388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.937474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.937500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.937633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.937749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.937775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.937870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.938005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.938030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.938113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.938201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.938229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.938382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.938496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.938527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.938603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.938676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.938702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.213 qpair failed and we were unable to recover it. 00:30:18.213 [2024-10-30 16:14:07.938815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.938891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.213 [2024-10-30 16:14:07.938916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.938992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.939087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.939112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.939222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.939346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.939371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.939460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.939552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.939576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.939685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.939771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.939796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.939913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.939995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.940020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.940094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.940206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.940231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.940351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.940433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.940458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.940542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.940648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.940673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.940791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.940878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.940902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.940984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.941096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.941121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.941207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.941325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.941354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.941472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.941626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.941651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.941743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.941826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.941852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.941969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.942050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.942074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.942161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.942247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.942276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.942371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.942445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.942470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.942606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.942694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.942718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.942879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.942970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.942995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.943131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.943214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.943240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.943345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.943421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.943445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.943564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.943646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.943672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.943757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.943831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.943856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.943996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.944090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.944114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.944218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.944353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.944379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.944464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.944549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.944574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.944687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.944767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.944791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.944870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.944982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.945008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.945128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.945234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.945264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.945385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.945492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.945517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.945605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.945746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.945771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.214 qpair failed and we were unable to recover it. 00:30:18.214 [2024-10-30 16:14:07.945865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.214 [2024-10-30 16:14:07.945950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.945975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.946056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.946161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.946185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.946275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.946368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.946392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.946507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.946615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.946640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.946733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.946811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.946836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.946954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.947033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.947057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.947173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.947318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.947344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.947422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.947546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.947572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.947660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.947773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.947798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.947922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.948004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.948028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.948110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.948219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.948242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.948402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.948481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.948506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.948629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.948705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.948729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.948838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.948952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.948977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.949071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.949181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.949206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.949311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.949418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.949443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.949560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.949647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.949672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.949750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.949838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.949863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.949967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.950069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.950095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.950205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.950321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.950347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.950425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.950512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.950537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.950629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.950725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.950749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.950841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.950954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.950979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.951095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.951177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.951201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.951295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.951371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.951396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.951483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.951568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.951594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.951731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.951812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.951838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.951945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.952055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.952079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.952228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.952343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.952368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.952463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.952547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.952571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.215 [2024-10-30 16:14:07.952694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.952783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.215 [2024-10-30 16:14:07.952807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.215 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.952894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.952972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.953001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.953111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.953249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.953280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.953368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.953478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.953503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.953621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.953697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.953721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.953831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.953934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.953959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.954043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.954183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.954208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.954331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.954413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.954438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.954519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.954604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.954628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.954715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.954825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.954850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.954937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.955054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.955079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.955164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.955285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.955310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.955425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.955512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.955536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.955674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.955784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.955809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.955920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.956007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.956031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.956147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.956237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.956273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.956383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.956498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.956531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.956621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.956705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.956729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.956842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.956982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.957006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.957088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.957206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.957231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.957353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.957488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.957512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.957594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.957703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.957727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.957823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.957912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.957938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.958054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.958139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.958164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.958252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.958376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.958401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.958486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.958593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.958617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.958709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.958824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.958849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.958988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.959126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.216 [2024-10-30 16:14:07.959150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.216 qpair failed and we were unable to recover it. 00:30:18.216 [2024-10-30 16:14:07.959242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.959395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.959419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.959507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.959620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.959644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.959741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.959854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.959878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.959992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.960087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.960112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.960202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.960305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.960331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.960441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.960560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.960586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.960704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.960814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.960839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.960933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.961043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.961067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.961162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.961274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.961299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.961387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.961490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.961516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.961633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.961718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.961744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.961860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.961973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.961998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.962082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.962186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.962211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.962317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.962398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.962422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.962533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.962625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.962650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.962726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.962807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.962832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.962916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.963031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.963057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.963165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.963279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.963304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.963415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.963492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.963516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.963649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.963736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.963760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.963901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.963984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.964009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.964093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.964188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.964212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.964313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.964428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.964452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.964548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.964625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.964649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.964737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.964823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.964851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.964939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.965061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.965086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.965211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.965299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.965326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.965439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.965534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.965560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.965654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.965736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.965760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.965855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.965939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.965964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.217 qpair failed and we were unable to recover it. 00:30:18.217 [2024-10-30 16:14:07.966045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.217 [2024-10-30 16:14:07.966130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.966155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.966266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.966392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.966416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.966493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.966568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.966593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.966707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.966790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.966815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.966904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.967028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.967056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.967138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.967246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.967277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.967368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.967455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.967479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.967583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.967694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.967719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.967860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.967940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.967964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.968046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.968155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.968180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.968268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.968359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.968384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.968492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.968600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.968625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.968702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.968817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.968843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.968927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.969051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.969076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.969158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.969305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.969331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.969426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.969546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.969575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.969692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.969800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.969826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.969914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.970053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.970078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.970163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.970243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.970275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.970397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.970510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.970534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.970611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.970746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.970771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.970861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.970974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.970999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.971114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.971193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.971218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.971370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.971513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.971544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.971655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.971741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.971766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.971883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.971963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.971988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.972072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.972153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.972177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.972285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.972386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.972411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.972523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.972611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.972635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.972752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.972840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.972865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.972957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.973036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.218 [2024-10-30 16:14:07.973062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.218 qpair failed and we were unable to recover it. 00:30:18.218 [2024-10-30 16:14:07.973172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.973297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.973332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.973426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.973548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.973573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.973655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.973765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.973789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.973887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.973999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.974025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.974138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.974219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.974245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.974359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.974441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.974466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.974595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.974708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.974738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.974822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.974903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.974928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.975035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.975144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.975169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.975249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.975342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.975367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.975475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.975594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.975619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.975701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.975812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.975836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.975922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.976030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.976054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.976164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.976274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.976307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.976395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.976478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.976503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.976622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.976706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.976732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.976844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.976983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.977007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.977145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.977270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.977296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.977428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.977510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.977539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.977655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.977742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.977766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.977872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.978006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.978030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.978109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.978213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.978237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.978327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.978413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.978438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.978518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.978604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.978628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.978740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.978849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.978877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.978996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.979078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.979102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.979212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.979317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.979343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.979452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.979563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.979587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.979664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.979768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.979793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.979888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.979998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.980024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.219 qpair failed and we were unable to recover it. 00:30:18.219 [2024-10-30 16:14:07.980113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.980220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.219 [2024-10-30 16:14:07.980244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.980345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.980428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.980452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.980574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.980684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.980708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.980782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.980869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.980893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.981008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.981113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.981138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.981230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.981353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.981378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.981493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.981588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.981613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.981728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.981810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.981834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.981950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.982060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.982085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.982174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.982253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.982285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.982398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.982486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.982510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.982602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.982683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.982708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.982789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.982872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.982897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.982980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.983061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.983085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.983222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.983371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.983397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.983511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.983630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.983655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.983768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.983851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.983875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.983953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.984033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.984057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.984197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.984332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.984357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.984475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.984591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.984615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.984724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.984807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.984832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.984947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.985035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.985061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.985146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.985250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.985280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.985371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.985456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.985481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.985572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.985659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.985684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.985770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.985887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.985912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.986023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.986107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.986131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.220 [2024-10-30 16:14:07.986246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.986359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.220 [2024-10-30 16:14:07.986383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.220 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.986472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.986605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.986630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.986718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.986882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.986907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.987045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.987124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.987149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.987236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.987375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.987400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.987540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.987655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.987679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.987789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.987868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.987894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.987979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.988128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.988153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.988297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.988393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.988418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.988503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.988638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.988663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.988774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.988886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.988911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.989000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.989102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.989126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.989199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.989347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.989373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.989479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.989569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.989593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.989691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.989834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.989859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.989969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.990105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.990129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.990243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.990383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.990407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.990529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.990598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.990622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.990730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.990807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.990836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.990931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.991004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.991029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.991148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.991265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.991291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.991371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.991464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.991489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.991624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.991748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.991773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.991891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.991984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.992010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.992123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.992264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.992290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.992427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.992510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.992536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.992652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.992736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.992760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.992842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.992918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.992942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.993059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.993166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.993190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.993310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.993433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.993458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.993546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.993682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.993706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.221 qpair failed and we were unable to recover it. 00:30:18.221 [2024-10-30 16:14:07.993824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.221 [2024-10-30 16:14:07.993934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.993960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.994068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.994176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.994200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.994277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.994386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.994411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.994528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.994633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.994658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.994735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.994873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.994898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.994986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.995094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.995120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.995205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.995319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.995344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.995459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.995564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.995589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.995733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.995868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.995893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.995981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.996065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.996089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.996179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.996319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.996345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.996438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.996517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.996541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.996621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.996731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.996755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.996867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.996950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.996975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.997064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.997181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.997206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.997345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.997465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.997490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.997607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.997690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.997715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.997829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.997914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.997940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.998030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.998144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.998169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.998283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.998369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.998393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.998473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.998561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.998586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.998725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.998836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.998860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.998950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.999063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.999088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.999178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.999286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.999312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.999395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.999480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.999507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.999596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.999734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:07.999759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:07.999894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:08.000038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:08.000063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:08.000175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:08.000264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:08.000291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:08.000406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:08.000523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:08.000548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:08.000631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:08.000738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:08.000763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.222 [2024-10-30 16:14:08.000913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:08.001017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.222 [2024-10-30 16:14:08.001041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.222 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.001133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.001277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.001308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.001420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.001534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.001560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.001649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.001728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.001753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.001840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.001947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.001972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.002081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.002163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.002187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.002299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.002415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.002440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.002528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.002639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.002664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.002754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.002865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.002895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.003002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.003113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.003137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.003221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.003336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.003361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.003456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.003571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.003597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.003740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.003852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.003877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.003990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.004101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.004125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.004235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.004327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.004353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.004443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.004594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.004618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.004733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.004841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.004866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.004953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.005088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.005113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.005193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.005297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.005322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.005418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.005523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.005548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.005660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.005743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.005768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.005880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.005992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.006018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.006156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.006246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.006281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.006366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.006478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.006503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.006619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.006704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.006729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.006846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.006930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.006955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.007040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.007145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.007170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.007263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.007349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.007373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.007486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.007599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.007630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.007723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.007836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.007861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.007948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.008026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.008051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.223 qpair failed and we were unable to recover it. 00:30:18.223 [2024-10-30 16:14:08.008176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.223 [2024-10-30 16:14:08.008288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.008314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.008427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.008515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.008540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.008629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.008742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.008766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.008853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.008932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.008957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.009040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.009177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.009202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.009317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.009400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.009425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.009519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.009630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.009655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.009789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.009902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.009927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.010017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.010107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.010132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.010222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.010341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.010366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.010504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.010589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.010614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.010701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.010811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.010835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.010909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.011044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.011069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.011153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.011234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.011266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.011376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.011451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.011477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.011562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.011640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.011665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.011750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.011878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.011903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.012016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.012090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.012115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.012253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.012385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.012412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.012491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.012594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.012618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.012737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.012817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.012841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.012921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.013024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.013049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.013158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.013246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.013314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.013436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.013557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.013582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.013671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.013759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.013783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.013893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.014041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.014066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.014198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.014322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.014362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.014448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.014599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.014626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.014712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.014848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.014875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.014970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.015056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.015084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.224 [2024-10-30 16:14:08.015174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.015297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.224 [2024-10-30 16:14:08.015324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.224 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.015408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.015552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.015579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.015664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.015771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.015797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.015887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.015972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.016004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.016119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.016211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.016239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.016332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.016469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.016496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.016611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.016699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.016725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.016811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.016887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.016913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.017019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.017129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.017160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.017313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.017425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.017451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.017559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.017679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.017706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.017796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.017903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.017929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.018018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.018134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.018161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.018249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.018364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.018392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.018507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.018586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.018613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.018699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.018814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.018840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.018930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.019035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.019061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.019143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.019264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.019292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.019381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.019520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.019550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.019665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.019792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.019817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.019927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.020039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.020065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.020174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.020264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.020292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.020375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.020486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.020513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.020605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.020684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.020710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.225 qpair failed and we were unable to recover it. 00:30:18.225 [2024-10-30 16:14:08.020821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.225 [2024-10-30 16:14:08.020948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.020975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.021112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.021202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.021228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.021339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.021428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.021454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.021539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.021618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.021644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.021724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.021836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.021866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.021957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.022074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.022100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.022213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.022296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.022324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.022422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.022504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.022530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.022647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.022761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.022788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.022925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.023004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.023030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.023141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.023228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.023253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.023360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.023451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.023476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.023587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.023668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.023695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.023805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.023916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.023942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.024054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.024162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.024192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.024273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.024390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.024417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.024509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.024614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.024640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.024718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.024809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.024835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.024951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.025033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.025059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.025172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.025289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.025317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.025428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.025510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.025536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.025619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.025706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.025731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.025826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.025935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.025960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.226 qpair failed and we were unable to recover it. 00:30:18.226 [2024-10-30 16:14:08.026069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.226 [2024-10-30 16:14:08.026149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.026174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.026293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.026403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.026430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.026548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.026633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.026659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.026772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.026881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.026907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.026990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.027103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.027131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.027240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.027363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.027390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.027475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.027553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.027578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.027666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.027771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.027796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.027882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.027966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.027991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.028079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.028222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.028248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.028344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.028459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.028486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.028566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.028677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.028704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.028829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.028905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.028932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.029019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.029091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.029118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.029226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.029316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.029343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.029462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.029553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.029578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.029714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.029825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.029851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.029934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.030018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.030044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.030128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.030241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.030274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.030391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.030472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.030499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.030589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.030684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.030710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.030790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.030906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.030932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.031026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.031139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.031164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.031245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.031363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.031389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.031480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.031568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.031595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.031705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.031785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.031811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.031914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.032031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.032057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.032170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.032287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.032315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.032424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.032536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.032562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.032648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.032761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.032788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.032875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.032957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.032984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.033070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.033158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.033185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.227 qpair failed and we were unable to recover it. 00:30:18.227 [2024-10-30 16:14:08.033303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.033409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.227 [2024-10-30 16:14:08.033435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.228 qpair failed and we were unable to recover it. 00:30:18.228 [2024-10-30 16:14:08.033519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.033601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.033627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.228 qpair failed and we were unable to recover it. 00:30:18.228 [2024-10-30 16:14:08.033737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.033823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.033849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.228 qpair failed and we were unable to recover it. 00:30:18.228 [2024-10-30 16:14:08.033946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.034059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.034085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.228 qpair failed and we were unable to recover it. 00:30:18.228 [2024-10-30 16:14:08.034175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.034252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.034286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.228 qpair failed and we were unable to recover it. 00:30:18.228 [2024-10-30 16:14:08.034405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.034543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.034568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.228 qpair failed and we were unable to recover it. 00:30:18.228 [2024-10-30 16:14:08.034684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.034800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.034826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.228 qpair failed and we were unable to recover it. 00:30:18.228 [2024-10-30 16:14:08.034939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.035052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.035079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.228 qpair failed and we were unable to recover it. 00:30:18.228 [2024-10-30 16:14:08.035186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.035275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.035302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.228 qpair failed and we were unable to recover it. 00:30:18.228 [2024-10-30 16:14:08.035382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.035464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.035491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.228 qpair failed and we were unable to recover it. 00:30:18.228 [2024-10-30 16:14:08.035620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.035725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.035751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.228 qpair failed and we were unable to recover it. 00:30:18.228 [2024-10-30 16:14:08.035845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.035954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.228 [2024-10-30 16:14:08.035979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.228 qpair failed and we were unable to recover it. 00:30:18.228 [2024-10-30 16:14:08.036096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.036240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.036276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.036362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.036488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.036514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.036628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.036714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.036749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.036842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.036930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.036956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.037040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.037136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.037162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.037242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.037345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.037372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.037483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.037573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.037599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.037688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.037796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.037822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.037965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.038076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.038102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.038183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.038270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.038296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.038378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.038466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.038492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.038585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.038700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.038727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.038818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.038930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.038956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.039047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.039157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.039183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.039301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.039383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.039409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.039549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.039663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.039689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.039779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.039863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.039891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.040032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.040111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.040137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.040251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.040355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.040382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.040463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.040581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.040607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.040683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.040790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.040815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.511 qpair failed and we were unable to recover it. 00:30:18.511 [2024-10-30 16:14:08.040900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.511 [2024-10-30 16:14:08.041018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.041043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.041149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.041266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.041293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.041378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.041468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.041496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.041575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.041711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.041738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.041852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.041936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.041962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.042091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.042236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.042271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.042394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.042502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.042527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.042612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.042699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.042727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.042816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.042905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.042931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.043011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.043098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.043124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.043205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.043328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.043355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.043473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.043560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.043589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.043669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.043781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.043806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.043896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.044021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.044048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.044171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.044254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.044287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.044378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.044485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.044511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.044618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.044708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.044735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.044823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.044975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.045002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.045092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.045200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.045227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.045320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.045437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.045463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.045560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.045674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.045700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.045793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.045907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.045943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.046084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.046223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.046249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.046340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.046422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.046450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.046589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.046674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.046700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.046785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.046870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.046897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.047015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.047128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.047154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.047244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.047373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.047400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.047510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.047588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.047614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.047700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.047837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.047862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.512 qpair failed and we were unable to recover it. 00:30:18.512 [2024-10-30 16:14:08.047945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.512 [2024-10-30 16:14:08.048057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.048085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.048176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.048292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.048319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.048406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.048512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.048539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.048615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.048722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.048747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.048836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.048948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.048975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.049050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.049141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.049167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.049276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.049363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.049390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.049470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.049586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.049613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.049729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.049808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.049835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.049952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.050031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.050057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.050169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.050253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.050285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.050378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.050491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.050517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.050625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.050707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.050732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.050809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.050907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.050934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.051018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.051130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.051156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.051267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.051351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.051378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.051456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.051562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.051588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.051727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.051801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.051837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.051951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.052061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.052087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.052194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.052289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.052317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.052400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.052507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.052533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.052621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.052698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.052728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.052821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.052963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.052989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.053098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.053184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.053210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.053337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.053450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.053476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.053565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.053706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.053731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.053819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.053937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.053963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.054053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.054190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.054220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.054311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.054404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.054430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.054543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.054682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.054708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.513 qpair failed and we were unable to recover it. 00:30:18.513 [2024-10-30 16:14:08.054820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.513 [2024-10-30 16:14:08.054932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.054958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.055066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.055204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.055229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.055349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.055431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.055458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.055542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.055620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.055647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.055755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.055872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.055899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.055990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.056078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.056106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.056187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.056277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.056304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.056380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.056458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.056488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.056604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.056682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.056707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.056790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.056880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.056905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.057013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.057088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.057113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.057202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.057320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.057347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.057457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.057546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.057573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.057660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.057802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.057829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.057942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.058023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.058050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.058191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.058303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.058331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.058439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.058534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.058560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.058674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.058786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.058817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.058913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.059028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.059053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.059136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.059225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.059251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.059384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.059490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.059516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.059630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.059748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.059773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.059881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.059990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.060016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.060125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.060216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.060242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.060335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.060428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.060455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.060543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.060656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.060683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.060763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.060856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.060883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.061022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.061157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.061184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.061299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.061414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.061441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.061531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.061618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.061643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.514 [2024-10-30 16:14:08.061727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.061843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.514 [2024-10-30 16:14:08.061869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.514 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.061989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.062077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.062102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.062214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.062308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.062337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.062428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.062539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.062566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.062678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.062764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.062790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.062904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.063021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.063048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.063162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.063261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.063288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.063372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.063457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.063482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.063578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.063690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.063716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.063842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.063956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.063983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.064071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.064180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.064216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.064345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.064488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.064515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.064601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.064714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.064740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.064849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.064986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.065012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.065129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.065271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.065301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.065439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.065525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.065551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.065658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.065750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.065776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.065874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.065997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.066024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.066139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.066224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.066250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.066386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.066478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.066503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.066583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.066694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.066721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.066840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.066952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.066979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.067062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.067153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.067179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.067286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.067370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.067396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.067512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.067597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.067623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.067721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.067831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.067857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.515 [2024-10-30 16:14:08.067940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.068055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.515 [2024-10-30 16:14:08.068081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.515 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.068169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.068251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.068285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.068372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.068478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.068504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.068579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.068688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.068714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.068798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.068885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.068910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.069021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.069129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.069154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.069270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.069382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.069408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.069522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.069630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.069656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.069749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.069828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.069855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.069969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.070076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.070102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.070215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.070306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.070334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.070446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.070557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.070583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.070664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.070779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.070804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.070944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.071056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.071082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.071169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.071244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.071278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.071423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.071509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.071534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.071618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.071708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.071734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.071814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.071932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.071960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.072074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.072216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.072242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.072330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.072443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.072469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.072561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.072639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.072665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.072755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.072868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.072894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.073012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.073123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.073150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.073238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.073364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.073390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.073471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.073586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.073611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.073698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.073810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.073836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.073949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.074059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.074086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.074195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.074316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.074343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.074479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.074584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.074609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.074724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.074819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.074845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.074927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.075013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.516 [2024-10-30 16:14:08.075038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.516 qpair failed and we were unable to recover it. 00:30:18.516 [2024-10-30 16:14:08.075122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.075234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.075268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.075389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.075507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.075533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.075614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.075720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.075746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.075836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.075958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.075986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.076073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.076163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.076191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.076313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.076429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.076455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.076546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.076658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.076683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.076773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.076858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.076884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.077021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.077108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.077135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.077251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.077386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.077413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.077502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.077613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.077643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.077779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.077909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.077939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.078085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.078200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.078227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.078321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.078406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.078432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.078526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.078604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.078631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.078750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.078859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.078885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.078976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.079087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.079112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.079196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.079280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.079307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.079394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.079481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.079507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.079617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.079697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.079723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.079827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.079918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.079944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.080054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.080166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.080192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.080302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.080385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.080412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.080505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.080619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.080644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.080732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.080845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.080871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.080950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.081057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.081083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.081195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.081309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.081335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.081448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.081538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.081562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.081696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.081794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.081823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.081906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.082020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.082046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.517 qpair failed and we were unable to recover it. 00:30:18.517 [2024-10-30 16:14:08.082142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-10-30 16:14:08.082253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.082289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.082384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.082497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.082521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.082662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.082740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.082764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.082881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.082960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.082985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.083069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.083173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.083199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.083313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.083423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.083448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.083548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.083627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.083653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.083761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.083870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.083894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.083975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.084049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.084072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.084159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.084274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.084300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.084396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.084533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.084559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.084646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.084783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.084813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.084931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.085065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.085090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.085171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.085283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.085308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.085421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.085506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.085531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.085642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.085726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.085751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.085836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.085943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.085970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.086078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.086163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.086187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.086301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.086411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.086436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.086519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.086621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.086645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.086738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.086848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.086873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.086963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.087074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.087103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.087192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.087279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.087304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.087392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.087476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.087501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.087581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.087722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.087746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.087872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.087956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.087982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.088066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.088182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.088206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.088292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.088375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.088400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.088483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.088593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.088618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.088738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.088825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.088850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.088937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.089047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-10-30 16:14:08.089072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.518 qpair failed and we were unable to recover it. 00:30:18.518 [2024-10-30 16:14:08.089158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.089268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.089294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.089399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.089532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.089560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.089653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.089737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.089764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.089876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.089983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.090009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.090094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.090173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.090199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.090291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.090379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.090405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.090495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.090587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.090616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.090714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.090852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.090877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.090991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.091101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.091126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.091203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.091291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.091317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.091428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.091503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.091527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.091621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.091711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.091738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.091832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.091976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.092001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.092143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.092277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.092303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.092392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.092479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.092504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.092581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.092700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.092726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.092817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.092905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.092931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.093020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.093099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.093123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.093210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.093355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.093381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.093497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.093577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.093602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.093711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.093793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.093819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.093912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.094036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.094061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.094172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.094247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.094283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.094360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.094445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.094469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.094578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.094660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.094685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.094770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.094876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.094901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.095015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.095129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-10-30 16:14:08.095155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.519 qpair failed and we were unable to recover it. 00:30:18.519 [2024-10-30 16:14:08.095250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.095364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.095389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.095501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.095613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.095639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.095731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.095813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.095838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.095950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.096054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.096079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.096191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.096332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.096359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.096474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.096558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.096584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.096669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.096742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.096766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.096881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.096994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.097018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.097132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.097275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.097300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.097384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.097469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.097495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.097612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.097694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.097718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.097812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.097894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.097919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.098010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.098120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.098144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.098253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.098353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.098378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.098538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.098619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.098647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.098735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.098821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.098845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.098955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.099055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.099080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.099171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.099284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.099309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.099396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.099507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.099531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.099613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.099695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.099720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.099804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.099890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.099916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.100005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.100088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.100114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.100223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.100336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.100361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.100446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.100517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.100541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.100656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.100740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.100764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.100857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.100939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.100965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.101073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.101161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.101186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.101280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.101365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.101389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.101484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.101569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.101593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.101672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.101752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.101778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.520 [2024-10-30 16:14:08.101892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.102006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-10-30 16:14:08.102031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.520 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.102170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.102273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.102297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.102412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.102497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.102521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.102666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.102754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.102779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.102889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.102999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.103024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.103147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.103260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.103285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.103411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.103495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.103520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.103661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.103773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.103798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.103904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.104011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.104036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.104129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.104212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.104237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.104337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.104471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.104502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.104583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.104675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.104700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.104781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.104865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.104892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.104982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.105069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.105096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.105232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.105338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.105365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.105492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.105609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.105635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.105731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.105842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.105868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.105951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.106030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.106058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.106176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.106292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.106320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.106435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.106522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.106549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.106642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.106723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.106750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.106869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.106978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.107005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.107152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.107236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.107272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.107385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.107500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.107525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.107614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.107726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.107753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.107843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.107924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.107952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.108041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.108125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.108151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.108239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.108362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.108389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.108532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.108645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.108671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.108752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.108841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.108867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.108964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.109052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.521 [2024-10-30 16:14:08.109078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.521 qpair failed and we were unable to recover it. 00:30:18.521 [2024-10-30 16:14:08.109191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.109279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.109307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.109398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.109497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.109523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.109606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.109696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.109723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.109808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.109920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.109956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.110033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.110174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.110200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.110324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.110445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.110472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.110596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.110708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.110734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.110830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.110918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.110944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.111059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.111138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.111165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.111282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.111399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.111425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.111542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.111650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.111676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.111765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.111847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.111873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.111951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.112045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.112071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.112153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.112269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.112296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.112389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.112514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.112540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.112681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.112796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.112822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.112911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.113030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.113056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.113198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.113312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.113339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.113420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.113557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.113584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.113665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.113772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.113797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.113908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.114025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.114050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.114135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.114246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.114282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.114369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.114449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.114476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.114594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.114700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.114725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.114834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.114955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.114980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.115097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.115180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.115206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.115344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.115485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.115511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.115592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.115735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.115761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.115902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.116017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.116044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.116131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.116244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.116278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.522 qpair failed and we were unable to recover it. 00:30:18.522 [2024-10-30 16:14:08.116374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.522 [2024-10-30 16:14:08.116487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.116513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.116630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.116718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.116744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.116884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.116997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.117023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.117131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.117262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.117290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.117434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.117531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.117558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.117674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.117786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.117813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.117930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.118008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.118034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.118141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.118245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.118286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.118396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.118483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.118509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.118601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.118677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.118703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.118818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.118933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.118958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.119076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.119191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.119218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.119324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.119407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.119433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.119538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.119652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.119677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.119787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.119877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.119908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.120052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.120131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.120157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.120239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.120354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.120380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.120495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.120610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.120636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.120725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.120868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.120894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.120982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.121096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.121122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.121231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.121359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.121389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.121483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.121600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.121625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.121750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.121858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.121883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.122002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.122111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.122137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.122248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.122372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.122402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.122521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.122638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.122664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.122740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.122865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.122891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.123038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.123128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.123155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.123248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.123401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.123428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.123516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.123599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.123625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.523 [2024-10-30 16:14:08.123718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.123827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.523 [2024-10-30 16:14:08.123853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.523 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.123967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.124049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.124076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.124192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.124274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.124301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.124410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.124524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.124550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.124690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.124800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.124831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.124945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.125057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.125083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.125174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.125293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.125320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.125432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.125524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.125550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.125662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.125807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.125834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.125922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.126007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.126035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.126179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.126268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.126297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.126395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.126486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.126511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.126625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.126709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.126736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.126827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.126963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.126989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.127104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.127191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.127222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.127351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.127439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.127466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.127568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.127647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.127674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.127756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.127843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.127870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.127985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.128073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.128101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.128218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.128351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.128379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.128490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.128579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.128614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.128704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.128815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.128841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.128919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.129046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.129072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.129186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.129271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.129308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.129416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.129492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.129519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.129638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.129749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.129775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.129882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.129974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.130000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.130083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.130200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.130226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.524 qpair failed and we were unable to recover it. 00:30:18.524 [2024-10-30 16:14:08.130357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.524 [2024-10-30 16:14:08.130451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.130476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.130586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.130695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.130722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.130843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.130961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.130987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.131069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.131180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.131207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.131319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.131406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.131432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.131511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.131626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.131652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.131732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.131815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.131840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.131933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.132049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.132075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.132165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.132277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.132303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.132392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.132483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.132510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.132592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.132732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.132758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.132848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.132958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.132984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.133078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.133186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.133212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.133307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.133426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.133453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.133573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.133657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.133683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.133790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.133912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.133939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.134027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.134107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.134133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.134221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.134347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.134374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.134496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.134584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.134612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.134708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.134847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.134872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.134957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.135097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.135123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.135244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.135343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.135371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.135520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.135598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.135626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.135709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.135819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.135845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.135957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.136074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.136101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.136183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.136270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.136308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.136417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.136528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.136554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.136675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.136755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.136781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.136902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.137017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.137042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.137131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.137212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.137239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.525 qpair failed and we were unable to recover it. 00:30:18.525 [2024-10-30 16:14:08.137330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.525 [2024-10-30 16:14:08.137441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.137468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.137614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.137729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.137755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.137848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.137965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.137990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.138108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.138191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.138218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.138319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.138434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.138460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.138549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.138627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.138653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.138742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.138821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.138847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.138963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.139077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.139104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.139189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.139284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.139311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.139400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.139474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.139500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.139626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.139750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.139779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.139877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.139992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.140019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.140133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.140218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.140245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.140343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.140460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.140486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.140574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.140712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.140738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.140829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.140914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.140940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.141054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.141134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.141160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.141277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.141413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.141439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.141550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.141663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.141688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.141795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.141881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.141912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.141993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.142075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.142101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.142183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.142295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.142321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.142443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.142523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.142548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.142634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.142751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.142786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.142880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.142961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.142987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.143069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.143160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.143186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.143279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.143360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.143385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.143510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.143618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.143648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.143793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.143915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.143942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.144062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.144190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.144217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.526 [2024-10-30 16:14:08.144318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.144409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.526 [2024-10-30 16:14:08.144437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.526 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.144551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.144676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.144702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.144815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.144911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.144937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.145017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.145158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.145184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.145327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.145409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.145436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.145556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.145649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.145676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.145806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.145928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.145956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.146054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.146183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.146213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.146327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.146447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.146474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.146597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.146680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.146706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.146788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.146904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.146932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.147047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.147122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.147147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.147232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.147357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.147384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.147496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.147582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.147608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.147718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.147790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.147816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.147935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.148050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.148076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.148166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.148282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.148309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.148423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.148519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.148545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.148632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.148711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.148736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.148858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.148967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.148993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.149111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.149193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.149219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.149342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.149482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.149508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.149644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.149732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.149758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.149898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.149984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.150011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.150129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.150213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.150241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.150354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.150479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.150506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.150650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.150792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.150818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.150933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.151026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.151052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.151167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.151246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.151281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.151371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.151475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.151501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.151593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.151678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.527 [2024-10-30 16:14:08.151704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.527 qpair failed and we were unable to recover it. 00:30:18.527 [2024-10-30 16:14:08.151781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.151858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.151885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.151970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.152113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.152139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.152253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.152357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.152383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.152472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.152551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.152578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.152692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.152767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.152794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.152875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.152960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.152986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.153097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.153206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.153231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.153323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.153431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.153456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.153546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.153682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.153708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.153800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.153882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.153908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.154021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.154108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.154136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.154269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.154367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.154393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.154482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.154570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.154596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.154713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.154839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.154867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.154981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.155059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.155086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.155199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.155296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.155323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.155436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.155522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.155548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.155662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.155748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.155774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.155916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.156030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.156056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.156166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.156247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.156278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.156410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.156524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.156550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.156671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.156787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.156813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.156900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.156982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.157007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.157121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.157211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.157238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.157362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.157451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.157477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.157569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.157717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.157743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.157825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.157904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.528 [2024-10-30 16:14:08.157934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.528 qpair failed and we were unable to recover it. 00:30:18.528 [2024-10-30 16:14:08.158015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.158096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.158123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.158234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.158337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.158364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.158482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.158600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.158627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.158738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.158851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.158878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.158992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.159114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.159140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.159275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.159392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.159418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.159510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.159614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.159644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.159760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.159840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.159866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.159963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.160072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.160098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.160214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.160301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.160333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.160422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.160504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.160529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.160607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.160722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.160748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.160891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.161009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.161035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.161146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.161221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.161246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.161344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.161464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.161491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.161604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.161688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.161713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.161822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.161906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.161932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.162047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.162126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.162152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.162268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.162382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.162407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.162500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.162607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.162636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.162724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.162797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.162822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.162941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.163032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.163057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.163143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.163266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.163294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.163381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.163496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.163521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.163616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.163727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.163752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.163871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.163985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.164012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.164096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.164206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.164232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.164335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.164430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.164456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.164537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.164647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.164675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.164763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.164842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.164873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.529 qpair failed and we were unable to recover it. 00:30:18.529 [2024-10-30 16:14:08.165019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.529 [2024-10-30 16:14:08.165103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.165129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.165246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.165341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.165366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.165453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.165525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.165550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.165644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.165744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.165770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.165881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.166018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.166045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.166126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.166232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.166265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.166374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.166476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.166502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.166641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.166726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.166752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.166867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.166954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.166979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.167088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.167202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.167228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.167384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.167480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.167508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.167624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.167718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.167747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.167841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.167921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.167946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.168061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.168135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.168159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.168242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.168329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.168354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.168449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.168563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.168588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.168705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.168811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.168836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.168928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.169006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.169031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.169148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.169241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.169273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.169387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.169473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.169498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.169619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.169694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.169718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.169830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.169918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.169943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.170026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.170111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.170136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.170242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.170368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.170394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.170516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.170644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.170674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.170819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.170908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.170934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.171049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.171136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.171162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.171280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.171370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.171398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.171484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.171597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.171623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.171710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.171796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.171822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.530 [2024-10-30 16:14:08.171966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.172051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.530 [2024-10-30 16:14:08.172077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.530 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.172165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.172307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.172334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.172423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.172529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.172555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.172665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.172778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.172806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.172890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.172965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.172991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.173113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.173223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.173249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.173371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.173449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.173475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.173555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.173634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.173660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.173769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.173880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.173907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.174045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.174152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.174178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.174292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.174418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.174447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.174536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.174658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.174685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.174776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.174865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.174891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.175028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.175118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.175143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.175262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.175358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.175384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.175471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.175555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.175581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.175700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.175818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.175844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.175932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.176044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.176070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.176164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.176283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.176316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.176419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.176567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.176593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.176685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.176769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.176796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.176910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.177027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.177053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.177140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.177253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.177284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.177378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.177485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.177511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.177627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.177742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.177768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.177885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.177992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.178017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.178109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.178219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.178246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.178344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.178459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.178485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.178563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.178645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.178671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.178788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.178895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.178920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.179036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.179157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.179183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.531 qpair failed and we were unable to recover it. 00:30:18.531 [2024-10-30 16:14:08.179287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.531 [2024-10-30 16:14:08.179375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.179402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.179540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.179651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.179678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.179792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.179907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.179932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.180020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.180138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.180164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.180251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.180349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.180375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.180461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.180544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.180569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.180663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.180748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.180774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.180893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.181027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.181054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.181136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.181290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.181316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.181402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.181543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.181568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.181679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.181765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.181790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.181918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.182028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.182053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.182167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.182305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.182331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.182414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.182525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.182550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.182635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.182744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.182769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.182914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.183023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.183048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.183127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.183253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.183284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.183394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.183508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.183534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.183613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.183721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.183745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.183858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.183950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.183976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.184067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.184161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.184187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.184329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.184403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.184428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.184513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.184596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.184622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.184704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.184795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.184820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.184904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.184993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.185019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.185131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.185247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.185280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.185376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.185464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.185489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.532 qpair failed and we were unable to recover it. 00:30:18.532 [2024-10-30 16:14:08.185605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.185738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.532 [2024-10-30 16:14:08.185764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.185853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.185939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.185966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.186104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.186185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.186211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.186363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.186444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.186470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.186576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.186690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.186715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.186829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.186944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.186970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.187062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.187147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.187171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.187251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.187349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.187374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.187493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.187575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.187600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.187713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.187799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.187824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.187904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.188017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.188044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.188130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.188277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.188304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.188420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.188537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.188567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.188652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.188737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.188762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.188841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.188923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.188948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.189060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.189143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.189169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.189281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.189365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.189390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.189531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.189608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.189633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.189719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.189827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.189853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.189941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.190024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.190049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.190136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.190275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.190301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.190415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.190523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.190547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.190659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.190745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.190774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.190894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.190978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.191003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.191129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.191233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.191278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.191373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.191460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.191487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.191571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.191657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.191684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.191825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.191939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.191965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.192085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.192163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.192191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.192336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.192421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.192449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.533 [2024-10-30 16:14:08.192538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.192623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.533 [2024-10-30 16:14:08.192651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.533 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.192762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.192846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.192872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.192956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.193069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.193102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.193186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.193289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.193316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.193398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.193492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.193519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.193643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.193724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.193749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.193860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.193976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.194002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.194114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.194196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.194223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.194318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.194434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.194461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.194617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.194701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.194727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.194844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.194937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.194964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.195050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.195140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.195167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.195289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.195447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.195485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.195609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.195721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.195747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.195832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.195942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.195968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.196088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.196206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.196231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.196338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.196471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.196501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.196612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.196721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.196747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.196860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.196941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.196966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.197041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.197125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.197152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.197266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.197352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.197379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.197497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.197640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.197665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.197750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.197859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.197885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.197996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.198071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.198097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.198186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.198301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.198328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.198442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.198524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.198549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.198640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.198713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.198738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.198852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.198927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.198952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.199059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.199171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.199196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.199320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.199432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.199457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.199540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.199646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.534 [2024-10-30 16:14:08.199672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.534 qpair failed and we were unable to recover it. 00:30:18.534 [2024-10-30 16:14:08.199761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.199876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.199901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.200017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.200128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.200152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.200240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.200388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.200416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.200536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.200659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.200686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.200813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.200899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.200925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.201037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.201121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.201146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.201224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.201315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.201342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.201419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.201518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.201543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.201624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.201708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.201736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.201862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.201949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.201974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.202092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.202230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.202260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.202362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.202459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.202489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.202630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.202751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.202777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.202866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.202972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.202998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.203110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.203225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.203250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.203340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.203477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.203502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.203594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.203678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.203705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.203821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.203931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.203956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.204041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.204124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.204151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.204231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.204363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.204390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.204478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.204615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.204641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.204772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.204885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.204911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.205048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.205147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.205175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.205268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.205440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.205466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.205555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.205635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.205662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.205774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.205857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.205882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.205994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.206078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.206102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.206184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.206301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.206328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.206443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.206522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.206547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.206691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.206778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.206803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.535 qpair failed and we were unable to recover it. 00:30:18.535 [2024-10-30 16:14:08.206919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.535 [2024-10-30 16:14:08.207030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.207054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.207137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.207252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.207293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.207454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.207557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.207585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.207672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.207786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.207811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.207929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.208010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.208035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.208120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.208247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.208279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.208402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.208518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.208543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.208625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.208794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.208819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.208904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.208986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.209011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.209096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.209205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.209231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.209346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.209443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.209472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.209565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.209651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.209677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.209780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.209888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.209918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.210039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.210182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.210209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.210328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.210443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.210469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.210563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.210640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.210666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.210779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.210893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.210919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.211007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.211115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.211141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.211282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.211399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.211425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.211517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.211636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.211662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.211803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.211881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.211906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.211991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.212076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.212102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.212214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.212348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.212377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.212469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.212612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.212638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.212759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.212843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.212870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.212956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.213029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.213055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.213170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.213290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.213318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.213406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.213521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.213546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.213669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.213753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.213780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.213855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.213944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.213972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.536 qpair failed and we were unable to recover it. 00:30:18.536 [2024-10-30 16:14:08.214093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.214176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.536 [2024-10-30 16:14:08.214202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.214318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.214430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.214457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.214549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.214668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.214693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.214779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.214863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.214889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.214965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.215077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.215103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.215211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.215314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.215341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.215423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.215495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.215520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.215605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.215696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.215721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.215838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.215928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.215954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.216067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.216155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.216181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.216271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.216362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.216389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.216505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.216618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.216644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.216768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.216889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.216914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.217002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.217087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.217113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.217195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.217337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.217364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.217473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.217554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.217579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.217658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.217741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.217767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.217877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.218005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.218031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.218112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.218225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.218252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.218356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.218467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.218493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.218603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.218720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.218746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.218867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.218983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.219009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.219122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.219209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.219234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.219341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.219432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.219461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.219549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.219663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.219689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.219774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.219864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.219891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.219987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.220071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.220098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.537 qpair failed and we were unable to recover it. 00:30:18.537 [2024-10-30 16:14:08.220189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.537 [2024-10-30 16:14:08.220273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.220299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.220389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.220501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.220526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.220635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.220715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.220741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.220828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.220929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.220954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.221066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.221158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.221184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.221270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.221387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.221418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.221508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.221591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.221619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.221705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.221818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.221844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.221952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.222070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.222096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.222183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.222273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.222300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.222413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.222501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.222527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.222608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.222717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.222743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.222853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.222938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.222964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.223102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.223219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.223244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.223355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.223440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.223466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.223542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.223617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.223648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.223771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.223893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.223920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.224029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.224138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.224164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.224294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.224381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.224407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.224521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.224602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.224628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.224727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.224817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.224843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.224923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.225004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.225030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.225141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.225227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.225253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.225387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.225488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.225516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.225628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.225711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.225736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.225852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.225936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.225969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.226046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.226124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.226149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.226270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.226350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.226376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.226527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.226625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.226655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.226779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.226894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.226920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.538 qpair failed and we were unable to recover it. 00:30:18.538 [2024-10-30 16:14:08.227032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.538 [2024-10-30 16:14:08.227117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.227143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.227267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.227361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.227387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.227479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.227565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.227591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.227700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.227787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.227812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.227924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.228036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.228062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.228208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.228327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.228354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.228449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.228529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.228555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.228638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.228752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.228779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.228867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.228945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.228970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.229049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.229130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.229155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.229300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.229409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.229434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.229507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.229666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.229690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.229787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.229908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.229934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.230018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.230128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.230154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.230275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.230389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.230414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.230498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.230584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.230609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.230696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.230779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.230804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.230892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.231001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.231028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.231132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.231240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.231272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.231411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.231519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.231544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.231623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.231731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.231757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.231839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.231921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.231946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.232058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.232165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.232192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.232280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.232367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.232392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.232479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.232559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.232587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.232672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.232784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.232810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.232935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.233021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.233045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.233130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.233235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.233269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.233371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.233477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.233501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.233596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.233710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.233734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.539 [2024-10-30 16:14:08.233848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.233960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.539 [2024-10-30 16:14:08.233985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.539 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.234061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.234140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.234165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.234249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.234350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.234376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.234458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.234569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.234594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.234733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.234849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.234875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.235020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.235131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.235157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.235304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.235390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.235415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.235503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.235611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.235637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.235749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.235826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.235851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.235970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.236058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.236084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.236200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.236319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.236346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.236426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.236510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.236535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.236659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.236774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.236801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.236886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.236969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.236994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.237111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.237202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.237228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.237348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.237448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.237474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.237564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.237646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.237672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.237787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.237900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.237926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.238017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.238129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.238155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.238269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.238359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.238384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.238476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.238561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.238587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.238696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.238784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.238809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.238898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.239013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.239037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.239124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.239201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.239226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.239377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.239490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.239516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.239638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.239731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.239756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.239846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.239932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.239958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.240073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.240151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.240176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.240273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.240351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.240376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.240489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.240615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.240640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.540 [2024-10-30 16:14:08.240755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.240895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.540 [2024-10-30 16:14:08.240921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.540 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.241033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.241119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.241144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.241252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.241351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.241376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.241468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.241554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.241579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.241724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.241832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.241857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.241941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.242057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.242082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.242171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.242254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.242285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.242401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.242485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.242512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.242633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.242716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.242741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.242819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.242930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.242954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.243045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.243178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.243204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.243292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.243377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.243402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.243510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.243624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.243650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.243767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.243877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.243902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.243986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.244080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.244106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.244191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.244273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.244299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.244389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.244493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.244517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.244630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.244740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.244765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.244863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.244941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.244966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.245080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.245160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.245186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.245293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.245401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.245428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.245523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.245636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.245663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.245752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.245865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.245891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.245980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.246090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.246116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.246202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.246289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.246315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.246397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.246485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.246510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.246650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.246741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.246767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.246849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.246932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.246957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.541 qpair failed and we were unable to recover it. 00:30:18.541 [2024-10-30 16:14:08.247072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.541 [2024-10-30 16:14:08.247182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.247208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.247293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.247415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.247442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.247533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.247622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.247646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.247743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.247830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.247855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.247942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.248062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.248087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.248201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.248286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.248312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.248403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.248487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.248513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.248620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.248703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.248729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.248820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.248969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.248996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.249110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.249198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.249223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.249339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.249447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.249472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.249554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.249692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.249718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.249836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.249913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.249938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.250027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.250105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.250131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.250219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.250316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.250341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.250448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.250550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.250575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.250661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.250741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.250766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.250875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.250954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.250979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.251066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.251208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.251234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.251339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.251453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.251480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.251602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.251722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.251748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.251836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.251921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.251947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.252088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.252201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.252227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.252329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.252434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.252460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.252552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.252661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.252688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.252773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.252884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.252909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.253008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.253118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.253143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.253228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.253325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.253351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.253471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.253595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.253620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.253737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.253877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.253902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.542 qpair failed and we were unable to recover it. 00:30:18.542 [2024-10-30 16:14:08.254007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.542 [2024-10-30 16:14:08.254097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.254122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.254207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.254322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.254347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.254437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.254584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.254609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.254724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.254810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.254838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.254946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.255055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.255081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.255191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.255329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.255355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.255438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.255525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.255550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.255623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.255761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.255787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.255898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.256012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.256042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.256157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.256270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.256297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.256413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.256499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.256524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.256622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.256713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.256740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.256836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.256947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.256972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.257057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.257144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.257170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.257263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.257377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.257402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.257485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.257594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.257619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.257729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.257833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.257858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.257963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.258071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.258096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.258208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.258309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.258345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.258433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.258544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.258570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.258687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.258804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.258830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.258945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.259065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.259092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.259207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.259317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.259344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.259455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.259574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.259599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.259686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.259803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.259829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.259918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.259990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.260015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.260135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.260246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.260282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.260394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.260480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.260505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.260617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.260707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.260738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.260830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.260945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.260970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.543 qpair failed and we were unable to recover it. 00:30:18.543 [2024-10-30 16:14:08.261079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.261214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.543 [2024-10-30 16:14:08.261239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.261347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.261433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.261457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.261574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.261668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.261692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.261783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.261859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.261884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.261972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.262061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.262086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.262181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.262296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.262322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.262414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.262487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.262519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.262636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.262723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.262749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.262863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.262961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.262988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.263103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.263213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.263239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.263367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.263457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.263481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.263595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.263706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.263731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.263846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.263987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.264011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.264114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.264229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.264253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.264348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.264472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.264496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.264584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.264689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.264715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.264803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.264913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.264939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.265027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.265112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.265138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.265265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.265354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.265380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.265483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.265623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.265648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.265774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.265864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.265888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.265973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.266091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.266117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.266245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.266374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.266399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.266548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.266659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.266685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.266829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.266972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.266998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.267089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.267176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.267200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.267291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.267408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.267433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.267517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.267607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.267632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.267743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.267858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.267883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.268004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.268113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.268140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.544 [2024-10-30 16:14:08.268260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.268398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.544 [2024-10-30 16:14:08.268424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.544 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.268512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.268619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.268644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.268757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.268841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.268868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.268979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.269060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.269086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.269211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.269299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.269325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.269435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.269520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.269546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.269662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.269773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.269798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.269886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.269995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.270022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.270110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.270194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.270219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.270343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.270429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.270454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.270564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.270675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.270700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.270792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.270931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.270956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.271043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.271149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.271174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.271288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.271403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.271429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.271515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.271631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.271655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.271739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.271846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.271873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.271955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.272068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.272093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.272187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.272273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.272300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.272415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.272523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.272548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.272665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.272806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.272830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.272918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.273008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.273034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.273143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.273253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.273284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.273391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.273473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.273498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.273604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.273716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.273742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.273853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.273961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.273987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.274072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.274157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.274182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.274295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.274388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.274414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.545 [2024-10-30 16:14:08.274520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.274600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.545 [2024-10-30 16:14:08.274625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.545 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.274709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.274787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.274812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.274905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.274990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.275016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.275109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.275196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.275221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.275334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.275474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.275498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.275613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.275751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.275777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.275919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.276004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.276031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.276119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.276203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.276227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.276322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.276435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.276460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.276570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.276680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.276706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.276800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.276888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.276914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.277031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.277138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.277163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.277253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.277349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.277374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.277486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.277658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.277685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.277773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.277886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.277913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.278002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.278114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.278139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.278225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.278316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.278343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.278453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.278559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.278585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.278667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.278777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.278803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.278919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.278997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.279022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.279107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.279242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.279275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.279356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.279443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.279468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.279581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.279702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.279728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.279827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.279974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.280000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.280086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.280188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.280213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.280343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.280470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.280495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.280579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.280680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.280705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.280827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.280941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.280967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.281080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.281161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.281187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.281271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.281381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.281406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.281497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.281585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.281610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.546 [2024-10-30 16:14:08.281694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.281810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.546 [2024-10-30 16:14:08.281835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.546 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.281951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.282034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.282061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.282205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.282310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.282338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.282457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.282580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.282606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.282691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.282801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.282827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.282966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.283049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.283074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.283164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.283277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.283304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.283421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.283505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.283532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.283673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.283784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.283810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.283929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.284014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.284039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.284154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.284264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.284291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.284391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.284476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.284502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.284582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.284681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.284706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.284813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.284907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.284931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.285041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.285154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.285179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.285270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.285371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.285395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.285486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.285574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.285599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.285683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.285789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.285814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.285905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.285993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.286017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.286130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.286204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.286229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.286346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.286430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.286457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.286568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.286688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.286716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.286830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.286910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.286934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.287053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.287165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.287191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.287280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.287386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.287412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.287500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.287589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.287615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.287704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.287823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.287848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.287930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.288009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.288036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.288149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.288233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.288264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.288389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.288530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.288568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.288706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.288789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.288814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.288906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.288993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.289018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.289129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.289210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.289234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.547 qpair failed and we were unable to recover it. 00:30:18.547 [2024-10-30 16:14:08.289354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.547 [2024-10-30 16:14:08.289438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.289464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.289583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.289700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.289726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.289816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.289928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.289954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.290064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.290145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.290171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.290322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.290410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.290435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.290546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.290655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.290681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.290792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.290902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.290927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.291010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.291128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.291153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.291298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.291379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.291408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.291547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.291674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.291703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.291804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.291889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.291914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.292030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.292147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.292172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.292275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.292411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.292436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.292550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.292662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.292687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.292768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.292855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.292882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.292972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.293062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.293088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.293206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.293322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.293348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.293440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.293555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.293582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.293666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.293780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.293812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.293888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.293978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.294003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.294080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.294192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.294217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.294309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.294426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.294451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.294548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.294647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.294673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.294754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.294836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.294861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.294949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.295070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.295095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.295204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.295319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.295345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.295422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.295534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.295560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.295643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.295757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.295782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.295873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.295961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.295990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.296105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.296192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.296217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.296317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.296399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.296424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.296571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.296658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.296685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.296775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.296856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.296880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.548 qpair failed and we were unable to recover it. 00:30:18.548 [2024-10-30 16:14:08.296995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.548 [2024-10-30 16:14:08.297104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.297129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.297218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.297347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.297372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.297470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.297617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.297642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.297756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.297843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.297870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.297960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.298097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.298123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.298205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.298323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.298353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.298442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.298591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.298616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.298704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.298813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.298839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.298956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.299062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.299087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.299178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.299262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.299289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.299371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.299483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.299509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.299591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.299681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.299709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.299791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.299872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.299897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.299976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.300085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.300109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.300253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.300370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.300395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.300510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.300622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.300648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.300767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.300844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.300869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.300955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.301073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.301098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.301185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.301299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.301327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.301424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.301501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.301526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.301626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.301766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.301791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.301903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.301992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.302018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.302102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.302192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.302220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.302351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.302460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.302487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.302578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.302695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.302720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.302804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.302915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.302941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.303092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.303207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.303234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.303385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.303488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.303517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.303636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.303774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.303800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.303922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.304001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.304028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.549 qpair failed and we were unable to recover it. 00:30:18.549 [2024-10-30 16:14:08.304140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.549 [2024-10-30 16:14:08.304247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.304284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.304377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.304455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.304480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.304564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.304645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.304670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.304779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.304918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.304944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.305057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.305138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.305163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.305251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.305342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.305368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.305462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.305545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.305570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.305656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.305737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.305763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.305840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.305924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.305950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.306085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.306167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.306192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.306280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.306403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.306431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.306520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.306605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.306631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.306747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.306861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.306887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.307035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.307121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.307148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.307242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.307364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.307389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.307479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.307578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.307603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.307689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.307800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.307826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.307938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.308014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.308039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.308122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.308208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.308235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.308348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.308472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.308499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.308605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.308711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.308736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.308859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.308942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.308966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.309044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.309148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.309174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.309265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.309353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.309378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.309456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.309591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.309617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.309697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.309782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.309807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.309901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.309971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.309996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.310085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.310158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.310184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.310309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.310402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.310428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.310545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.310650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.310675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.310761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.310865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.310889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.310985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.311102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.311127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.550 qpair failed and we were unable to recover it. 00:30:18.550 [2024-10-30 16:14:08.311214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.311311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.550 [2024-10-30 16:14:08.311336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.311421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.311537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.311562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.311644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.311721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.311745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.311859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.311949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.311974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.312057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.312140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.312165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.312244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.312338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.312364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.312447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.312562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.312587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.312667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.312770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.312794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.312877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.312952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.312977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.313061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.313133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.313157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.313308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.313392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.313418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.313510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.313593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.313618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.313733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.313822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.313847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.313961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.314071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.314095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.314220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.314375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.314405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.314493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.314608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.314634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.314728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.314813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.314840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.314982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.315095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.315122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.315210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.315327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.315354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.315470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.315587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.315613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.315756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.315848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.315874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.315957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.316045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.316071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.316158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.316278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.316306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.316419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.316504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.316531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.316610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.316705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.316736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.316817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.316970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.316996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.317108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.317220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.317247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.317378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.317509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.317538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.317630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.317722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.317749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.317841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.317950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.317977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.318086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.318169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.318197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.318275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.318362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.318389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.318479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.318623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.318650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.551 qpair failed and we were unable to recover it. 00:30:18.551 [2024-10-30 16:14:08.318736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.551 [2024-10-30 16:14:08.318845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.318872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.318958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.319078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.319109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.319198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.319295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.319322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.319433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.319544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.319570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.319676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.319760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.319786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.319893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.319974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.319999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.320108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.320192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.320218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.320299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.320392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.320418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.320501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.320589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.320616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.320729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.320811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.320836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.320972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.321048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.321073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.321152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.321238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.321275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.321383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.321470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.321496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.321607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.321686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.321712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.321796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.321867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.321893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.321998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.322156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.322184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.322332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.322412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.322438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.322548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.322658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.322682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.322769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.322880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.322906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.323044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.323134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.323159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.323247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.323343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.323370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.323486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.323597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.323624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.323717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.323800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.323826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.323944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.324081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.324108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.324197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.324332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.324358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.324442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.324532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.324558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.324674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.324753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.324779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.324898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.324972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.324998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.325089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.325199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.325224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.325371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.325483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.325508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.325596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.325679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.325705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.325812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.325896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.325921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.326004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.326122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.326148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.326243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.326341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.326368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.326484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.326562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.552 [2024-10-30 16:14:08.326587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.552 qpair failed and we were unable to recover it. 00:30:18.552 [2024-10-30 16:14:08.326674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.326760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.326785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.326897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.326968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.326994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.327074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.327147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.327172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.327252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.327373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.327397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.327505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.327618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.327642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.327724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.327837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.327861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.327947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.328064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.328089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.328197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.328309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.328334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.328447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.328572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.328596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.328684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.328801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.328825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.328935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.329042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.329067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.329181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.329267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.329291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.329412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.329516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.329542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.329683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.329770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.329795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.329907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.330017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.330043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.330132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.330211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.330235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.330328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.330410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.330435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.330513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.330598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.330623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.330703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.330813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.330838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.330915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.331024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.331050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.331128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.331248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.331280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.331359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.331498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.331523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.331636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.331722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.331746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.331883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.331963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.331988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.332100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.332210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.332235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.332368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.332459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.332488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.332568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.332655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.332681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.332765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.332909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.332935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.333051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.333183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.333208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.333299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.333427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.333454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.333545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.333686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.333712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.553 [2024-10-30 16:14:08.333821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.333900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.553 [2024-10-30 16:14:08.333926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.553 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.334008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.334116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.334142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.334224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.334317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.334343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.334432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.334512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.334537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.334648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.334732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.334758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.334860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.334938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.334962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.335076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.335182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.335212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.335300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.335375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.335400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.335484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.335598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.335622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.335733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.335809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.335835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.335914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.336004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.336030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.336122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.336204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.336229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.336362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.336476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.336501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.336616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.336722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.336747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.336828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.336913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.336937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.337049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.337129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.337154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.337242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.337340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.337370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.337457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.337569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.337593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.337708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.337787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.337812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.337893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.337996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.338022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.338112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.338229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.338254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.338377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.338463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.338488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.338605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.338690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.338713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.338804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.338915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.338939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.339049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.339140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.339165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.339280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.339366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.339391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.339529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.339615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.339640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.339730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.339815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.339839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.339945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.340025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.340050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.554 qpair failed and we were unable to recover it. 00:30:18.554 [2024-10-30 16:14:08.340161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.340242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.554 [2024-10-30 16:14:08.340274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.340362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.340442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.340467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.340552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.340639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.340664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.340784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.340865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.340889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.341008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.341122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.341146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.341227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.341308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.341333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.341423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.341538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.341562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.341673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.341777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.341801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.341877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.341988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.342014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.342097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.342177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.342202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.342285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.342372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.342398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.342489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.342606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.342630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.342710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.342783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.342806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.342896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.343004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.343028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.343114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.343268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.343293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.343404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.343490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.343514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.343602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.343710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.343736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.343852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.343994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.344019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.344101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.344190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.344216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.344317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.344424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.344449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.344558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.344684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.344709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.344793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.344868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.344893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.344967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.345071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.345095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.345176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.345253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.345286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.345365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.345449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.345474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.345588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.345697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.345722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.345832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.345939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.345964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.346075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.346157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.346181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.346283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.346398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.346424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.346531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.346610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.346635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.346753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.346837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.346862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.346952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.347030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.347054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.347192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.347305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.347330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.555 qpair failed and we were unable to recover it. 00:30:18.555 [2024-10-30 16:14:08.347447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.347555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.555 [2024-10-30 16:14:08.347580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.347693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.347780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.347806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.347915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.348023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.348049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.348128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.348242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.348274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.348416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.348499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.348524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.348601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.348686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.348715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.348797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.348910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.348935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.349014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.349124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.349148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.349239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.349335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.349360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.349445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.349526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.349556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.349665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.349775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.349800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.349888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.349995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.350019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.350123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.350203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.350228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.350341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.350452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.350477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.350560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.350663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.350687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.350792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.350876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.350900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.350990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.351123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.351148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.351233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.351352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.351378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.351525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.351608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.351634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.351711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.351822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.351847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.351985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.352070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.352096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.352176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.352290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.352315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.352431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.352521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.352546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.352630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.352765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.352791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.352903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.353014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.353039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.353148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.353233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.353266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.353385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.353476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.353501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.353596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.353683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.353708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.353821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.353927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.353954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.354026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.354138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.354164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.354254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.354337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.354361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.354476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.354581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.354606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.354720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.354809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.354834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.556 [2024-10-30 16:14:08.354937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.355050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.556 [2024-10-30 16:14:08.355074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.556 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.355156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.355269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.355296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.355412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.355551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.355578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.355692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.355771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.355796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.355907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.356021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.356047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.356152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.356232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.356278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.356366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.356443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.356468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.356551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.356658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.356684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.356797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.356933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.356958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.357069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.357179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.357205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.357329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.357452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.357477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.357571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.357648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.357673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.357780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.357888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.357913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.358005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.358128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.358154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.358239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.358354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.358380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.358475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.358588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.358614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.358729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.358861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.358886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.358979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.359049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.359074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.359211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.359296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.359322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.359402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.359540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.359565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.359682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.359796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.359822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.359915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.360026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.360051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.360143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.360253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.360289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.360375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.360467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.360497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.360584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.360710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.360738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.360841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.360956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.360984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.361097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.361207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.361233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.361322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.361417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.361452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.361588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.361706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.361731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.557 [2024-10-30 16:14:08.361846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.361928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.557 [2024-10-30 16:14:08.361952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.557 qpair failed and we were unable to recover it. 00:30:18.558 [2024-10-30 16:14:08.362061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.362199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.362225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.558 qpair failed and we were unable to recover it. 00:30:18.558 [2024-10-30 16:14:08.362353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.362437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.362464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.558 qpair failed and we were unable to recover it. 00:30:18.558 [2024-10-30 16:14:08.362567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.362656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.362689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.558 qpair failed and we were unable to recover it. 00:30:18.558 [2024-10-30 16:14:08.362821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.362905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.362931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.558 qpair failed and we were unable to recover it. 00:30:18.558 [2024-10-30 16:14:08.363057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.363154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.363181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.558 qpair failed and we were unable to recover it. 00:30:18.558 [2024-10-30 16:14:08.363280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.363392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.363417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.558 qpair failed and we were unable to recover it. 00:30:18.558 [2024-10-30 16:14:08.363502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.363615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.363639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.558 qpair failed and we were unable to recover it. 00:30:18.558 [2024-10-30 16:14:08.363757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.363839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.363863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.558 qpair failed and we were unable to recover it. 00:30:18.558 [2024-10-30 16:14:08.363981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.364092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.364128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.558 qpair failed and we were unable to recover it. 00:30:18.558 [2024-10-30 16:14:08.364245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.364383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.364409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.558 qpair failed and we were unable to recover it. 00:30:18.558 [2024-10-30 16:14:08.364534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.364652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.558 [2024-10-30 16:14:08.364678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.558 qpair failed and we were unable to recover it. 00:30:18.842 [2024-10-30 16:14:08.364769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-10-30 16:14:08.364860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-10-30 16:14:08.364886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-10-30 16:14:08.364975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-10-30 16:14:08.365064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-10-30 16:14:08.365089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-10-30 16:14:08.365203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-10-30 16:14:08.365290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-10-30 16:14:08.365316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-10-30 16:14:08.365413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-10-30 16:14:08.365495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-10-30 16:14:08.365521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-10-30 16:14:08.365641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-10-30 16:14:08.365746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-10-30 16:14:08.365781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-10-30 16:14:08.365893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.366038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.366071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.366238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.366356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.366389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.366490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.366618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.366654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.366792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.366947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.366982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.367079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.367236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.367281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.367395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.367523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.367556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.367654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.367753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.367787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.367919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.368057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.368091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.368229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.368335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.368370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.368486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.368586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.368616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.368735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.368819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.368849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.368938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.369053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.369081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.369168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.369313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.369341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.369458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.369568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.369594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.369687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.369773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.369798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.369909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.370046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.370073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.370191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.370308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.370335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.370425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.370508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.370534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.370632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.370775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.370801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.370927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.371038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.371063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.371149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.371229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.371254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.371350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.371437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.371461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.371543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.371631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.371656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.371741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.371852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.371879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.372025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.372169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.372195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.372282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.372368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.372393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.372511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.372622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.372647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.372731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.372801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.372827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.372941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.373033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.373059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-10-30 16:14:08.373142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-10-30 16:14:08.373263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.373290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.373406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.373526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.373552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.373678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.373818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.373844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.373984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.374121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.374146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.374264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.374382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.374407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.374520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.374631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.374657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.374745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.374822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.374846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.374927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.375014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.375040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.375122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.375212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.375238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.375330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.375438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.375469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.375582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.375664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.375689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.375776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.375890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.375915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.376019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.376129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.376155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.376278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.376393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.376419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.376534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.376657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.376682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.376819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.376930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.376956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.377045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.377156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.377182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.377334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.377467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.377493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.377582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.377692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.377718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.377862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.377951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.377982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.378126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.378205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.378231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.378319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.378426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.378451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.378564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.378659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.378685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.378768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.378852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.378877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.378993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.379067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.379092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.379207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.379292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.379317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.379435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.379551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.379576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.379722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.379809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.379835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.379909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.379995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.380020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.380112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.380221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.380247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.380380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.380466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.844 [2024-10-30 16:14:08.380491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.844 qpair failed and we were unable to recover it. 00:30:18.844 [2024-10-30 16:14:08.380604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.380682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.380707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.380788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.380877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.380902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.380987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.381098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.381123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.381236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.381338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.381364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.381471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.381546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.381571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.381656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.381758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.381783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.381897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.381980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.382007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.382085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.382191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.382216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.382315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.382394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.382419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.382505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.382581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.382607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.382721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.382833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.382858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.382977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.383085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.383111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.383193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.383302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.383328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.383436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.383546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.383571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.383686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.383764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.383789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.383934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.384018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.384044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.384149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.384235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.384267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.384357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.384443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.384469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.384553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.384664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.384690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.384830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.384917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.384943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.385026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.385138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.385165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.385244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.385325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.385351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.385460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.385571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.385596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.385676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.385764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.385789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.385879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.385963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.385988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.386128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.386209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.386234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.386336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.386422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.386447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.386551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.386663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.386689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.386768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.386851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.386877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.386953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.387065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.387091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.845 qpair failed and we were unable to recover it. 00:30:18.845 [2024-10-30 16:14:08.387205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.845 [2024-10-30 16:14:08.387313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.387339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.387452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.387557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.387583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.387663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.387743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.387769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.387848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.387962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.387987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.388070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.388182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.388209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.388306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.388415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.388442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.388524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.388597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.388622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.388741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.388823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.388849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.388987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.389099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.389123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.389236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.389365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.389395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.389484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.389559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.389585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.389690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.389769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.389794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.389879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.389966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.389990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.390095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.390174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.390199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.390281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.390369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.390395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.390469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.390578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.390603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.390718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.390855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.390880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.391013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.391099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.391123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.391206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.391293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.391319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.391462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.391567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.391592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.391685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.391792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.391817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.391930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.392040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.392065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.392173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.392251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.392284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.392372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.392454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.392479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.392568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.392658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.392684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.392791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.392900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.392925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.393019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.393098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.393123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.393207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.393303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.393328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.393408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.393517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.393542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.393623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.393708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.393733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.393822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.393904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.846 [2024-10-30 16:14:08.393930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.846 qpair failed and we were unable to recover it. 00:30:18.846 [2024-10-30 16:14:08.394046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.394133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.394158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.394275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.394352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.394377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.394468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.394550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.394575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.394658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.394768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.394793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.394899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.395010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.395035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.395177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.395271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.395297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.395381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.395523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.395548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.395694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.395801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.395827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.395915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.396004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.396031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.396148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.396267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.396292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.396404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.396487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.396512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.396596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.396705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.396729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.396863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.396954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.396979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.397094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.397200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.397225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.397372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.397484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.397510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.397620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.397702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.397727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.397847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.397932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.397956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.398030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.398168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.398194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.398279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.398360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.398385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.398495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.398614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.398640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.398753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.398842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.398867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.398955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.399071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.399097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.399201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.399309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.399336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.399454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.399539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.399564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.399671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.399759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.399784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.399861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.399974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.400000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.400115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.400200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.847 [2024-10-30 16:14:08.400225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.847 qpair failed and we were unable to recover it. 00:30:18.847 [2024-10-30 16:14:08.400316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.400397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.400422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.400501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.400591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.400616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.400694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.400781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.400810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.400924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.401028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.401053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.401166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.401295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.401321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.401431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.401517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.401543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.401656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.401776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.401801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.401908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.402015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.402039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.402152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.402240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.402272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.402387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.402559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.402585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.402665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.402780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.402805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.402914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.403017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.403042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.403130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.403206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.403235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.403333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.403444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.403469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.403560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.403641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.403666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.403802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.403887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.403911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.404021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.404107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.404131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.404218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.404317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.404343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.404423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.404510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.404536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.404651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.404738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.404766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.404876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.404962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.404989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.405078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.405195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.405220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.405326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.405437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.405463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.405578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.405688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.405714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.405791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.405898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.405924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.406015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.406093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.406118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.406205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.406278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.406304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.406442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.406551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.406576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.406711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.406799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.406824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.406900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.407009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.848 [2024-10-30 16:14:08.407034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.848 qpair failed and we were unable to recover it. 00:30:18.848 [2024-10-30 16:14:08.407146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.407218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.407243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.407388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.407479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.407504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.407578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.407660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.407685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.407807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.407887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.407912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.408031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.408135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.408161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.408299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.408382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.408408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.408504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.408610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.408636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.408721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.408799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.408825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.408935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.409075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.409100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.409184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.409279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.409305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.409396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.409504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.409530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.409618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.409730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.409756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.409832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.409903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.409928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.410034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.410144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.410170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.410247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.410364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.410391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.410473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.410600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.410627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.410741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.410821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.410848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.410983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.411103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.411131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.411254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.411390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.411415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.411506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.411583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.411608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.411694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.411804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.411829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.411922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.412040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.412068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.412169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.412282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.412308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.412436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.412596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.412621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.412709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.412799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.412825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.412937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.413048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.413073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.413177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.413321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.413364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.413448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.413565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.413609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.413735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.413847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.413872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.413961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.414085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.414113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.849 qpair failed and we were unable to recover it. 00:30:18.849 [2024-10-30 16:14:08.414304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.414418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.849 [2024-10-30 16:14:08.414443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.414519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.414625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.414650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.414731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.414911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.414936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.415039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.415174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.415207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.415349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.415490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.415516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.415670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.415785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.415810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.415899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.416045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.416072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.416181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.416329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.416355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.416473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.416609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.416637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.416787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.416907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.416936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.417060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.417200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.417225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.417390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.417536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.417561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.417698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.417821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.417852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.417973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.418107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.418133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.418212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.418344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.418372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.418451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.418553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.418581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.418688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.418804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.418830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.418942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.419030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.419056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.419191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.419353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.419378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.419474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 2549319 Killed "${NVMF_APP[@]}" "$@" 00:30:18.850 [2024-10-30 16:14:08.419590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.419615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.419705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.419819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.419845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 16:14:08 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:18.850 [2024-10-30 16:14:08.419992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 16:14:08 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:18.850 [2024-10-30 16:14:08.420075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.420101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.420177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 16:14:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:18.850 [2024-10-30 16:14:08.420289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.420315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.850 16:14:08 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 16:14:08 -- common/autotest_common.sh@10 -- # set +x 00:30:18.850 [2024-10-30 16:14:08.420478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.420639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.420671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.420767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.420893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.420923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.421028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.421124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.421150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.421244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.421380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.421406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.421495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.421629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.421657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.421773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.421852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.421878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.421989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.422077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.850 [2024-10-30 16:14:08.422103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.850 qpair failed and we were unable to recover it. 00:30:18.850 [2024-10-30 16:14:08.422196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.422334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.422360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.422450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.422560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.422585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.422721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.422822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.422850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.422982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.423098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.423126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.423264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.423388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.423415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.423504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.423678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.423704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.423820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.423947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.423973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.424055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.424191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.424216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 16:14:08 -- nvmf/common.sh@469 -- # nvmfpid=2550009 00:30:18.851 [2024-10-30 16:14:08.424371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 16:14:08 -- nvmf/common.sh@470 -- # waitforlisten 2550009 00:30:18.851 [2024-10-30 16:14:08.424467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.424492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 16:14:08 -- common/autotest_common.sh@819 -- # '[' -z 2550009 ']' 00:30:18.851 [2024-10-30 16:14:08.424600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 16:14:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:18.851 [2024-10-30 16:14:08.424739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 16:14:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:18.851 [2024-10-30 16:14:08.424796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 16:14:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:18.851 [2024-10-30 16:14:08.424908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 16:14:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:18.851 [2024-10-30 16:14:08.425021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:18.851 [2024-10-30 16:14:08.425048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 16:14:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:18.851 [2024-10-30 16:14:08.425166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 16:14:08 -- common/autotest_common.sh@10 -- # set +x 00:30:18.851 [2024-10-30 16:14:08.425281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.425307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.425426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.425505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.425531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.425642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.425719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.425744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.425857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.425948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.425973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.426080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.426191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.426235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.426346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.426460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.426486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.426563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.426694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.426722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.426859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.426963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.426988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.427103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.427188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.427213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.427335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.427414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.427438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.427565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.427658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.427686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.427819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.427936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.427961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.428042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.428152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.428177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.428267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.428385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.851 [2024-10-30 16:14:08.428411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.851 qpair failed and we were unable to recover it. 00:30:18.851 [2024-10-30 16:14:08.428502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.428605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.428630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.428712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.428784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.428809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.428919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.429034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.429059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.429195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.429281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.429308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.429395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.429483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.429508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.429624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.429729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.429754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.429836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.429955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.429980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.430067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.430230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.430279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.430397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.430481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.430508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.430623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.430731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.430756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.430867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.431002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.431027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.431105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.431187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.431211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.431305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.431385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.431410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.431497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.431635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.431660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.431747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.431838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.431863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.431971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.432080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.432105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.432184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.432267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.432297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.432375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.432457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.432483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.432591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.432667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.432694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.432810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.432923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.432966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.433059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.433161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.433186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.433270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.433361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.433387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.433499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.433573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.433598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.433706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.433788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.433822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.433968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.434092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.434122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.434212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.434316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.434345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.434426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.434516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.434548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.434637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.434722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.434748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.434840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.434924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.434950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.435043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.435149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.435176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.852 qpair failed and we were unable to recover it. 00:30:18.852 [2024-10-30 16:14:08.435270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.852 [2024-10-30 16:14:08.435361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.435387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.435477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.435570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.435596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.435678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.435753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.435779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.435948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.436042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.436068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.436162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.436246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.436277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.436389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.436476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.436501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.436618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.436726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.436768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.436866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.436987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.437014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.437107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.437231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.437267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.437383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.437496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.437522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.437648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.437763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.437789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.437920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.438038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.438065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.438183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.438269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.438294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.438393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.438491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.438519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.438646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.438734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.438761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.438854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.438946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.438972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.439064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.439162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.439187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.439371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.439485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.439514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.439631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.439717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.439746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.439877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.439967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.439992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.440085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.440173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.440199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.440300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.440378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.440404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.440520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.440643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.440669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.440797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.440904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.440931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.441046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.441131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.441160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.441269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.441400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.441425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.441504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.441652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.441678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.441837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.441927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.441955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.442047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.442159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.442185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.442317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.442404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.442429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.853 [2024-10-30 16:14:08.442533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.442657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.853 [2024-10-30 16:14:08.442682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.853 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.442767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.442875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.442903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.443004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.443150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.443176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.443270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.443385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.443410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.443491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.443664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.443689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.443832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.443935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.443962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.444046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.444152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.444182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.444296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.444439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.444465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.444583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.444669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.444695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.444804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.444964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.444990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.445082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.445219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.445244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.445367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.445487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.445513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.445679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.445806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.445830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.445969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.446103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.446132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.446244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.446339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.446365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.446454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.446594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.446624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.446729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.446854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.446908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.447039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.447150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.447179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.447331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.447426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.447451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.447538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.447641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.447667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.447763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.447882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.447906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.447997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.448069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.448094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.448176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.448279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.448305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.448383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.448490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.448532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.448614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.448690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.448714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.448827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.448912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.448937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.449024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.449148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.449175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.449305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.449391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.449419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.449502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.449636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.449662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.449744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.449850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.449875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.449971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.450051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.450075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.854 qpair failed and we were unable to recover it. 00:30:18.854 [2024-10-30 16:14:08.450195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.854 [2024-10-30 16:14:08.450319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.450345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.450442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.450553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.450601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.450742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.450869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.450894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.450994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.451109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.451133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.451219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.451341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.451369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.451455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.451615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.451641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.451725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.451805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.451837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.451967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.452077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.452121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.452209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.452319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.452346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.452428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.452521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.452548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.452688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.452781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.452808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.452893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.453025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.453049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.453137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.453224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.453249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.453367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.453478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.453504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.453626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.453739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.453779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.453886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.454049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.454074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.454168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.454290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.454316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.454405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.454512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.454536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.454691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.454842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.454867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.454981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.455125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.455168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.455309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.455394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.455419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.455508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.455598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.455622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.455704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.455810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.455835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.456003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.456129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.456158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.456297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.456421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.456451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.456583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.456658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.456684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.456773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.456859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.456891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.855 [2024-10-30 16:14:08.456974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.457100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.855 [2024-10-30 16:14:08.457125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.855 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.457210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.457297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.457325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.457437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.457554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.457580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.457700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.457783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.457808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.457923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.458034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.458059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.458140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.458235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.458277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.458362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.458477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.458504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.458605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.458688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.458715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.458826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.458903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.458929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.459042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.459129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.459160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.459253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.459347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.459373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.459460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.459579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.459604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.459725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.459807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.459832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.459948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.460058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.460081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.460167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.460239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.460284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.460371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.460463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.460488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.460608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.460724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.460751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.460830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.460904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.460928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.461034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.461149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.461178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.461278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.461359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.461384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.461468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.461562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.461586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.461669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.461811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.461836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.461915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.462056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.462082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.462242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.462350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.462375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.462499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.462595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.462622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.462706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.462838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.462866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.462991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.463068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.463093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.463228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.463378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.463404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.463522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.463650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.463691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.463833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.463911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.463952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.464078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.464189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.464214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.856 qpair failed and we were unable to recover it. 00:30:18.856 [2024-10-30 16:14:08.464332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.856 [2024-10-30 16:14:08.464418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.464449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.464545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.464674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.464699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.464847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.464997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.465024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.465122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.465253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.465289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.465376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.465488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.465513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.465652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.465814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.465839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.465954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.466062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.466088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.466178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.466281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.466307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.466390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.466504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.466530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.466674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.466795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.466837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.466917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.467023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.467047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.467139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.467273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.467316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.467395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.467508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.467532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.467687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.467823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.467848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.467965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.468049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.468074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.468205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.468293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.468319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.468403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.468509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.468534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.468614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.468688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.468712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.468864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.469026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.469068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.469211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.469305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.469332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.469482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.469574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.469599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.469683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.469776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.469799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.469915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.469996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.470021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.470065] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:30:18.857 [2024-10-30 16:14:08.470149] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:18.857 [2024-10-30 16:14:08.470178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.470287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.470313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.470421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.470512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.470537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.470645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.470723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.470748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.470827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.470964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.470989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.471092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.471202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.471228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.471357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.471479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.471503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.471622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.471724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.471748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.857 qpair failed and we were unable to recover it. 00:30:18.857 [2024-10-30 16:14:08.471861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.857 [2024-10-30 16:14:08.471940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.471964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.472113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.472228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.472253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.472381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.472490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.472515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.472629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.472712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.472736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.472824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.472905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.472929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.473045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.473157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.473181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.473282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.473395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.473420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.473534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.473681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.473706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.473820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.473925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.473951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.474099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.474253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.474288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.474398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.474512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.474537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.474660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.474779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.474805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.474885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.474996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.475022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.475110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.475190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.475215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.475355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.475460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.475488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.475585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.475680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.475711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.475792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.475952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.475978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.476121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.476208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.476233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.476346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.476462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.476490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.476614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.476738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.476776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.476901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.477012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.477038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.477157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.477236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.477283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.477374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.477452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.477477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.477573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.477681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.477706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.477813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.477925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.477951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.478038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.478156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.478181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.478310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.478419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.478445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.478536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.478640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.478668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.478780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.478914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.478940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.479028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.479142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.479167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.858 qpair failed and we were unable to recover it. 00:30:18.858 [2024-10-30 16:14:08.479324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.858 [2024-10-30 16:14:08.479409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.479435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.479544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.479652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.479677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.479756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.479870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.479893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.479998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.480067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.480090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.480196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.480286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.480313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.480424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.480539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.480564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.480642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.480747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.480771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.480889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.480995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.481020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.481104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.481215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.481239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.481372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.481484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.481509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.481600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.481688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.481712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.481824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.481904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.481928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.482017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.482124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.482148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.482249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.482350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.482374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.482456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.482603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.482628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.482767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.482906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.482931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.483021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.483132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.483158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.483311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.483431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.483456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.483577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.483691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.483716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.483794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.483901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.483930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.484050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.484156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.484182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.484294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.484380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.484403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.484485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.484573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.484597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.484711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.484832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.484857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.484996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.485076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.485109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.485251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.485332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.485357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.485447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.485529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.485553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.485678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.485784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.485808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.485894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.486030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.486055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.486130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.486224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.486248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.859 qpair failed and we were unable to recover it. 00:30:18.859 [2024-10-30 16:14:08.486379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.486461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.859 [2024-10-30 16:14:08.486486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.486581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.486653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.486678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.486787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.486898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.486928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.487047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.487159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.487184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.487302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.487419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.487455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.487538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.487677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.487702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.487821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.487954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.487979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.488097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.488189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.488214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.488336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.488440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.488464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.488593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.488715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.488740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.488831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.488939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.488965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.489077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.489162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.489188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.489307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.489395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.489420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.489509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.489617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.489642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.489759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.489853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.489878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.489990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.490126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.490152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.490273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.490345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.490370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.490510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.490660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.490685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.490799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.490916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.490941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.491057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.491200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.491226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.491331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.491425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.491450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.491531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.491644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.491669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.491760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.491848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.491872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.492012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.492133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.492158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.492243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.492394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.492420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.492510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.492631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.492656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.492770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.492881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.492906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.492992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.493097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.493122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.860 qpair failed and we were unable to recover it. 00:30:18.860 [2024-10-30 16:14:08.493209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.860 [2024-10-30 16:14:08.493314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.493341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.493425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.493517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.493542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.493649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.493767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.493793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.493880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.493958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.493981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.494067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.494204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.494230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.494331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.494413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.494438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.494544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.494660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.494684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.494768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.494876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.494901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.494987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.495121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.495146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.495275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.495366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.495392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.495521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.495603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.495627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.495720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.495828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.495853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.495942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.496027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.496057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.496173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.496307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.496333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.496419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.496539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.496564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.496670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.496784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.496815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.496931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.497068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.497093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.497240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.497372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.497398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.497502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.497588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.497613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.497697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.497773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.497798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.497879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.498010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.498035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.498155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.498236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.498281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.498387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.498475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.498508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.498630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.498734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.498759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.498873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.498961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.498986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.499098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.499168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.499193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.499287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.499422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.499447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.499553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.499699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.499723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.499826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.499912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.499935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.500018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.500166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.500191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.861 qpair failed and we were unable to recover it. 00:30:18.861 [2024-10-30 16:14:08.500318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.500409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.861 [2024-10-30 16:14:08.500435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.500523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.500606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.500629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.500774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.500919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.500944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.501089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.501205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.501242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.501420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.501536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.501562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.501672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.501781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.501807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.501926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.502068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.502093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.502181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.502294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.502320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.502403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.502525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.502550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.502632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.502741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.502767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.502882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.502983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.503008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.503115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.503218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.503243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.503350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.503429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.503453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.503605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.503731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.503756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.503875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.503982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.504008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.504143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.504233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.504277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.504377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.504494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.504518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.504607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.504712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.504736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.504822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.504958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.504983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.505065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.505188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.505213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.505328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.505409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.505433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.505551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.505639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.505664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.505740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.505876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.505901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.505978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.506105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.506130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.506215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.506341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.506365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.506446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.506531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.506567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.506684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.506800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.506824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.506910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.507017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.507042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.507133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.507248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.507282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.507379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.507463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.507487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.507610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.507773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.507798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.862 qpair failed and we were unable to recover it. 00:30:18.862 [2024-10-30 16:14:08.507904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.862 [2024-10-30 16:14:08.508017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.508042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.508183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.508276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.508304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.508410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.508526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.508551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.508690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.508775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.508801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.508885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.508970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.508994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 EAL: No free 2048 kB hugepages reported on node 1 00:30:18.863 [2024-10-30 16:14:08.509115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.509219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.509243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.509364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.509476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.509501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.509590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.509672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.509696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.509804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.509920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.509945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.510035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.510172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.510197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.510287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.510404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.510427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.510510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.510591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.510615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.510758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.510872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.510901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.511008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.511089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.511114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.511226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.511378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.511403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.511489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.511577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.511601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.511706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.511818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.511843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.511957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.512059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.512084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.512197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.512287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.512316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.512437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.512526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.512559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.512659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.512742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.512766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.512882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.512972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.512997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.513092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.513205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.513234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.513324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.513411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.513436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.513525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.513613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.513638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.513753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.513860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.513885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.514001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.514118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.514143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.514281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.514374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.514401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.514517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.514649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.514674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.514796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.514917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.514941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.863 [2024-10-30 16:14:08.515021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.515135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.863 [2024-10-30 16:14:08.515160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.863 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.515291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.515408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.515432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.515524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.515611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.515636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.515751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.515833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.515857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.515975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.516054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.516081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.516176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.516284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.516310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.516408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.516492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.516517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.516601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.516717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.516742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.516818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.516926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.516951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.517026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.517150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.517176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.517267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.517350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.517375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.517490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.517588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.517614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.517700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.517783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.517809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.517928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.518018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.518043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.518182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.518266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.518293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.518383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.518496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.518521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.518608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.518695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.518720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.518833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.518918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.518945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.519037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.519149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.519176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.519265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.519357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.519382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.519492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.519584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.519608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.519722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.519806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.519831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.519942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.520057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.520082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.520170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.520319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.520344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.520458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.520545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.520571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.520690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.520798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.520823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.520914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.521018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.521044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.521154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.521306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.521333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.864 qpair failed and we were unable to recover it. 00:30:18.864 [2024-10-30 16:14:08.521452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.521569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.864 [2024-10-30 16:14:08.521594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.521681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.521760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.521784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.521903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.522013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.522039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.522120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.522214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.522238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.522340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.522452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.522477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.522597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.522684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.522713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.522800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.522883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.522909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.523002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.523111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.523136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.523224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.523323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.523349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.523456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.523530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.523565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.523649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.523743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.523767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.523903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.523981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.524007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.524118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.524228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.524252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.524406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.524495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.524519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.524621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.524729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.524754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.524832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.524917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.524947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.525053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.525140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.525165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.525261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.525355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.525381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.525468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.525575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.525600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.525713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.525796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.525821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.525899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.526010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.526036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.526142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.526236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.526269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.526360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.526446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.526471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.526592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.526701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.526726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.526814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.526899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.526923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.527009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.527127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.527153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.527269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.527390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.527416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.527498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.527610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.527635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.527748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.527860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.527885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.527971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.528082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.528106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.528193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.528335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.528361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.865 qpair failed and we were unable to recover it. 00:30:18.865 [2024-10-30 16:14:08.528456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.865 [2024-10-30 16:14:08.528577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.528603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.528712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.528825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.528850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.528936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.529049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.529074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.529164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.529249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.529283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.529421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.529507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.529532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.529643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.529726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.529761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.529876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.529987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.530012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.530100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.530205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.530229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.530355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.530431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.530456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.530578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.530685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.530710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.530819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.530904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.530929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.531042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.531150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.531175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.531269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.531379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.531404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.531484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.531601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.531626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.531703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.531789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.531813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.531931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.532014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.532039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.532146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.532263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.532289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.532407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.532515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.532550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.532631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.532742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.532767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.532875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.532963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.532988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.533079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.533158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.533183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.533271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.533384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.533409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.533490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.533610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.533635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.533750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.533857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.533882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.533970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.534113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.534137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.534222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.534323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.534350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.534468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.534584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.534610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.534691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.534829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.534854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.534972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.535062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.535087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.535189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.535306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.535332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.535435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.535516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.866 [2024-10-30 16:14:08.535541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.866 qpair failed and we were unable to recover it. 00:30:18.866 [2024-10-30 16:14:08.535620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.535713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.535738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.535852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.535963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.535987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.536095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.536171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.536197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.536318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.536421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.536446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.536556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.536629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.536661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.536746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.536817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.536843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.536959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.537096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.537121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.537208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.537297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.537330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.537439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.537518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.537543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.537646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.537803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.537827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.537920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.538011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.538036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.538125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.538244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.538276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.538392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.538480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.538505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.538600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.538714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.538740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.538850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.538959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.538984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.539128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.539242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.539309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.539401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.539515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.539540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.539656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.539735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.539759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.539852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.539959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.539984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.540071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.540180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.540206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.540292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.540379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.540404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.540520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.540609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.540634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.540720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.540802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.540827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.540908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.540999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.541025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.541140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.541247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.541281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.541414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.541534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.541572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.541660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.541738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.541763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.541853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.541943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.541968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.542094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.542208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.542233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.542330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.542409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.542435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.867 qpair failed and we were unable to recover it. 00:30:18.867 [2024-10-30 16:14:08.542520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.542632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.867 [2024-10-30 16:14:08.542657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.542753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.542861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.542887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.543009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.543152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.543178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.543298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.543385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.543410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.543493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.543588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.543613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.543730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.543820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.543845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.543929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.544036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.544061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.544157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.544245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.544278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.544382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.544498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.544523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.544616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.544724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.544749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.544833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.544944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.544969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.544977] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:18.868 [2024-10-30 16:14:08.545054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.545128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.545154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.545247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.545356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.545381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.545464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.545587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.545611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.545700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.545785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.545810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.545900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.546007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.546032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.546126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.546245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.546296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.546395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.546506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.546532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.546653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.546742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.546767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.546850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.546944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.546970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.547056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.547174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.547200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.547324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.547436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.547461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.547562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.547636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.547661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.547751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.547868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.547894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.548008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.548118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.548144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.548238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.548371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.548397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.548538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.548629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.548654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.868 qpair failed and we were unable to recover it. 00:30:18.868 [2024-10-30 16:14:08.548746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.868 [2024-10-30 16:14:08.548829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.548854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.548935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.549022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.549048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.549159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.549270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.549296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.549382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.549457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.549483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.549598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.549674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.549699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.549784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.549897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.549922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.550012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.550129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.550154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.550253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.550423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.550449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.550590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.550706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.550736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.550816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.550932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.550957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.551075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.551167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.551193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.551307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.551424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.551450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.551530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.551639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.551663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.551749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.551859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.551884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.551993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.552104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.552129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.552207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.552326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.552352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.552449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.552569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.552595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.552704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.552786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.552812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.552893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.552986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.553015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.553127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.553231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.553263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.553368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.553451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.553476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.553605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.553692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.553717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.553809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.553915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.553940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.554056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.554151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.554175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.554267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.554387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.554413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.554522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.554628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.554654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.554743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.554825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.554851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.554990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.555077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.555102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.555196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.555285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.555311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.555404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.555507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.555532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.869 [2024-10-30 16:14:08.555627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.555711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.869 [2024-10-30 16:14:08.555736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.869 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.555822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.555908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.555933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.556045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.556163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.556188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.556273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.556377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.556402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.556493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.556585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.556610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.556704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.556793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.556817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.556956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.557042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.557067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.557139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.557220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.557245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.557347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.557459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.557484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.557632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.557724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.557749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.557862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.557978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.558003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.558092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.558202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.558226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.558341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.558425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.558450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.558562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.558675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.558699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.558791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.558927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.558951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.559031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.559119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.559144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.559301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.559396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.559421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.559537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.559654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.559680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.559795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.559878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.559903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.560017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.560138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.560164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.560247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.560343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.560369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.560507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.560592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.560616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.560725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.560850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.560875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.560991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.561064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.561089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.561204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.561292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.561318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.561399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.561483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.561508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.561588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.561677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.561702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.561809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.561923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.561948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.562036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.562110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.562135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.562248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.562347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.562373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.562449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.562561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.562585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.870 qpair failed and we were unable to recover it. 00:30:18.870 [2024-10-30 16:14:08.562703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.870 [2024-10-30 16:14:08.562815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.562840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.562945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.563030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.563055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.563133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.563241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.563275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.563362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.563446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.563472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.563586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.563694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.563719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.563831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.563924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.563951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.564036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.564140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.564166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.564246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.564365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.564391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.564473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.564585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.564614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.564696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.564808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.564833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.564920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.565011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.565035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.565124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.565238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.565272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.565369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.565475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.565501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.565582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.565654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.565678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.565771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.565853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.565877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.565962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.566048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.566073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.566181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.566271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.566299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.566392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.566474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.566499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.566611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.566721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.566745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.566833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.566914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.566939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.567019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.567124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.567149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.567235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.567326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.567352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.567491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.567570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.567595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.567746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.567831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.567857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.567949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.568027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.568053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.568161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.568252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.568298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.568385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.568466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.568492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.568630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.568713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.568738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.568829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.568919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.568945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.569063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.569150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.569175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.871 [2024-10-30 16:14:08.569281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.569392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.871 [2024-10-30 16:14:08.569418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.871 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.569497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.569584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.569609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.569693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.569783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.569808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.569894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.570046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.570072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.570147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.570223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.570248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.570368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.570454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.570480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.570598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.570710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.570735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.570817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.570892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.570917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.570993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.571079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.571104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.571215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.571329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.571361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.571461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.571586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.571612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.571704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.571790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.571816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.571910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.572019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.572045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.572137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.572224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.572252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.572382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.572475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.572502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.572624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.572705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.572731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.572822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.572925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.572951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.573038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.573132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.573160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.573249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.573376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.573409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.573508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.573600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.573626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.573741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.573863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.573891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.573982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.574076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.574104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.574220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.574317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.574345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.574436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.574527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.574554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.574668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.574783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.574809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.574887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.574970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.574998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.575136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.575225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.575267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.575388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.575476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.575502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.872 qpair failed and we were unable to recover it. 00:30:18.872 [2024-10-30 16:14:08.575604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.575684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.872 [2024-10-30 16:14:08.575710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.575824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.575943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.575970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.576060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.576152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.576186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.576282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.576363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.576389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.576510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.576629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.576654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.576735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.576809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.576835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.576971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.577049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.577075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.577170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.577277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.577304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.577383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.577490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.577516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.577666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.577755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.577781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.577862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.577952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.577978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.578077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.578189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.578215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.578326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.578443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.578468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.578583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.578669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.578695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.578807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.578886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.578912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.579026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.579106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.579132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.579220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.579308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.579334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.579448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.579527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.579554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.579667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.579778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.579804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.579913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.580026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.580051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.580163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.580248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.580286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.580404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.580485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.580515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.580605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.580695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.580721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.580804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.580922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.580949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.581030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.581138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.581165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.581254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.581408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.581435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.581528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.581643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.581670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.581785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.581900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.581927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.582011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.582121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.582147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.582238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.582345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.582371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.873 [2024-10-30 16:14:08.582484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.582584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.873 [2024-10-30 16:14:08.582610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.873 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.582699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.582809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.582840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.582930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.583015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.583042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.583151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.583240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.583273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.583364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.583502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.583528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.583607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.583723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.583748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.583839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.583959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.583985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.584079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.584157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.584183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.584268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.584364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.584391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.584488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.584590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.584616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.584708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.584814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.584840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.584925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.585018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.585050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.585164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.585243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.585278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.585365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.585482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.585508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.585630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.585720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.585746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.585835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.585913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.585940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.586019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.586115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.586141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.586227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.586345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.586371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.586454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.586557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.586583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.586694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.586776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.586803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.586885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.586979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.587005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.587094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.587208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.587243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.587360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.587483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.587510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.587608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.587748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.587774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.587853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.587964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.587992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.588083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.588194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.588219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.588329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.588445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.588471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.588565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.588655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.588684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.588790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.588908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.588935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.589034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.589122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.589149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.589240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.589351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.874 [2024-10-30 16:14:08.589377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.874 qpair failed and we were unable to recover it. 00:30:18.874 [2024-10-30 16:14:08.589462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.589543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.589575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.589706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.589795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.589821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.589937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.590017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.590044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.590137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.590278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.590312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.590400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.590483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.590515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.590629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.590740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.590766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.590858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.590962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.590987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.591098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.591191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.591217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.591335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.591444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.591470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.591585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.591695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.591721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.591838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.591958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.591983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.592103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.592180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.592206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.592289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.592374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.592400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.592539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.592625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.592651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.592744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.592856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.592882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.592999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.593131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.593159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.593266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.593357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.593383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.593464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.593564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.593591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.593681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.593796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.593822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.593911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.594022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.594049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.594173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.594278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.594316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.594411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.594494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.594521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.594620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.594713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.594739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.594853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.594963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.594988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.595105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.595187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.595212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.595335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.595430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.595457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.595546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.595664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.595689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.595813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.595907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.595932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.596044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.596126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.596152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.596288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.596379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.596403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.875 qpair failed and we were unable to recover it. 00:30:18.875 [2024-10-30 16:14:08.596515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.875 [2024-10-30 16:14:08.596613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.596645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.596741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.596833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.596859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.596938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.597019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.597044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.597129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.597225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.597252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.597368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.597486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.597511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.597601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.597699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.597725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.597842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.597982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.598008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.598090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.598197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.598221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.598343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.598459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.598484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.598606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.598719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.598745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.598844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.598966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.598993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.599089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.599197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.599223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.599324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.599411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.599438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.599566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.599643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.599668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.599758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.599847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.599872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.599988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.600101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.600128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.600211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.600311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.600337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.600427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.600521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.600546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.600684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.600799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.600824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.600924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.601041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.601066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.601150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.601235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.601272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.601376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.601487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.601513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.601601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.601714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.601739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.601851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.601969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.601995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.602083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.602177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.602204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.602307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.602412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.602437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.602529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.602616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.602643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.602763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.602875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.602900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.603015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.603099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.603126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.603212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.603319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.603347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.876 [2024-10-30 16:14:08.603485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.603573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.876 [2024-10-30 16:14:08.603600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.876 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.603694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.603788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.603814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.603914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.603997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.604023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.604108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.604214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.604240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.604339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.604449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.604475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.604588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.604697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.604723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.604815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.604891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.604917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.604995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.605112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.605137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.605222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.605321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.605348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.605442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.605536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.605561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.605653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.605741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.605766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.605869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.606002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.606029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.606141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.606232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.606271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.606374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.606491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.606516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.606615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.606698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.606725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.606835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.606913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.606938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.607032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.607125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.607151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.607293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.607414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.607440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.607556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.607641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.607668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.607782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.607892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.607916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.608062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.608154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.608179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.608266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.608394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.608420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.608509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.608591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.608617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.608737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.608849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.608875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.608969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.609109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.609135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.609221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.609318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.609344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.609417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.609534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.609559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.609640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.609723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.609748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.877 qpair failed and we were unable to recover it. 00:30:18.877 [2024-10-30 16:14:08.609835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.877 [2024-10-30 16:14:08.609948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.609973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.610059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.610169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.610195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.610319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.610396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.610422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.610536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.610654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.610681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.610797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.610915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.610951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.611041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.611150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.611177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.611272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.611364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.611391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.611514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.611627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.611652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.611743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.611829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.611856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.611945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.612057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.612083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.612167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.612267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.612303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.612384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.612469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.612494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.612569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.612682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.612706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.612822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.612941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.612967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.613061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.613175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.613200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.613316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.613430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.613455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.613539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.613630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.613657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.613751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.613840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.613867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.613959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.614069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.614095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.614187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.614297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.614324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.614420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.614507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.614532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.614627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.614737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.614763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.614855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.614974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.615000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.615118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.615212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.615238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.615373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.615462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.615489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.615617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.615707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.615734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.615825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.615902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.615927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.616035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.616157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.616182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.616274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.616367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.616393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.616473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.616563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.616588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.878 qpair failed and we were unable to recover it. 00:30:18.878 [2024-10-30 16:14:08.616677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.878 [2024-10-30 16:14:08.616763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.616791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.616879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.616998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.617023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.617137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.617243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.617307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.617391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.617477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.617510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.617603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.617690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.617716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.617798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.617882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.617908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.617988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.618074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.618101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.618210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.618299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.618327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.618407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.618486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.618511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.618590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.618676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.618703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.618799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.618889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.618915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.619055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.619131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.619156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.619272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.619370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.619397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.619540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.619660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.619691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.619805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.619889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.619916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.620058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.620137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.620162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.620279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.620369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.620395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.620509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.620601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.620627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.620717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.620831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.620856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.620937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.621028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.621053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.621139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.621254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.621287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.621403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.621515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.621541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.621638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.621755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.621781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.621898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.622014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.622044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.622129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.622244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.622280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.622397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.622511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.622537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.622653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.622741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.622768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.622858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.622932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.622956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.623069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.623161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.623186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.623309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.623419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.623444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.879 qpair failed and we were unable to recover it. 00:30:18.879 [2024-10-30 16:14:08.623561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.879 [2024-10-30 16:14:08.623647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.623672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.623790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.623906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.623932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.624015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.624101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.624126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.624217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.624340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.624372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.624465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.624583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.624608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.624689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.624816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.624842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.624938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.625024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.625052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.625147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.625228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.625254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.625353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.625437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.625464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.625556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.625673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.625699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.625813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.625896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.625921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.626033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.626118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.626145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.626241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.626375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.626402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.626492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.626603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.626629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.626714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.626826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.626851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.626961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.627105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.627132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.627222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.627314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.627339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.627429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.627538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.627563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.627674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.627784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.627809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.627903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.627997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.628023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.628135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.628217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.628242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.628342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.628416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.628442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.628531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.628623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.628649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.628763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.628845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.628872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.628967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.629106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.629132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.629222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.629343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.629370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.629460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.629540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.629565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.629653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.629771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.629797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.629891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.629978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.630004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.630113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.630195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.630221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.880 [2024-10-30 16:14:08.630342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.630420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.880 [2024-10-30 16:14:08.630445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.880 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.630555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.630696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.630721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.630809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.630892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.630918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.631032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.631115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.631139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.631236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.631340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.631367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.631457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.631551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.631577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.631686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.631770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.631796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.631890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.632006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.632032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.632124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.632210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.632236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.632358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.632479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.632507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.632634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.632720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.632745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.632865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.632950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.632978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.633075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.633185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.633210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.633333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.633475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.633501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.633593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.633680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.633705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.633806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.633891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.633916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.634010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.634128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.634153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.634235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.634390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.634418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.634504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.634595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.634622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.634706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.634848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.634874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.634979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.635055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.635080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.635165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.635248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.635283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.635421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.635559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.635585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.635672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.635783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.635810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.635910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.636025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.636051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.636161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.636238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.636272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.636363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.636448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.636474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.636614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.636726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.636751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.881 qpair failed and we were unable to recover it. 00:30:18.881 [2024-10-30 16:14:08.636866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.881 [2024-10-30 16:14:08.636949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.636975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.637061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.637179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.637205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.637351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.637440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.637466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.637565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.637704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.637731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.637817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.637953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.637979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.638070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.638147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.638172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.638266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.638352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.638378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.638462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.638574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.638599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.638690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.638807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.638833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.638916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.638999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.639025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.639106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.639192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.639217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.639319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.639400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.639427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.639512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.639606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.639632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.639714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.639795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.639823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 [2024-10-30 16:14:08.639814] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.639905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.639941] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:18.882 [2024-10-30 16:14:08.639958] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:18.882 [2024-10-30 16:14:08.639971] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:18.882 [2024-10-30 16:14:08.639994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.640019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.640028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:18.882 [2024-10-30 16:14:08.640110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.640186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.640211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.640305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.640320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:18.882 [2024-10-30 16:14:08.640404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.640430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.640518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.640600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:18.882 [2024-10-30 16:14:08.640605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:18.882 [2024-10-30 16:14:08.640660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.640684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.640802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.640890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.640915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.641032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.641140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.641165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.641288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.641373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.641399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.641486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.641600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.641626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.641704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.641787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.641811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.641924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.642019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.642045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.642167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.642252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.642284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.642374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.642463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.642489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.642586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.642695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.642721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.642839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.642928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.642953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.882 [2024-10-30 16:14:08.643041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.643117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.882 [2024-10-30 16:14:08.643143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.882 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.643224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.643322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.643348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.643440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.643552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.643578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.643694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.643798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.643823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.643934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.644018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.644043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.644152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.644231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.644264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.644360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.644451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.644477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.644557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.644668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.644693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.644784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.644893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.644918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.645026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.645113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.645138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.645248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.645345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.645372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.645466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.645582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.645607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.645694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.645806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.645833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.645926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.646038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.646064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.646172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.646252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.646325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.646423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.646541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.646567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.646661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.646746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.646773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.646874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.646982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.647008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.647090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.647192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.647218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.647321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.647407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.647433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.647516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.647605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.647631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.647716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.647805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.647832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.647950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.648048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.648073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.648164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.648284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.648311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.648402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.648488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.648515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.648600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.648686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.648711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.648798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.648889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.648915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.649033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.649147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.649173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.649282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.649392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.649417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.649499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.649591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.649617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.883 qpair failed and we were unable to recover it. 00:30:18.883 [2024-10-30 16:14:08.649708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.883 [2024-10-30 16:14:08.649798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.649825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.649921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.650009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.650034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.650117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.650197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.650223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.650347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.650435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.650460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.650546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.650654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.650680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.650762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.650878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.650904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.650994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.651080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.651105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.651228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.651348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.651374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.651471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.651583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.651608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.651694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.651802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.651828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.651945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.652030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.652055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.652139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.652245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.652281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.652373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.652501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.652525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.652639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.652752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.652777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.652865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.652946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.652971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.653057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.653170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.653195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.653278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.653394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.653420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.653506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.653587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.653612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.653694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.653768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.653793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.653885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.653980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.654006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.654116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.654227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.654252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.654341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.654417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.654443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.654525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.654611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.654636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.654718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.654810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.654837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.654954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.655036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.655062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.655180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.655273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.655299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.655408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.655495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.655521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.655601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.655745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.655770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.655891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.656014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.656038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.656115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.656234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.656285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.884 [2024-10-30 16:14:08.656363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.656453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.884 [2024-10-30 16:14:08.656479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.884 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.656593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.656674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.656700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.656790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.656904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.656931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.657019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.657108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.657134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.657225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.657348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.657375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.657462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.657551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.657575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.657666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.657760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.657789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.657906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.657990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.658016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.658106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.658200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.658226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.658402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.658484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.658510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.658604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.658691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.658716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.658818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.658934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.658960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.659050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.659128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.659154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.659243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.659333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.659358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.659449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.659533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.659560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.659664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.659760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.659785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.659875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.659957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.659989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.660103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.660188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.660213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.660326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.660405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.660430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.660520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.660634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.660660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.660757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.660841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.660866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.660955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.661048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.661074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.661187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.661288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.661316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.661406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.661489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.661516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.661603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.661681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.661706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.661792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.661904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.661929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.662049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.662135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.662165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.662244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.662348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.662372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.662457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.662574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.662600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.662687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.662780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.662805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.885 [2024-10-30 16:14:08.662921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.662998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.885 [2024-10-30 16:14:08.663024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.885 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.663127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.663222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.663247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.663396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.663485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.663512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.663627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.663738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.663765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.663881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.663976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.664001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.664082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.664158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.664184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.664268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.664381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.664411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.664529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.664648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.664673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.664765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.664849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.664877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.664953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.665032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.665058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.665147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.665218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.665243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.665339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.665428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.665452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.665542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.665650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.665675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.665786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.665893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.665918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.666032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.666146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.666172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.666247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.666341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.666367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.666453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.666544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.666571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.666716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.666794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.666820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.666908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.666997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.667024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.667139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.667221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.667247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.667343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.667431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.667456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.667573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.667653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.667678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.667799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.667886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.667911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.667997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.668081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.668107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.668182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.668299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.668325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.668413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.668530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.668556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.668649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.668761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.668788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.668883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.668965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.668992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.669083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.669195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.669220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.669336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.669411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.669436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.669530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.669635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.669661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.669746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.669830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.669855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.669941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.670081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.670109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.670223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.670319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.670347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.886 qpair failed and we were unable to recover it. 00:30:18.886 [2024-10-30 16:14:08.670436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.886 [2024-10-30 16:14:08.670521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.670546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.670629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.670747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.670773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.670861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.670951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.670976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.671072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.671166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.671192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.671275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.671356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.671383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.671464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.671554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.671581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.671668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.671744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.671769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.671852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.671944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.671972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.672066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.672141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.672167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.672264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.672343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.672369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.672461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.672582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.672607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.672692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.672776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.672802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.672883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.672972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.672998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.673127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.673209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.673235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.673325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.673437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.673463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.673551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.673633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.673659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.673770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.673843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.673868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.673949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.674064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.674090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.674170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.674249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.674285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.674370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.674449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.674475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.674554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.674670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.674696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.674785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.674871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.674896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.674984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.675071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.675097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.675205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.675296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.675322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.675413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.675501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.675526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.675612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.675696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.675722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.675807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.675923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.675949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.676037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.676151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.676179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.676269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.676380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.676407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.676491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.676578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.676603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.676713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.676820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.676845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.676927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.677001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.677027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.677106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.677227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.677253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.677354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.677429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.677454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.677536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.677623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.677648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.887 qpair failed and we were unable to recover it. 00:30:18.887 [2024-10-30 16:14:08.677804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.887 [2024-10-30 16:14:08.677919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.677945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.678032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.678106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.678131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.678217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.678342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.678369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.678452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.678542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.678568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.678652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.678735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.678761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.678851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.678927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.678953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.679055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.679143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.679169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.679305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.679423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.679450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.679576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.679656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.679683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.679765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.679851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.679877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.679955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.680041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.680068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.680182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.680267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.680294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.680385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.680476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.680503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.680595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.680673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.680700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.680807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.680887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.680912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.680997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.681119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.681145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.681229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.681322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.681350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.681440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.681527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.681553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.681661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.681794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.681827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.681925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.682004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.682030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.682108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.682224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.682250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.682342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.682424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.682450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.682535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.682651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.682677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.682754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.682839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.682864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.682951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.683063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.683089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.683176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.683272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.683298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.683416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.683531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.683557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.683634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.683752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.683779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.683900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.683989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.684016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.684099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.684204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.684229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.684325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.684412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.684438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.684524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.684605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.684632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.684727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.684836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.888 [2024-10-30 16:14:08.684862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.888 qpair failed and we were unable to recover it. 00:30:18.888 [2024-10-30 16:14:08.684943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.685031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.685057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.685149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.685269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.685296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.685399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.685487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.685514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.685601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.685717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.685744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.685840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.685919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.685944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.686042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.686156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.686182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.686271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.686360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.686387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.686471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.686559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.686585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.686667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.686755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.686781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.686863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.686947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.686973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.687058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.687143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.687170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.687282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.687380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.687407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.687485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.687571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.687596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.687675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.687794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.687819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.687903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.687981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.688007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.688099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.688187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.688215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.688311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.688422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.688448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.688536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.688627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.688654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.688735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.688817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.688841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.688928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.689044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.689070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.689151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.689250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.689283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.689366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.689455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.689481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.689596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.689674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.689700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.689795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.689900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.689925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.690008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.690086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.690113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.690206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.690308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.690334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.690414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.690490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.690515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.690625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.690704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.690732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.889 qpair failed and we were unable to recover it. 00:30:18.889 [2024-10-30 16:14:08.690823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.690911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.889 [2024-10-30 16:14:08.690936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.691021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.691143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.691169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.691261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.691344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.691374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.691453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.691579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.691605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.691687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.691776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.691803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.691892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.691967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.691992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.692084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.692164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.692191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.692282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.692368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.692398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.692491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.692575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.692601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.692691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.692775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.692801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.692881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.692968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.692993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.693084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.693165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.693190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.693278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.693359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.693384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.693468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.693579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.693605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.693698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.693785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.693811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.693926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.694008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.694035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.694121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.694208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.694233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.694327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.694408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.694445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.694532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.694639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.694665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.694786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.694906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.694932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.695042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.695121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.695147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:18.890 [2024-10-30 16:14:08.695228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.695329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.890 [2024-10-30 16:14:08.695360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:18.890 qpair failed and we were unable to recover it. 00:30:19.173 [2024-10-30 16:14:08.695448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-10-30 16:14:08.695530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-10-30 16:14:08.695558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-10-30 16:14:08.695642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-10-30 16:14:08.695725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-10-30 16:14:08.695751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-10-30 16:14:08.695832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-10-30 16:14:08.695944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-10-30 16:14:08.695969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-10-30 16:14:08.696045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-10-30 16:14:08.696124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-10-30 16:14:08.696151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-10-30 16:14:08.696241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-10-30 16:14:08.696341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.696366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.696458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.696549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.696581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.696678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.696767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.696791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.696876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.696961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.696988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.697072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.697148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.697173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.697282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.697373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.697399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.697479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.697565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.697590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.697707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.697790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.697815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.697911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.697995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.698020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.698114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.698196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.698222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.698314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.698425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.698451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.698541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.698621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.698646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.698734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.698821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.698847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.698963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.699043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.699068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.699154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.699235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.699268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.699388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.699477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.699503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.699585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.699669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.699695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.699784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.699900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.699927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.700011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.700100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.700125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.700210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.700294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.700319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.700404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.700480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.700506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.700594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.700680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.700708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.700805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.700915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.700941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.701029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.701139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.701165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.701275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.701353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.701380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.701460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.701544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.701571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.701651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.701758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.701783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.701864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.701948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.701973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.702067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.702157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.702184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.702276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.702387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.702413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-10-30 16:14:08.702498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-10-30 16:14:08.702580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.702605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.702684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.702788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.702814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.702911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.702986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.703011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.703122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.703238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.703269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.703359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.703446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.703472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.703597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.703680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.703706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.703843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.703926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.703952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.704028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.704142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.704167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.704286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.704391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.704417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.704497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.704616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.704642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.704764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.704848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.704874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.704960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.705047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.705072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.705161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.705271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.705296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.705380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.705542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.705567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.705663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.705751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.705777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.705892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.705987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.706012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.706102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.706202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.706228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.706320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.706415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.706441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.706532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.706610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.706635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.706748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.706831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.706856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.706943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.707059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.707085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.707182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.707289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.707315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.707409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.707487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.707512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.707626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.707715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.707741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.707861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.707942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.707966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.708081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.708163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.708188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.708307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.708401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.708425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.708516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.708627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.708653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.708741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.708849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.708873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.708984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.709123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.709148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-10-30 16:14:08.709230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-10-30 16:14:08.709322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.709347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.709462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.709580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.709607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.709707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.709824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.709850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.709935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.710008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.710033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.710116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.710206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.710232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.710333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.710424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.710452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.710534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.710610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.710636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.710735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.710822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.710847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.710927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.711020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.711045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.711124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.711213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.711242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.711367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.711444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.711469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.711580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.711665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.711697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.711795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.711906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.711931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.712013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.712091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.712118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.712224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.712322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.712348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.712435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.712517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.712542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.712624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.712704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.712730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.712847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.712959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.712984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.713096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.713202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.713227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.713374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.713461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.713486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.713607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.713692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.713718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.713831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.713934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.713961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.714046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.714156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.714181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.714302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.714383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.714408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.714519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.714601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.714626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.714713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.714796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.714822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.714910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.715000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.715027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.715113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.715199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.715225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.715319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.715400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.715426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.715521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.715634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.715660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-10-30 16:14:08.715750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.715840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-10-30 16:14:08.715865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.715955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.716040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.716065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.716155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.716246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.716279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.716372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.716490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.716516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.716596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.716672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.716697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.716820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.716903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.716928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.717010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.717135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.717162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.717283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.717366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.717391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.717487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.717593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.717618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.717741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.717816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.717841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.717942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.718026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.718051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.718159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.718232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.718264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.718350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.718446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.718473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.718563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.718645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.718672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.718756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.718870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.718895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.719010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.719101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.719127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.719298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.719386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.719412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.719501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.719590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.719615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.719704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.719786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.719812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.719901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.719999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.720025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.720114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.720192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.720218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.720314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.720402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.720428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.720503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.720617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.720643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.720750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.720830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.720855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.720934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.721020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.721045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.721138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.721259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.721285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.721374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.721452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.721476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.721558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.721671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.721696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.721808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.721889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.721914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.722002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.722113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.722139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.722228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.722313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-10-30 16:14:08.722339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-10-30 16:14:08.722458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.722549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.722574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.722660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.722741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.722766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.722858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.722970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.722996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.723082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.723162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.723187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.723273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.723358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.723383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.723498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.723598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.723623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.723718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.723800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.723825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.723913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.724020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.724046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.724160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.724269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.724295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.724416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.724503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.724529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.724642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.724733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.724758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.724847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.724950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.724980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.725063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.725142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.725169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.725272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.725348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.725373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.725453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.725536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.725563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.725654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.725750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.725776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.725868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.725986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.726011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.726092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.726204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.726230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.726321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.726407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.726434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.726545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.726637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.726663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.726741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.726829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.726854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.726971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.727063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.727093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.727172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.727310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.727337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.727423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.727528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.727554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.727662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.727774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.727800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-10-30 16:14:08.727893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-10-30 16:14:08.727973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.727999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.728095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.728202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.728226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.728320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.728434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.728461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.728553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.728667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.728692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.728771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.728860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.728885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.728970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.729049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.729076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.729163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.729247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.729287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.729408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.729493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.729518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.729592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.729706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.729731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.729841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.729953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.729979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.730065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.730151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.730175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.730251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.730339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.730364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.730447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.730533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.730559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.730641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.730735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.730761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.730836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.730921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.730946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.731029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.731119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.731145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.731238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.731327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.731358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.731471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.731555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.731581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.731664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.731741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.731767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.731857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.731942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.731967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.732063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.732143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.732169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.732275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.732404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.732434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.732523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.732640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.732666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.732750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.732840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.732867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.732976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.733093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.733119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.733200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.733293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.733320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.733472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.733552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.733578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.733662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.733742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.733769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.733846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.733926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.733950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.734035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.734119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.734146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-10-30 16:14:08.734245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.734332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-10-30 16:14:08.734359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.734451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.734543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.734568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.734678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.734770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.734797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.734908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.735047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.735072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.735157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.735247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.735279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.735368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.735478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.735503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.735590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.735682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.735708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.735805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.735899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.735927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.736005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.736149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.736175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.736250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.736341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.736368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.736465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.736581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.736607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.736694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.736773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.736797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.736886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.736995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.737021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.737102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.737182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.737208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.737305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.737415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.737442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.737585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.737669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.737695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.737777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.737889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.737914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.738017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.738095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.738120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.738208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.738298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.738324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.738406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.738486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.738511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.738600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.738685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.738711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.738798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.738881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.738907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.739025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.739101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.739126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.739236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.739327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.739353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.739444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.739546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.739571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.739687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.739768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.739795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.739878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.739958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.739985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.740108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.740218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.740244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.740360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.740470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.740496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.740574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.740661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.740686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-10-30 16:14:08.740827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.740907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-10-30 16:14:08.740933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.741043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.741127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.741152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.741233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.741371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.741406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.741519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.741606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.741631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.741716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.741797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.741823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.741906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.742018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.742043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.742161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.742278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.742304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.742394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.742472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.742498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.742586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.742667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.742695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.742774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.742881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.742905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.742994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.743081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.743107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.743202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.743291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.743319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.743434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.743515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.743540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.743623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.743763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.743789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.743872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.743954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.743979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.744090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.744182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.744209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.744304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.744391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.744416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.744509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.744598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.744624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.744720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.744801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.744826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.744916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.745006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.745031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.745144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.745231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.745264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.745354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.745438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.745464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.745547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.745627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.745654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.745741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.745834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.745860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.745945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.746058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.746084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.746174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.746289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.746316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.746429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.746537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.746564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.746681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.746756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.746782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.746868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.746949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.746974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.747062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.747179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.747204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.747319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.747402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-10-30 16:14:08.747427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-10-30 16:14:08.747503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.747581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.747606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.747721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.747824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.747849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.747935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.748048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.748074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.748151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.748233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.748262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.748373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.748463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.748488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.748562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.748650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.748674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.748771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.748870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.748898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.749019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.749159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.749184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.749280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.749398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.749423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.749502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.749620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.749646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.749756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.749840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.749868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.749944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.750031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.750057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.750168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.750261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.750287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.750372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.750483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.750508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.750595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.750685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.750710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.750801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.750916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.750942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.751030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.751149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.751175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.751291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.751374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.751401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.751489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.751574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.751600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.751714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.751823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.751848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.751923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.752001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.752028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.752145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.752231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.752262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.752343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.752424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.752451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.752542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.752624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.752650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.752753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.752869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.752894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.752981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.753062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.753087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-10-30 16:14:08.753200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.753314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-10-30 16:14:08.753340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.753426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.753503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.753528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.753609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.753716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.753742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.753858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.753943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.753969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.754058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.754172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.754198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.754291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.754379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.754404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.754513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.754622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.754647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.754759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.754842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.754867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.755005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.755085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.755110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.755192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.755274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.755301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.755419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.755511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.755536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.755617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.755710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.755737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.755846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.755925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.755951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.756044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.756123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.756148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.756235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.756327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.756353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.756439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.756527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.756554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.756674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.756781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.756807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.756893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.756978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.757005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.757115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.757195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.757220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.757319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.757407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.757432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.757515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.757655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.757681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.757775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.757853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.757878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.757962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.758048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.758073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.758157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.758243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.758276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.758397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.758489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.758515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.758632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.758739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.758764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.758881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.758954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.758979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.759055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.759134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.759160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.759245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.759345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.759371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.759456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.759534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.759560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-10-30 16:14:08.759640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-10-30 16:14:08.759721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.759753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.759835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.759946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.759971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.760055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.760136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.760160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.760250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.760348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.760375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.760457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.760576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.760602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.760686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.760802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.760827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.760905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.760981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.761006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.761085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.761165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.761190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.761283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.761364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.761390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.761476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.761591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.761617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.761704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.761817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.761848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.761965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.762052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.762078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.762188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.762304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.762330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.762411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.762495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.762522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.762609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.762724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.762750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.762826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.762935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.762961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.763047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.763158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.763183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.763267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.763344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.763370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.763449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.763564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.763589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.763670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.763752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.763777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.763872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.763980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.764011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.764097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.764173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.764197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.764305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.764389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.764415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.764514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.764624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.764649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.764728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.764807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.764833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.764962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.765065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.765090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.765165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.765280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.765307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.765396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.765477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.765503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.765583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.765700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.765726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.765818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.765895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.765920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-10-30 16:14:08.766007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.766113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-10-30 16:14:08.766143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.766230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.766320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.766346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.766444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.766529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.766554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.766635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.766745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.766771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.766858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.766942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.766968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.767048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.767154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.767180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.767262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.767378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.767405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.767484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.767566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.767592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.767705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.767821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.767848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.767931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.768024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.768051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.768166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.768260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.768287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.768383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.768465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.768491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.768564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.768643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.768669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.768759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.768839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.768866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.768949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.769033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.769058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.769173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.769253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.769297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.769386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.769473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.769500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.769612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.769692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.769718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.769808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.769887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.769913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.769993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.770101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.770126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.770222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.770311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.770337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.770430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.770512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.770538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.770646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.770723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.770749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.770860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.770948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.770974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.771052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.771125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.771151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.771239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.771386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.771412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.771496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.771609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.771635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.771717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.771806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.771833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.771929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.772008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.772034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.772121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.772197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.772222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.772341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.772426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-10-30 16:14:08.772451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-10-30 16:14:08.772541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.772655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.772680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.772769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.772847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.772873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.772957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.773038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.773063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.773174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.773285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.773311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.773395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.773475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.773501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.773583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.773695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.773722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.773811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.773923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.773948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.774057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.774135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.774160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.774245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.774326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.774351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.774427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.774508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.774533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.774618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.774727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.774752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.774829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.774908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.774932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.775012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.775097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.775122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.775230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.775346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.775373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.775482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.775598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.775623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.775705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.775783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.775808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.775887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.775995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.776020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.776109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.776185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.776209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.776292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.776365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.776390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.776502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.776580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.776605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.776683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.776766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.776792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.776879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.776967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.776993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.777078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.777156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.777183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.777278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.777392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.777418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.777498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.777607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.777632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.777718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.777800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.777827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.777938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.778017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-10-30 16:14:08.778043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-10-30 16:14:08.778129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.778206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.778231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.778327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.778422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.778447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.778537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.778616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.778640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.778758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.778841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.778868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.778953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.779031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.779056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.779137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.779250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.779281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.779362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.779444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.779470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.779586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.779664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.779690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.779773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.779848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.779873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.779970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.780046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.780071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.780178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.780252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.780283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.780366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.780476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.780500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.780584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.780663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.780688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.780802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.780912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.780937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.781022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.781099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.781124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.781235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.781363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.781389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.781475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.781557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.781583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.781665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.781749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.781775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.781857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.781934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.781961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.782051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.782130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.782155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.782269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.782347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.782372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.782452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.782531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.782555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.782638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.782743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.782768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.782853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.782957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.782982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.783090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.783170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.783195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.783309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.783395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.783421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.783508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.783591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.783616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.783693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.783768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.783794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.783904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.783984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.784009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.784117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.784193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.784219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-10-30 16:14:08.784337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-10-30 16:14:08.784415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.784441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.784521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.784595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.784620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.784730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.784804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.784829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.784907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.785023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.785049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.785133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.785218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.785243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.785368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.785479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.785503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.785587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.785668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.785695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.785780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.785860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.785885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.786004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.786079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.786104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.786187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.786305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.786331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.786443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.786519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.786544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.786654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.786725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.786750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.786829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.786905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.786930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.787013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.787125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.787151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.787239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.787333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.787360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.787471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.787547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.787572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.787658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.787783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.787809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.787895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.787966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.787991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.788097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.788205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.788231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.788329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.788410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.788436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.788516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.788596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.788623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.788707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.788792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.788819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.788930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.789014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.789039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.789111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.789222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.789248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.789349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.789430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.789457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.789547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.789657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.789682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.789825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.789907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.789934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.790027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.790106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.790133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.790243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.790342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.790367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.790483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.790565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.790592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-10-30 16:14:08.790673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.790789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-10-30 16:14:08.790815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.790899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.790978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.791005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.791084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.791156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.791182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.791288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.791387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.791412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.791529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.791609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.791635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.791717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.791795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.791821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.791904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.792018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.792045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.792120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.792200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.792226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.792321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.792430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.792455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.792539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.792648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.792675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.792762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.792847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.792873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.792957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.793035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.793061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.793137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.793210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.793236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.793336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.793449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.793481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.793556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.793630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.793660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.793741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.793814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.793839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.793955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.794032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.794058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.794149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.794261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.794288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.794373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.794449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.794475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.794564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.794642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.794667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.794747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.794859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.794884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.794995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.795078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.795103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.795188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.795296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.795322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.795439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.795521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.795550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.795632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.795740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.795765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.795852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.795991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.796017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.796100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.796178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.796204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.796290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.796375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.796400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.796478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.796561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.796587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.796665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.796796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.796821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-10-30 16:14:08.796902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.797040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-10-30 16:14:08.797066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.797158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.797268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.797294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.797410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.797489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.797513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.797590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.797670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.797701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.797784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.797892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.797917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.798000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.798079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.798104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.798182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.798264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.798289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.798380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.798463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.798489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.798578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.798690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.798716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.798797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.798938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.798964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.799073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.799146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.799171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.799288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.799370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.799395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.799507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.799590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.799617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.799715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.799827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.799852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.799939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.800042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.800067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.800149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.800253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.800284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.800366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.800455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.800481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.800563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.800641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.800665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.800740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.800821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.800846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.800926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.800997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.801022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.801114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.801199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.801226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.801317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.801425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.801451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.801563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.801671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.801696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.801775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.801916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.801941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.802033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.802114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.802141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.802219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.802305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.802331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.802423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.802501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.802527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.802639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.802715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.802740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.802821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.802894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.802919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.803006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.803090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.803116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.803197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.803290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-10-30 16:14:08.803318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-10-30 16:14:08.803428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.803510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.803536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.803622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.803701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.803726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.803827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.803938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.803965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.804085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.804165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.804190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.804333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.804419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.804444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.804523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.804595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.804620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.804699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.804811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.804836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.804913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.805002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.805027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.805107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.805222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.805247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.805333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.805410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.805435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.805521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.805598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.805623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.805733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.805835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.805865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.805957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.806034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.806059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.806145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.806223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.806248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.806338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.806451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.806476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.806563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.806640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.806666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.806747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.806824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.806850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.806932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.807009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.807034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.807127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.807214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.807239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.807351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.807434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.807464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.807582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.807659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.807684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.807775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.807927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.807953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.808034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.808119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.808145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.808227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.808309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.808335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-10-30 16:14:08.808414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.808500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-10-30 16:14:08.808527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.808639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.808727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.808752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.808862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.808969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.808994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.809071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.809177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.809202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.809318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.809394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.809420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.809496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.809571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.809596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.809690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.809789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.809815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.809898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.810004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.810030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.810138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.810246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.810277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.810360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.810443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.810470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.810554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.810639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.810664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.810772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.810847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.810871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.810979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.811056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.811081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.811161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.811242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.811276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.811391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.811560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.811586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.811665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.811752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.811777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.811856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.811931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.811956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.812039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.812147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.812171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.812276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.812359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.812385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.812500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.812578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.812603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.812714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.812829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.812854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.812936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.813015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.813042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.813132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.813246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.813279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.813363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.813477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-10-30 16:14:08.813503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-10-30 16:14:08.813619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.813702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.813727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.813812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.813891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.813915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.814002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.814088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.814114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.814198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.814281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.814307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.814390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.814469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.814494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.814594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.814690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.814718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.814835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.814913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.814939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.815029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.815108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.815134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.815221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.815311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.815338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.815429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.815538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.815563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.815643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.815726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.815753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.815866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.815955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.815980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.816061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.816149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.816175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.816252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.816333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.816359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.816438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.816520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.816546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.816622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.816716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.816741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.816880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.816961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.816986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.817058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.817138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.817162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.817276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.817363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.817388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.817470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.817555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.817581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.817691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.817775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.817800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.817878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.817962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.817988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.818067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.818150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-10-30 16:14:08.818175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-10-30 16:14:08.818267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.818380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.818406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.818491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.818598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.818624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.818712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.818823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.818849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.818936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.819016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.819041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.819115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.819191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.819216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.819338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.819454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.819479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.819558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.819638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.819664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.819775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.819851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.819875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.819956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.820068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.820093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.820207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.820288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.820314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.820455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.820567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.820592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.820673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.820754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.820779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.820889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.821008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.821033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.821149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.821236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.821268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.821383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.821469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.821495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.821607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.821686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.821711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.821801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.821885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.821911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.821993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.822072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.822097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.822185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.822268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.822294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.822406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.822485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.822510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.822595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.822678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.822703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.822815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.822889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.822913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.822995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.823113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.823140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-10-30 16:14:08.823250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-10-30 16:14:08.823368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.823395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.823479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.823584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.823609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.823729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.823808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.823833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.823921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.824000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.824025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.824136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.824248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.824283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.824368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.824489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.824514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.824604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.824685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.824712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.824821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.824926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.824953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.825035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.825110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.825135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.825247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.825334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.825365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.825447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.825555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.825580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.825663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.825776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.825802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.825888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.826002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.826027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.826115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.826195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.826220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.826310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.826390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.826415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.826499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.826609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.826634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.826712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.826823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.826849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.826960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.827033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.827057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.827140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.827246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.827280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.827388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.827490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.827519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.827605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.827687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.827713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.827824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.827937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.827961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-10-30 16:14:08.828041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.828116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-10-30 16:14:08.828142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.828229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.828345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.828371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.828464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.828543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.828568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.828655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.828800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.828825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.828912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.828986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.829011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.829089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.829173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.829198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.829286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.829369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.829395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.829509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.829621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.829650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.829738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.829814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.829839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.829951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.830035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.830059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.830138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.830227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.830252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.830400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.830482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.830508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.830593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.830677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.830703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.830820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.830904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.830930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.831012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.831091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.831116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.831221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.831314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.831340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.831447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.831530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.831556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.831633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.831717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.831749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.831831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.831902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.831927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.832010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.832090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-10-30 16:14:08.832115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-10-30 16:14:08.832228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.832336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.832363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.832508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.832598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.832624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.832709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.832793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.832819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.832960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.833040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.833064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.833143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.833230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.833262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.833347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.833430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.833456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.833533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.833615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.833642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.833753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.833859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.833884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.833975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.834065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.834089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.834169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.834249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.834292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.834383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.834459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.834484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.834564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.834674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.834700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.834795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.834869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.834895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.834973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.835082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.835107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.835225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.835307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.835334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.835413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.835493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.835517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.835630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.835708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.835732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.835807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.835881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.835906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.836022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.836098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.836123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.836211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.836305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.836331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.836414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.836519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.836544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.836656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.836743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.836768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.836846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.836962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.836988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-10-30 16:14:08.837068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.837141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-10-30 16:14:08.837166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.837247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.837345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.837370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.837459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.837543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.837569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.837651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.837728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.837753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.837866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.837978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.838002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.838092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.838177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.838204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.838288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.838371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.838396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.838480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.838559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.838583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.838699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.838783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.838808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.838887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.839003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.839028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.839106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.839217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.839242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.839328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.839406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.839431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.839543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.839623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.839649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.839736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.839844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.839869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.839951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.840054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.840079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.840160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.840278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.840306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.840418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.840497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.840522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.840642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.840728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.840755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.840831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.840923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.840948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.841025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.841135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.841160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.841240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.841335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.841361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.841469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.841545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.841571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.841657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.841737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.841762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.841846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.841923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-10-30 16:14:08.841949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-10-30 16:14:08.842023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.842109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.842134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.842287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.842376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.842401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.842483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.842590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.842616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.842703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.842787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.842812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.842907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.842985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.843009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.843094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.843170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.843195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.843283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.843393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.843418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.843497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.843607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.843633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.843714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.843793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.843818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.843909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.844015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.844041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.844121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.844236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.844268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.844361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.844441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.844467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.844580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.844658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.844685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.844790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.844874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.844900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.844990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.845103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.845128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.845206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.845303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.845331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.845426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.845511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.845536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.845611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.845719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.845744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.845827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.845913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.845939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.846051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.846127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.846152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.846266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.846346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.846373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.846462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.846541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.846566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.846674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.846785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.846811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-10-30 16:14:08.846897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-10-30 16:14:08.846974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.846999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.847108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.847186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.847211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.847296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.847388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.847415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.847525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.847600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.847625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.847704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.847831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.847856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.848000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.848081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.848107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.848190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.848281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.848307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.848390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.848498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.848524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.848639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.848722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.848750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.848828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.848912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.848936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.849013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.849090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.849115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.849227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.849319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.849346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.849458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.849567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.849592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.849674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.849800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.849826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.849939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.850025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.850050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.850163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.850242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.850284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.850367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.850476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.850500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.850583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.850663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.850689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.850769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.850882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.850907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.850995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.851070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.851095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.851233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.851317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.851343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.851424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.851565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.851590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.851672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.851751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.851777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-10-30 16:14:08.851866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.852010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-10-30 16:14:08.852036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.852116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.852223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.852247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.852368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.852483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.852508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.852587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.852667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.852693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.852814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.852892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.852918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.853030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.853110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.853136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.853215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.853332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.853358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.853437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.853516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.853541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.853649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.853761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.853787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.853896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.853971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.853996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.854079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.854166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.854191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.854270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.854347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.854372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.854470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.854576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.854601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.854679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.854753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.854778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.854893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.855032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.855056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.855136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.855212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.855237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.855324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.855468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.855493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.855611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.855689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.855715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.855794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.855876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.855902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.855996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.856074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.856098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.856206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.856316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.856341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.856419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.856508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.856534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.856611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.856722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.856747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.856823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.856938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.856962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.857072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.857178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.857202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-10-30 16:14:08.857296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-10-30 16:14:08.857384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.857409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.857498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.857612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.857637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.857720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.857802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.857829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.857905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.857980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.858005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.858144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.858229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.858273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.858358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.858441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.858465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.858542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.858626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.858652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.858731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.858805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.858831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.858941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.859022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.859048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.859136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.859216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.859242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.859333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.859447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.859477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.859559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.859671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.859696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.859806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.859893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.859918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.859995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.860082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.860107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.860253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.860346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.860372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.860457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.860564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.860589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.860679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.860785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.860810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.860888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.860965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.860989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.861071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.861155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.861180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.861276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.861359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.861385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-10-30 16:14:08.861472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-10-30 16:14:08.861553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.861582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.861665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.861771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.861795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.861903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.862017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.862043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.862122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.862197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.862222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.862368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.862445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.862470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.862559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.862638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.862665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.862777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.862881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.862907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.862982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.863061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.863086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.863211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.863328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.863355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.863469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.863580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.863604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.863688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.863767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.863799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.863879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.864012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.864037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.864119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.864227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.864253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.864342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.864422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.864447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.864522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.864603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.864629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.864741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.864826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.864851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.864927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.865004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.865029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.865114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.865190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.865215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.865318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.865408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.865433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.865514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.865598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.865624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.865706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.865781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.865811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.865888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.865970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.865996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.866107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.866235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.866269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.866353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.866461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.866486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-10-30 16:14:08.866570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.866650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-10-30 16:14:08.866675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.866752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.866865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.866891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.866978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.867058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.867085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.867190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.867299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.867325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.867406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.867485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.867510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.867599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.867681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.867706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.867785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.867888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.867913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.868026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.868102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.868128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.868247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.868340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.868367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.868450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.868528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.868554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.868640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.868752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.868777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.868916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.868996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.869021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.869106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.869212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.869237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.869317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.869391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.869417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.869506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.869618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.869644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.869722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.869800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.869825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.869929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.870043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.870068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.870157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.870232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.870289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.870385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.870467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.870493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.870580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.870687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.870712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.870802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.870882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.870908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.871021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.871127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.871153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.871265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.871357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.871384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.871495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.871573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.871597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-10-30 16:14:08.871714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.871795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-10-30 16:14:08.871820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.871912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.872014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.872039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.872120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.872204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.872229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.872366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.872464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.872494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.872585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.872692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.872723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.872810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.872896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.872921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.873000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.873139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.873165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.873275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.873360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.873386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.873498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.873604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.873630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.873704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.873785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.873810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.873903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.874014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.874041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.874124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.874203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.874228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.874315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.874422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.874449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.874566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.874639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.874665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.874745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.874830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.874855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.874936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.875050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.875076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.875153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.875266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.875292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.875403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.875509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.875534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.875617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.875704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.875729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.875812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.875889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.875914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.876023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.876108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.876133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.876220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.876311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.876339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.876428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.876518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.876544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.876661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.876741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.876766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.876854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.876941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.876968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-10-30 16:14:08.877047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-10-30 16:14:08.877154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.877179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.877269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.877347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.877372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.877464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.877579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.877604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.877683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.877796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.877823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.877908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.877985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.878011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.878091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.878164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.878189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.878281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.878393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.878419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.878507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.878591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.878616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.878732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.878813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.878839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.878952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.879035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.879061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.879142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.879220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.879245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.879334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.879408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.879434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.879545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.879656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.879682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.879768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.879850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.879875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.879958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.880030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.880055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.880166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.880241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.880272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.880355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.880462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.880488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.880569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.880649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.880673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.880762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.880839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.880864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.880972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.881085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.881110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.881191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.881273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.881298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.881382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.881493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.881518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.881594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.881704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.881730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.881814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.881893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.881918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-10-30 16:14:08.882059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.882139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-10-30 16:14:08.882165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.882251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.882337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.882362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.882450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.882538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.882563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.882642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.882722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.882749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.882847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.882974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.883003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.883091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.883183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.883208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.883306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.883395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.883421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.883533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.883619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.883643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.883726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.883805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.883830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.883917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.884032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.884058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.884142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.884227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.884253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.884345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.884424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.884450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.884533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.884612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.884638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.884718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.884835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.884860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.884938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.885025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.885050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.885133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.885210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.885236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.885329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.885410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.885435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.885543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.885650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.885675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.885758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.885865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.885890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.885966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.886075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.886101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.886179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.886291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-10-30 16:14:08.886317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-10-30 16:14:08.886425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.886506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.886532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.886606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.886715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.886740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.886821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.886906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.886932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.887043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.887157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.887182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.887266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.887380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.887404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.887492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.887606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.887631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.887719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.887827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.887852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.887932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.888011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.888036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.888115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.888221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.888246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.888339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.888417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.888442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.888551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.888629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.888654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.888731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.888838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.888864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.888952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.889063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.889088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.889172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.889287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.889313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.889398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.889483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.889508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.889616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.889732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.889758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.889837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.889919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.889945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.890038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.890114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.890139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.890247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.890335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.890360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.890445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.890527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.890554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.890631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.890711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.890737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.890813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.890930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.890955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.891035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.891146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-10-30 16:14:08.891170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-10-30 16:14:08.891282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.891367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.891392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.891488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.891565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.891591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.891675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.891788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.891815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.891928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.892043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.892068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.892150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.892226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.892251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.892341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.892452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.892477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.892556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.892668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.892693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.892767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.892844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.892869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.892978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.893063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.893087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.893165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.893277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.893302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.893388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.893467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.893497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.893581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.893664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.893689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.893772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.893898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.893923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.894007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.894090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.894115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.894190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.894271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.894296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.894376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.894454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.894479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.894555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.894691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.894716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.894831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.894905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.894929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.895010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.895088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.895113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.895200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.895286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.895312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.895428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.895510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.895541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.895653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.895737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.895764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.895883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.895967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.895993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.896080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.896158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.896183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-10-30 16:14:08.896301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.896381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-10-30 16:14:08.896406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.896514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.896586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.896611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.896694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.896801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.896826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.896908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.897045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.897070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.897149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.897228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.897254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.897340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.897428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.897453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.897529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.897648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.897678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.897761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.897842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.897867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.897957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.898041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.898068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.898178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.898292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.898318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.898400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.898478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.898503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.898611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.898694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.898721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.898799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.898881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.898906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.898984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.899063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.899090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.899169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.899243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.899276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.899355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.899458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.899483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.899564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.899643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.899669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.899773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.899859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.899884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.899960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.900066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.900091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.900232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.900314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.900340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.900432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.900512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.900538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.900619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.900728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.900754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.900835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.900945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.900970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.901082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.901165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.901191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-10-30 16:14:08.901305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-10-30 16:14:08.901388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.901413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.901493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.901581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.901606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.901696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.901806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.901831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.901911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.901996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.902021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.902104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.902210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.902236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.902329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.902402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.902427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.902524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.902606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.902632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.902758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.902858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.902883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.902971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.903108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.903133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.903216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.903323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.903350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.903431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.903516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.903542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.903627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.903703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.903728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.903867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.903978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.904003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.904094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.904170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.904195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.904308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.904385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.904410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.904489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.904562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.904587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.904703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.904783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.904807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.904885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.904995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.905020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.905162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.905242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.905275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.905405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.905483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.905509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.905583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.905672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.905697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.905772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.905880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.905907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.906022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.906102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.906129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-10-30 16:14:08.906213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.906296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-10-30 16:14:08.906322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.906402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.906485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.906510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.906591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.906695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.906720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.906819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.906903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.906928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.907006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.907090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.907117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.907199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.907282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.907308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.907386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.907468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.907494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.907583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.907696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.907721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.907796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.907872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.907897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.907984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.908063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.908088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.908183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.908295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.908321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.908410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.908493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.908518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.908630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.908710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.908735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.908849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.908928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.908953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.909048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.909130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.909156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.909262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.909375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.909401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.909514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.909675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.909704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.909790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.909902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.909928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.910024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.910109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.910134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.910216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.910302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.910328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.910411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.910505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.910530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.910619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.910694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.910719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.910799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.910904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.910929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-10-30 16:14:08.911010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-10-30 16:14:08.911084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.911109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.911186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.911264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.911290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.911380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.911453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.911478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.911587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.911662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.911687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.911771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.911877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.911901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.911987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.912092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.912117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.912196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.912275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.912301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.912385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.912470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.912494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.912609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.912690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.912715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.912797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.912878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.912904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.912977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.913056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.913082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.913158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.913271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.913297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.913388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.913468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.913493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.913571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.913649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.913674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.913787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.913896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.913921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.914033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.914141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.914166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.914248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.914339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.914364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.914442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.914532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.914557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.914635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.914723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.914748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.914825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.914902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.914927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-10-30 16:14:08.915005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.915114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-10-30 16:14:08.915139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.915224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.915310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.915335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.915414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.915492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.915517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.915599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.915706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.915730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.915842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.915949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.915974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.916057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.916135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.916162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.916244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.916329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.916354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.916430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.916516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.916546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.916629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.916712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.916737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.916813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.916897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.916923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.917026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.917096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.917121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.917200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.917280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.917306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.917424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.917499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.917524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.917613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.917717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.917741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.917820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.917894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.917919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.918002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.918078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.918103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.918178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.918264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.918290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.918365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.918444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.918468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.918555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.918627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.918652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.918731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.918809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.918834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.918912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.918986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.919011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.919121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.919203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.919228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.919322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.919411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.919435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.919514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.919591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.919617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.919692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.919795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.919820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-10-30 16:14:08.919897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-10-30 16:14:08.919968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.919993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.920081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.920189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.920214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.920301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.920377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.920402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.920521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.920594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.920619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.920705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.920809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.920834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.920909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.921014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.921038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.921157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.921242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.921274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.921386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.921493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.921518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.921602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.921674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.921698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.921782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.921860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.921885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.921968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.922105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.922130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.922209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.922297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.922323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.922405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.922511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.922536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.922653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.922733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.922758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.922867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.922949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.922974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.923115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.923193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.923217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.923333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.923404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.923429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.923537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.923620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.923647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.923744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.923823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.923849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.923926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.924015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.924040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.924130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.924214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.924238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.924320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.924423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.924448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.924534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.924614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.924638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.924750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.924844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.924869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-10-30 16:14:08.924946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-10-30 16:14:08.925028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.925052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.925133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.925221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.925246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.925350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.925436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.925462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.925544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.925617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.925642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.925752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.925830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.925855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.925941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.926022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.926047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.926158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.926280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.926306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.926382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.926468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.926493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.926573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.926653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.926678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.926785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.926866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.926895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.926986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.927066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.927092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.927203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.927300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.927326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.927403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.927484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.927509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.927620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.927705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.927730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.927839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.927916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.927940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.928046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.928127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.928152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.928266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.928350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.928375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.928460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.928534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.928558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.928639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.928748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.928772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.928854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.928928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.928953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.929047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.929118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.929144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.929233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.929348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.929373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.929450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.929533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.929558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.929635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.929708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.929733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.929819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.929895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.929919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.930010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.930088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-10-30 16:14:08.930113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-10-30 16:14:08.930230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.930309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.930334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.930416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.930522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.930546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.930625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.930702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.930727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.930814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.930930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.930956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.931039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.931110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.931135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.931209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.931292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.931318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.931442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.931594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.931618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.931693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.931767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.931792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.931871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.931960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.931984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.932093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.932197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.932221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.932343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.932453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.932478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.932559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.932673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.932698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.932777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.932857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.932882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.932961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.933035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.933059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.933147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.933236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.933266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.933347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.933432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.933457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.933541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.933649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.933674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.933756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.933834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.933859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.933934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.934016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.934041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.934132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.934211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.934237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.934382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.934455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.934480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.934564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.934651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.934675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.934759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.934841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.934865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.934945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.935051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.935076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.935184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.935298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.935325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.935414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.935498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.935523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-10-30 16:14:08.935602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-10-30 16:14:08.935678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.935703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.935794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.935873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.935898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.935973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.936051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.936076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.936160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.936268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.936293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.936376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.936451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.936476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.936567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.936643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.936667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.936773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.936885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.936910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.937020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.937096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.937121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.937195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.937282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.937312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.937393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.937475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.937499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.937578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.937655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.937679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.937763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.937854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.937879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.937968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.938043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.938068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.938146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.938266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.938291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.938377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.938490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.938515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.938623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.938699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.938724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.938803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.938914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.938939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.939023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.939098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.939123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.939239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.939328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.939354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.939451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.939534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.939559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.939669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.939749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.939775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.939863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.939970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-10-30 16:14:08.939995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-10-30 16:14:08.940082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.940189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.940213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.940305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.940436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.940462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.940545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.940624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.940649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.940735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.940814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.940839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.940919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.940997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.941022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.941102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.941186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.941211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.941297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.941381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.941406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.941494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.941638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.941663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.941774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.941852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.941876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.941962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.942038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.942063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.942137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.942212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.942237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.942376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.942449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.942474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.942584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.942663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.942688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.942761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.942846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.942871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.942991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.943074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.943099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.943179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.943267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.943293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.943371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.943479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.943505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.943615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.943691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.943716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.943790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.943893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.943918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.944003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.944114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.944139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.944215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.944309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.944335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.944443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.944517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.944542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.944621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.944730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.944754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.944839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.944916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.944941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.945014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.945099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.945124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.945236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.945320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.945346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-10-30 16:14:08.945455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-10-30 16:14:08.945539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.945564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.945640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.945717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.945742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.945825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.945927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.945952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.946060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.946139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.946163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.946271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.946378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.946403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.946485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.946558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.946582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.946657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.946734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.946758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.946841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.946921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.946947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.947035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.947147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.947172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.947249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.947333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.947358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.947444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.947523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.947549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.947622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.947727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.947756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.947845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.947933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.947957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.948044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.948150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.948175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.948261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.948344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.948370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.948447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.948559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.948584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.948671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.948749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.948774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.948852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.948963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.948987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.949060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.949171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.949196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.949272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.949363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.949388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.949499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.949578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.949604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.949677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.949786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.949815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.949926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.950016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.950041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.950125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.950219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.950244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.950356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.950431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.950457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-10-30 16:14:08.950573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.950682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-10-30 16:14:08.950707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.950782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.950886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.950910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.950984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.951065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.951089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.951198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.951279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.951305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.951401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.951512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.951537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.951615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.951693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.951717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.951793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.951872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.951897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.951984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.952071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.952096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.952175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.952314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.952340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.952453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.952541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.952566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.952646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.952724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.952749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.952834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.952910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.952935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.953012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.953093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.953119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.953211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.953289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.953314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.953394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.953475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.953501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.953592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.953673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.953698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.953780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.953857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.953881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.954025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.954109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.954134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.954218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.954356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.954382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.954462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.954541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.954566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.954671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.954749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.954773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.954859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.954964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.954989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.955074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.955150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.955175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.955267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.955342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.955368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.955441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.955516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.955541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.955627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.955707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.955732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-10-30 16:14:08.955810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-10-30 16:14:08.955917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.955942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.956019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.956158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.956182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.956270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.956353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.956377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.956455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.956570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.956595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.956671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.956785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.956810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.956891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.956972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.956998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.957087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.957192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.957217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.957319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.957396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.957421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.957502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.957615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.957640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.957779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.957858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.957883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.957964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.958046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.958070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.958205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.958316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.958342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.958425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.958498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.958523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.958600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.958682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.958707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.958816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.958890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.958915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.958993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.959064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.959089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.959228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.959316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.959342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.959419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.959492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.959517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.959600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.959686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.959711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.959820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.959900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.959925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.959999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.960133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.960158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.960267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.960344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.960374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.960462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.960543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.960569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.960681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.960757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.960782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.960861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.960936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.960961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.961035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.961126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.961151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.961229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.961347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.961373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.961456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.961561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.961586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.222 [2024-10-30 16:14:08.961660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.961736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.222 [2024-10-30 16:14:08.961761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.222 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.961837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.961907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.961932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.962040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.962117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.962141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.962248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.962395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.962421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.962507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.962614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.962639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.962728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.962807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.962832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.962912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.962986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.963011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.963114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.963195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.963221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.963306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.963416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.963440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.963518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.963599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.963623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.963708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.963793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.963817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.963897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.963980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.964005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.964083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.964189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.964214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.964305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.964415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.964440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.964523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.964602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.964627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.964703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.964789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.964814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.964892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.964998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.965023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.965109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.965185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.965210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.965287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.965367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.965392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.965475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.965544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.965569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.965659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.965738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.965763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.965848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.965929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.965953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.966035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.966114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.966140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.223 [2024-10-30 16:14:08.966246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.966329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.223 [2024-10-30 16:14:08.966354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.223 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.966446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.966560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.966584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.966663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.966747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.966772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.966847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.966933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.966958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.967037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.967118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.967143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.967248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.967331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.967356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.967441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.967519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.967544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.967631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.967714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.967739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.967812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.967883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.967907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.968014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.968089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.968114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.968198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.968272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.968297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.968384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.968473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.968498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.968612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.968691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.968716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.968801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.968915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.968939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.969019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.969124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.969149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.969231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.969313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.969339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.969418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.969497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.969523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.969610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.969687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.969712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.969855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.969960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.969984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.970070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.970149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.970174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.224 qpair failed and we were unable to recover it. 00:30:19.224 [2024-10-30 16:14:08.970249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.970330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.224 [2024-10-30 16:14:08.970355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.970469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.970546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.970578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.970659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.970743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.970768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.970872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.970957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.970982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.971092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.971167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.971191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.971277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.971353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.971378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.971463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.971546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.971571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.971655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.971736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.971761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.971866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.971943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.971968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.972081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.972185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.972210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.972312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.972403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.972428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.972533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.972616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.972641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.972727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.972807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.972831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.972910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.972988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.973013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.973102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.973183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.973208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.973284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.973369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.973394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.973481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.973556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.973581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.973661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.973742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.973768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.973849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.973958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.973983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.974065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.974177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.974202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.974285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.974360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.974385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.974494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.974579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.974603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.974745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.974855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.974891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.974974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.975085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.975109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.975189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.975268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.975295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.975379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.975488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.975514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.975591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.975669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.975694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.975774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.975911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.975937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.976021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.976125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.976150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.976262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.976342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.976368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.976471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.976550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.225 [2024-10-30 16:14:08.976576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.225 qpair failed and we were unable to recover it. 00:30:19.225 [2024-10-30 16:14:08.976652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.976757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.976782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.976894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.976997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.977022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.977097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.977202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.977237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.977337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.977412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.977437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.977523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.977601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.977626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.977707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.977798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.977823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.977899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.977983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.978009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.978125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.978201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.978236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.978356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.978494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.978518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.978601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.978679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.978705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.978786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.978874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.978899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.978981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.979066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.979092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.979169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.979274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.979300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.979392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.979496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.979521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.979627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.979699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.979724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.979803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.979908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.979933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.980042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.980148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.980173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.980249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.980333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.980358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.980438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.980509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.980535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.980646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.980730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.980755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.980843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.980925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.980950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.981061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.981168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.981197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.981276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.981351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.981376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.981459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.981566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.981590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.981672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.981753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.981777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.981887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.981959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.981984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.982060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.982129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.982153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.982232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.982313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.982338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.982416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.982563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.982588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.982667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.982747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.982772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.226 qpair failed and we were unable to recover it. 00:30:19.226 [2024-10-30 16:14:08.982849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.226 [2024-10-30 16:14:08.982952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.982977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.983091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.983166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.983197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.983283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.983358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.983383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.983463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.983540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.983565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.983651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.983729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.983755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.983832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.983909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.983934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.984020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.984101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.984125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.984237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.984320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.984346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.984462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.984570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.984596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.984706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.984782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.984807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.984885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.984956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.984981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.985056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.985134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.985160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.985251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.985334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.985359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.985447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.985532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.985557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.985634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.985708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.985732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.985826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.985935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.985959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.986033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.986111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.986135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.986219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.986360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.986386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.986470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.986546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.986570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.986685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.986765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.986789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.986874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.986979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.987008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.987112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.987185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.987210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.987299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.987379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.987404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.987490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.987626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.987651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.987732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.987817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.987843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.987927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.988010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.988035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.988145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.988219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.988244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.988329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.988418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.988443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.988532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.988638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.988663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.988744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.988855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.988881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.227 [2024-10-30 16:14:08.988967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.989045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.227 [2024-10-30 16:14:08.989070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.227 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.989152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.989230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.989263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.989347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.989431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.989458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.989547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.989652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.989677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.989758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.989866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.989890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.989967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.990072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.990097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.990176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.990291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.990318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.990458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.990540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.990565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.990655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.990737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.990762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.990839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.990943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.990967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.991048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.991126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.991150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.991227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.991339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.991364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.991453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.991565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.991591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.991700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.991790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.991815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.991890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.991965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.991990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.992099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.992215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.992240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.992355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.992437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.992463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.992543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.992652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.992677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.992754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.992828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.992853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.992937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.993040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.993064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.993150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.993224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.993249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.993342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.993425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.993450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.993532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.993652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.993682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.993761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.993875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.993900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.993981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.994069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.994094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.994175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.994254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.994286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.228 [2024-10-30 16:14:08.994397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.994479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.228 [2024-10-30 16:14:08.994504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.228 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.994587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.994663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.994689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.994763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.994840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.994864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.994939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.995045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.995070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.995152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.995229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.995254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.995340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.995446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.995472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.995562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.995700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.995725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.995837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.995928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.995953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.996041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.996148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.996174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.996299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.996377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.996402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.996511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.996599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.996625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.996705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.996812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.996836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.996920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.997024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.997049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.997123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.997234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.997263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.997380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.997459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.997484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.997576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.997680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.997705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.997795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.997868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.997893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.997975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.998051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.998076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.998157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.998239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.998288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.998394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.998485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.998510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.998594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.998673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.998698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.998812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.998887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.998912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.998995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.999072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.999098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.999247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.999341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.999366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.999442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.999520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.999545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.999630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.999714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.999739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:08.999819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.999895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:08.999920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:09.000001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:09.000086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:09.000111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:09.000219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:09.000302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:09.000328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:09.000436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:09.000547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:09.000573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:09.000654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:09.000730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:09.000755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.229 qpair failed and we were unable to recover it. 00:30:19.229 [2024-10-30 16:14:09.000827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.229 [2024-10-30 16:14:09.000929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.000954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.001037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.001119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.001144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.001228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.001312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.001338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.001414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.001498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.001523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.001618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.001726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.001751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.001865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.001940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.001965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.002039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.002131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.002156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.002234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.002351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.002378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.002491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.002576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.002601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.002688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.002776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.002800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.002891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.002996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.003020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.003095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.003177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.003202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.003294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.003374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.003400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.003483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.003568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.003593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.003683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.003758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.003783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.003856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.003940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.003966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.004041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.004144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.004174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.004261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.004347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.004373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.004451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.004525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.004550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.004634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.004744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.004769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.004853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.004932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.004957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.005034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.005116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.005141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.005221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.005348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.005373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.005451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.005523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.005548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.005631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.005718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.005742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.005826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.005933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.005957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.006034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.006108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.006134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.006222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.006349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.006376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.006463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.006540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.006565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.006645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.006722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.006747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.006859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.006941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.230 [2024-10-30 16:14:09.006967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.230 qpair failed and we were unable to recover it. 00:30:19.230 [2024-10-30 16:14:09.007078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.007163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.007188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.007270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.007344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.007369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.007455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.007531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.007557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.007647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.007749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.007774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.007854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.007933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.007959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.008044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.008125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.008150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.008241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.008332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.008357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.008445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.008520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.008545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.008619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.008731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.008756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.008840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.008945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.008970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.009079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.009154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.009183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.009267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.009359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.009384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.009496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.009582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.009608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.009714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.009793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.009818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.009897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.009985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.010010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.010086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.010170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.010194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.010291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.010373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.010398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.010486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.010561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.010585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.010667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.010773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.010797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.010877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.010947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.010972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.011057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.011132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.011157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.011235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.011323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.011349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.011422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.011524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.011549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.011626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.011703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.011727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.011801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.011915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.011940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.012012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.012093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.012117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.012236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.012333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.012359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.012440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.012523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.012549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.012661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.012801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.012826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.012902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.012984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.013009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.231 qpair failed and we were unable to recover it. 00:30:19.231 [2024-10-30 16:14:09.013123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.231 [2024-10-30 16:14:09.013196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.013221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.013303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.013386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.013411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.013526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.013609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.013634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.013710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.013785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.013810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.013925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.014009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.014035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.014117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.014230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.014288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.014368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.014473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.014502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.014581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.014675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.014700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.014790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.014872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.014898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.014977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.015080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.015104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.015193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.015272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.015298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.015380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.015459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.015483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.015589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.015675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.015702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.015778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.015883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.015909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.015998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.016108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.016133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.016213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.016292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.016317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.016397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.016476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.016501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.016618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.016706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.016731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.016838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.016921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.016946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.017033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.017142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.017166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.017245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.017363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.017388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.017469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.017548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.017573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.017654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.017724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.017749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.017837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.017908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.017933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.018011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.018147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.018171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.018261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.018374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.018400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.018475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.018548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.018572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.232 qpair failed and we were unable to recover it. 00:30:19.232 [2024-10-30 16:14:09.018658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.232 [2024-10-30 16:14:09.018769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.018794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.018870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.018977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.019002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.019085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.019159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.019184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.019275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.019359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.019385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.019464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.019539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.019564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.019648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.019754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.019778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.019892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.019998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.020022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.020099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.020204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.020229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.020309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.020389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.020413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.020487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.020603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.020628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.020754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.020851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.020879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.020975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.021056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.021081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.021168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.021293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.021321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.021403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.021480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.021505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.021617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.021695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.021720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.021839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.021947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.021972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.022052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.022138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.022163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.022241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.022323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.022348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.022435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.022543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.022570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.022657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.022738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.022763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.022851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.022931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.022957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.023066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.023159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.023184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.023273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.023383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.023408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.023492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.023569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.023594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.023677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.023754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.023780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.023860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.023980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.024006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.024117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.024196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.024221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.024325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.024406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.024433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.024516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.024591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.024617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.024693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.024776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.024803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.233 [2024-10-30 16:14:09.024899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.024982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.233 [2024-10-30 16:14:09.025009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.233 qpair failed and we were unable to recover it. 00:30:19.234 [2024-10-30 16:14:09.025094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.025183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.025208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.234 qpair failed and we were unable to recover it. 00:30:19.234 [2024-10-30 16:14:09.025309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.025423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.025449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.234 qpair failed and we were unable to recover it. 00:30:19.234 [2024-10-30 16:14:09.025542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.025652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.025677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.234 qpair failed and we were unable to recover it. 00:30:19.234 [2024-10-30 16:14:09.025756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.025866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.025892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.234 qpair failed and we were unable to recover it. 00:30:19.234 [2024-10-30 16:14:09.026003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.026089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.026114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.234 qpair failed and we were unable to recover it. 00:30:19.234 [2024-10-30 16:14:09.026191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.026306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.026332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.234 qpair failed and we were unable to recover it. 00:30:19.234 [2024-10-30 16:14:09.026415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.026528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.026555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.234 qpair failed and we were unable to recover it. 00:30:19.234 [2024-10-30 16:14:09.026643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.026724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.026754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.234 qpair failed and we were unable to recover it. 00:30:19.234 [2024-10-30 16:14:09.026831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.026910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.026936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.234 qpair failed and we were unable to recover it. 00:30:19.234 [2024-10-30 16:14:09.027016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.234 [2024-10-30 16:14:09.027095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-10-30 16:14:09.027120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-10-30 16:14:09.027208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-10-30 16:14:09.027288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-10-30 16:14:09.027315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-10-30 16:14:09.027391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-10-30 16:14:09.027473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-10-30 16:14:09.027498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-10-30 16:14:09.027636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-10-30 16:14:09.027715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-10-30 16:14:09.027740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-10-30 16:14:09.027822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-10-30 16:14:09.027897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-10-30 16:14:09.027922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-10-30 16:14:09.028013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-10-30 16:14:09.028095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-10-30 16:14:09.028124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-10-30 16:14:09.028267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-10-30 16:14:09.028352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-10-30 16:14:09.028379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-10-30 16:14:09.028461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-10-30 16:14:09.028545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.028573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.028656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.028745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.028771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.028849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.028932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.028958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.029034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.029123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.029150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.029230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.029331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.029359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.029445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.029536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.029562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.029681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.029792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.029818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.029899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.029982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.030009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.030092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.030177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.030204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.030293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.030405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.030430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.030515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.030590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.030615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.030697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.030773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.030798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.030883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.030992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.031018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.031115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.031199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.031225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.031318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.031436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.031463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.031544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.031624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.031651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.031726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.031806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.031836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.031948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.032033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.032059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.032141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.032217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.032244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.032339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.032422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.032453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.032571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.032650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.032676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.032758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.032832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.032857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.032935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.033017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.033044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.033124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.033234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.033270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.033355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.033434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.033459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.033542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.033622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.033648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.033755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.033844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.033871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.033948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.034064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.034090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.034170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.034247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.034280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.034366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.034484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.034510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-10-30 16:14:09.034603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.034720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-10-30 16:14:09.034746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.034827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.034902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.034926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.035005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.035079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.035104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.035213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.035336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.035367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.035449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.035528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.035554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.035641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.035731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.035757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.035850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.035963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.035989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.036067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.036138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.036163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.036239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.036320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.036345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.036456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.036573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.036598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.036686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.036765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.036791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.036870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.036941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.036966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.037053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.037139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.037165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.037244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.037324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.037349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.037427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.037534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.037559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.037649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.037723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.037748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.037827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.037899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.037924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.038012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.038122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.038147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.038229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.038309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.038335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.038417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.038494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.038519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.038630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.038740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.038765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.038889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.038963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.038987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.039068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.039178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.039202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.039318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.039395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.039421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.039506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.039612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.039636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.039714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.039800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.039825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.039906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.039992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.040017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.040128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.040234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.040264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.040344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.040424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.040448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.040531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.040602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.040627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.040712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.040825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.040850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-10-30 16:14:09.040931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-10-30 16:14:09.041041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.041066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.041155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.041244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.041274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.041355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.041430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.041454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.041557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.041636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.041660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.041751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.041861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.041886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.041961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.042046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.042071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.042145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.042238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.042268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.042348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.042425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.042450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.042560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.042638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.042664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.042743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.042849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.042875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.042984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.043061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.043085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.043201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.043276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.043302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.043411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.043489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.043514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.043592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.043701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.043726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.043803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.043916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.043940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.044016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.044087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.044112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.044200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.044278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.044304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.044384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.044464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.044489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.044572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.044651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.044675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.044752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.044835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.044859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.044934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.045015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.045040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.045116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.045191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.045216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.045305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.045381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.045406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.045512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.045590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.045619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.045699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.045774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.045799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.045876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.045957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.045983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.046063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.046145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.046170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.046249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.046370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.046395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.046485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.046560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.046584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.046691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.046768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.046794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-10-30 16:14:09.046875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.046953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-10-30 16:14:09.046978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.047055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.047133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.047158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.047271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.047356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.047381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.047465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.047591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.047622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.047711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.047788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.047813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.047903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.047993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.048018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.048099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.048203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.048229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.048317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.048401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.048427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.048511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.048590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.048615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.048694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.048802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.048827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.048908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.048990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.049015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.049096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.049169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.049193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.049299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.049374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.049398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.049482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.049556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.049580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.049664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.049742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.049768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.049846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.049951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.049976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.050053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.050127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.050152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.050266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.050343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.050367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.050447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.050524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.050549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.050624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.050699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.050724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.050801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.050879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.050903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.051013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.051100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.051124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.051200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.051272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.051298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.051380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.051463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.051489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.051577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.051687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.051712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.051792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.051867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.051892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.051979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.052062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.052087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.052164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.052237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.052267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.052355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.052458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.052482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.052560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.052632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.052656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-10-30 16:14:09.052740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.052822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-10-30 16:14:09.052847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.052933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.053044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.053070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.053184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.053264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.053299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.053377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.053454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.053479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.053587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.053679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.053705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.053793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.053908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.053932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.054016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.054091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.054115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.054195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.054301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.054327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.054403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.054486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.054510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.054595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.054680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.054705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.054786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.054890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.054914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.054989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.055069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.055094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.055172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.055269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.055295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.055380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.055483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.055507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.055591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.055681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.055706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.055786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.055865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.055890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.056006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.056088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.056113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.056231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.056320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.056345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.056430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.056505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.056530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.056640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.056715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.056740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.056816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.056907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.056934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.057014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.057102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.057127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.057208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.057291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.057317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.057395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.057471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.057495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.057574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.057651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.057681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.057790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.057870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.057894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.057969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.058053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.058078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-10-30 16:14:09.058191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-10-30 16:14:09.058266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.058291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.058377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.058452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.058477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.058554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.058630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.058655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.058732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.058810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.058834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.058907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.059020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.059045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.059121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.059225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.059250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.059334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.059410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.059435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.059573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.059659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.059683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.059765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.059837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.059861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.059939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.060010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.060034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.060140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.060246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.060276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.060365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.060441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.060466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.060550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.060626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.060651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.060730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.060806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.060830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.060907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.060991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.061016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.061089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.061165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.061190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.061283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.061366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.061391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.061469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.061543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.061567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.061645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.061756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.061782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.061865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.061939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.061964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.062045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.062149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.062173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.062279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.062363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.062389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.062467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.062539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.062564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.062637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.062718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.062743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.062819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.062905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.062930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.063022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.063094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.063119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.063201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.063281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.063308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.063381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.063488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.063513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.063604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.063706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.063731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.063838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.063919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.063945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-10-30 16:14:09.064022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.064128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-10-30 16:14:09.064152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.064230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.064312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.064338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.064419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.064494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.064519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.064634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.064724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.064749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.064859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.064932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.064957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.065036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.065140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.065165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.065263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.065340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.065365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.065450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.065529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.065555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.065664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.065775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.065800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.065874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.065954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.065979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.066091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.066187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.066212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.066325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.066410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.066435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.066550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.066627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.066652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.066737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.066842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.066867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.066975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.067061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.067085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.067164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.067240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.067272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.067356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.067438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.067463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.067549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.067620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.067645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.067750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.067835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.067864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.067953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.068031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.068056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.068143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.068243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.068296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.068378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.068459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.068483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.068565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.068677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.068702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.068807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.068917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.068941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.069016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.069090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.069114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.069189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.069303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.069330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.069444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.069521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.069546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.069635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.069749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.069774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.069852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.069929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.069954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.070036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.070107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.070132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.070209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.070285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.070311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-10-30 16:14:09.070387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-10-30 16:14:09.070469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.070494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.070578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.070662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.070687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.070767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.070874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.070899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.070991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.071073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.071098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.071180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.071286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.071311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.071393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.071476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.071501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.071581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.071697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.071722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.071798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.071870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.071895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.071974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.072054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.072078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.072156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.072230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.072260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.072375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.072447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.072472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.072554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.072635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.072660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.072747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.072835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.072861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.072942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.073016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.073041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.073120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.073223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.073248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.073344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.073418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.073443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.073533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.073646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.073671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.073754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.073844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.073868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.073953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.074039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.074064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.074139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.074214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.074239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.074347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.074453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.074478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.074555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.074681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.074705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.074792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.074868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.074893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.075002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.075110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.075135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.075249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.075338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.075363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.075437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.075527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.075552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.075626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.075703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.075728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.075805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.075914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.075939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.076022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.076096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.076121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.076204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.076309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.076335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.076418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.076501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-10-30 16:14:09.076526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-10-30 16:14:09.076613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.076684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.076709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.076789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.076864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.076889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.076968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.077076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.077101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.077182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.077275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.077311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.077387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.077504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.077530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.077612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.077690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.077715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.077788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.077892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.077918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.077997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.078081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.078112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.078200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.078279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.078305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.078388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.078498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.078522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.078599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.078672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.078697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.078806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.078923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.078947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.079053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.079163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.079187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.079285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.079366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.079391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.079473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.079580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.079605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.079681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.079770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.079795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.079877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.079983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.080008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.080097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.080200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.080229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.080316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.080402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.080427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.080507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.080577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.080602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.080690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.080764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.080789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.080867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.080937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.080961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.081070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.081147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.081172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.081249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.081336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.081361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.081454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.081529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.081553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.081666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.081738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.081763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-10-30 16:14:09.081838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.081914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-10-30 16:14:09.081939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.082019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.082130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.082155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.082241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.082329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.082356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.082440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.082518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.082542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.082623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.082702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.082727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.082832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.082909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.082934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.083042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.083130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.083155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.083283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.083358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.083383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.083495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.083580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.083605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.083711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.083786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.083812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.083889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.084001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.084026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.084103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.084184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.084209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.084298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.084378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.084403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.084481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.084589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.084614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.084694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.084768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.084793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.084870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.085007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.085032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.085108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.085189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.085214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.085447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.085554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.085580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.085657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.085767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.085793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.085871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.085947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.085972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.086045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.086133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.086158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.086274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.086362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.086387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.086464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.086543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.086569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.086653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.086737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.086762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.086845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.086925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.086950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.087041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.087121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.087146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.087228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.087344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.087370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.087445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.087519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.087544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.087624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.087705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.087730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.087809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.087899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.087924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.088004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.088086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.088112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-10-30 16:14:09.088190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-10-30 16:14:09.088281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.088308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.088382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.088472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.088497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.088576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.088648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.088672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.088754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.088872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.088897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.088992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.089099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.089124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.089211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.089285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.089311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.089389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.089472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.089497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.089578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.089684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.089709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.089783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.089862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.089887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.089991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.090130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.090155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.090237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.090321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.090347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.090456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.090581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.090610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.090688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.090763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.090787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.090893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.090969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.090994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.091102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.091210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.091235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.091324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.091400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.091425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.091513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.091618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.091643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.091725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.091831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.091856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.091962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.092048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.092074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.092164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.092275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.092300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.092381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.092456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.092480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.092559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.092645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.092670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.092760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.092836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.092861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.092968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.093073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.093098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.093185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.093295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.093320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.093429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.093511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.093536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.093619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.093706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.093731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.093805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.093879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.093904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.093983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.094056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.094081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.094190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.094299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.094324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.094402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.094486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-10-30 16:14:09.094511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-10-30 16:14:09.094598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.094683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.094708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.094791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.094868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.094893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.094967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.095055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.095080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.095165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.095283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.095308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.095386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.095470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.095495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.095570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.095658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.095682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.095761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.095837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.095861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.095965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.096038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.096063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.096144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.096266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.096292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.096369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.096444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.096469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.096584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.096658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.096683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.096763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.096838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.096863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.096940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.097015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.097040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.097154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.097263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.097289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.097405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.097487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.097512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.097617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.097693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.097718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.097793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.097902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.097928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.098010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.098098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.098123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.098211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.098285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.098311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.098397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.098479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.098504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.098621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.098731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.098756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.098833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.098942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.098967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.099045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.099121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.099146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.099268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.099406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.099431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.099518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.099642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.099667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.099756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.099839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.099864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.099942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.100018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.100044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.100127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.100203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.100228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.100320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.100431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.100456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.100537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.100617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.100642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-10-30 16:14:09.100751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.100836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-10-30 16:14:09.100861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.100964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.101046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.101076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.101154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.101234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.101268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.101349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.101456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.101480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.101586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.101676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.101701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.101810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.101893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.101917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.102036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.102112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.102137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.102210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.102295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.102321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.102427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.102548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.102573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.102685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.102757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.102782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.102860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.102983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.103007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.103091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.103171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.103197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.103288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.103364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.103389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.103471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.103584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.103608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.103694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.103770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.103800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.103931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.104040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.104066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.104147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.104250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.104281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.104362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.104437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.104462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.104542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.104620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.104645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.104722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.104859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.104884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.104970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.105044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.105069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.105149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.105259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.105284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.105375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.105450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.105475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.105559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.105641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.105668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.105749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.105826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.105852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.105962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.106041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.106068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.106209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.106331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.106357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.106432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.106507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-10-30 16:14:09.106532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-10-30 16:14:09.106603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.106679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.106704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.106818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.106893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.106918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.107003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.107085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.107110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.107191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.107267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.107292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.107382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.107468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.107494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.107570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.107677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.107702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.107776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.107855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.107880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.107991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.108063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.108088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.108193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.108302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.108328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.108403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.108510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.108535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.108616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.108693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.108718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.108827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.108930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.108955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.109042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.109117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.109142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.109220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.109305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.109331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.109452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.109577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.109602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.109713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.109820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.109845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.109952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.110033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.110058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.110138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.110243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.110274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.110384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.110461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.110485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.110562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.110638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.110663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.110768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.110878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.110903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.110987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.111069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.111094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.111174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.111248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.111280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.111370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.111449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.111474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.111577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.111661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.111690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.111765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.111837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.111862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.111939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.112046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.112071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.112183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.112269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.112295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.112371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.112474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.112499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.112585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.112659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.112684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-10-30 16:14:09.112773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.112848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-10-30 16:14:09.112873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.112952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.113029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.113054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.113137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.113218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.113243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.113332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.113437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.113462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.113542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.113617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.113646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.113729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.113801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.113826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.113908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.113992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.114020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.114132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.114208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.114233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.114321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.114402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.114426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.114510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.114623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.114656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.114758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.114855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.114884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.114986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.115066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.115092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.115204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.115283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.115318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.115419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.115501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.115527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.115642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.115761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.115786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.115883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.115966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.115991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.116072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.116150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.116174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.116251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.116372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.116397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.116471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.116574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.116599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.116678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.116790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.116816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.116953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.117032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.117057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.117161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.117272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.117298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.117411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.117493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.117518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.117593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.117673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.117697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.117787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.117908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.117934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.118016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.118091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.118116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.118226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.118313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.118338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.118422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.118498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.118524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.118603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.118721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.118746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.118859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.118930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.118955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.119032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.119110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.119135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-10-30 16:14:09.119243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-10-30 16:14:09.119347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.119373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.119450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.119566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.119591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.119678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.119759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.119784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.119905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.119990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.120015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.120094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.120176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.120202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.120284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.120371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.120396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.120511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.120590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.120616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.120735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.120819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.120844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.120922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.120998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.121023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.121100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.121183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.121208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.121290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.121367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.121393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.121502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.121613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.121638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.121717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.121833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.121857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.121937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.122042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.122067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.122139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.122218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.122247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.122340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.122410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.122435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.122514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.122584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.122608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.122692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.122769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.122794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.122878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.122958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.122984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.123060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.123198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.123223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.123305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.123383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.123408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.123495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.123577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.123603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.123679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.123784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.123810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.123923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.124001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.124026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.124111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.124220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.124250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.124363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.124437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.124464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.124557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.124638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.124662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.124743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.124841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.124866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.124943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.125024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.125049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.125131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.125212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.125237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-10-30 16:14:09.125289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2311980 (9): Bad file descriptor 00:30:19.534 [2024-10-30 16:14:09.125460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.125591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-10-30 16:14:09.125620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.125705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.125787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.125813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.125894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.126001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.126027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.126108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.126192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.126218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.126308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.126404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.126432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.126512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.126592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.126618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.126694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.126768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.126793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.126899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.126973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.126998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.127078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.127153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.127179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.127268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.127382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.127408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.127499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.127574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.127599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.127707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.127790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.127816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.127897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.128002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.128027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.128101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.128181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.128206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.128285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.128391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.128427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.128505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.128582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.128607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.128681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.128756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.128780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.128859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.128975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.129000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.129087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.129166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.129192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.129279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.129369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.129394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.129475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.129546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.129571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.129653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.129762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.129787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.129869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.129949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.129975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.130064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.130176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.130201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.130288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.130369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.130400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.130507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.130589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.130614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.130699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.130810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.130835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.130912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.131021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.131046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.131125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.131197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.131222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-10-30 16:14:09.131354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.131439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-10-30 16:14:09.131464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.131546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.131631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.131655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.131732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.131805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.131830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.131948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.132029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.132055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.132130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.132234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.132274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.132368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.132475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.132500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.132620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.132732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.132757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.132843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.132924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.132951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.133029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.133102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.133127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.133209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.133287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.133313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.133429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.133544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.133569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.133643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.133719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.133745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.133823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.133932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.133957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.134038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.134114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.134139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.134246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.134346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.134371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.134447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.134524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.134548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.134642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.134720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.134746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.134833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.134918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.134943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.135018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.135099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.135123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.135203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.135277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.135303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.135390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.135465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.135490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.135598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.135671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.135696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.135783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.135860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.135885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.135968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.136052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.136076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.136154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.136227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.136252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.136342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.136425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.136450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.136533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.136677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.136703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.136813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.136889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.136914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.137023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.137130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.137155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.536 qpair failed and we were unable to recover it. 00:30:19.536 [2024-10-30 16:14:09.137236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.536 [2024-10-30 16:14:09.137364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.137390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.137499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.137579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.137603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.137681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.137791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.137817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.137896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.137970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.137995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.138068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.138175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.138199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.138287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.138381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.138406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.138485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.138562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.138587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.138668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.138811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.138837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.138919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.139031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.139056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.139139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.139220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.139245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.139334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.139431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.139456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.139567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.139672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.139697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.139777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.139856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.139881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.139954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.140034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.140060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.140177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.140249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.140281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.140373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.140455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.140480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.140558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.140636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.140661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.140743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.140851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.140879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.140959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.141074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.141099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.141182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.141272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.141298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.141385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.141462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.141487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.141566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.141643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.141668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.141743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.141849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.141874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.141961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.142035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.142059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.142141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.142226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.142251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.142345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.142429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.142454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.142565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.142639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.142664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.142778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.142885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.142909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.143005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.143115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.143141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.143252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.143342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.143368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.537 [2024-10-30 16:14:09.143451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.143556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.537 [2024-10-30 16:14:09.143581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.537 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.143659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.143762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.143787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.143901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.143977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.144002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.144086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.144170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.144194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.144282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.144387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.144412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.144492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.144598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.144623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.144713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.144797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.144822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.144932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.145017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.145042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.145124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.145196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.145221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.145310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.145421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.145446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.145533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.145611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.145636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.145713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.145828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.145853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.145933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.146014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.146038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.146122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.146230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.146262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.146358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.146433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.146458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.146564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.146638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.146662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.146743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.146833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.146858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.146941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.147021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.147046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.147165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.147272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.147298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.147378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.147467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.147492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.147573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.147662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.147687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.147765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.147846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.147872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.147951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.148024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.148049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.148133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.148207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.148232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.148316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.148392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.148417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.148526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.148631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.148655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.148741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.148822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.148847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.148924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.149004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.149029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.149149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.149235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.149264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.149357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.149435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.149459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.149537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.149616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.149641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.538 qpair failed and we were unable to recover it. 00:30:19.538 [2024-10-30 16:14:09.149721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.149804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.538 [2024-10-30 16:14:09.149829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.149941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.150023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.150047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.150128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.150273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.150300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.150430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.150507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.150533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.150628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.150710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.150734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.150845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.150924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.150948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.151023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.151098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.151122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.151232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.151328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.151357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.151470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.151551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.151576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.151650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.151757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.151782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.151867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.151947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.151972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.152048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.152125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.152149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.152282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.152358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.152383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.152470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.152551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.152576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.152664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.152752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.152778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.152890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.153005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.153030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.153107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.153235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.153265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.153353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.153440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.153465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.153546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.153620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.153645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.153732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.153858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.153883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.153989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.154133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.154158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.154268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.154343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.154368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.154463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.154549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.154574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.154684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.154765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.154790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.154873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.154947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.154972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.155053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.155157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.155182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.155266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.155378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.155403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.155521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.155625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.155651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.155737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.155811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.155836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.155918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.156003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.156028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.156103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.156173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.156198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.539 qpair failed and we were unable to recover it. 00:30:19.539 [2024-10-30 16:14:09.156277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.539 [2024-10-30 16:14:09.156356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.156381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.156454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.156557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.156582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.156672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.156750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.156774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.156865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.156945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.156969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.157051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.157154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.157179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.157270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.157358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.157384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.157473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.157550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.157575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.157685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.157792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.157817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.157926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.157997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.158021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.158106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.158250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.158282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.158361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.158436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.158461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.158542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.158617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.158642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.158749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.158855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.158879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.158957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.159029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.159053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.159130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.159203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.159228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.159322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.159414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.159439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.159533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.159645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.159670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.159755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.159874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.159899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.160015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.160087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.160112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.160222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.160377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.160403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.160483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.160562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.160586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.160664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.160778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.160804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.160886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.160964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.160989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.161074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.161153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.161179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.161265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.161363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.161389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.161480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.161569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.161594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.161680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.161756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.161781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.540 [2024-10-30 16:14:09.161855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.161929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.540 [2024-10-30 16:14:09.161958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.540 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.162075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.162159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.162183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.162268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.162345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.162370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.162467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.162573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.162598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.162672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.162750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.162775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.162850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.162924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.162949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.163036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.163145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.163170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.163247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.163333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.163358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.163474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.163554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.163579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.163668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.163780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.163804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.163884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.163968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.163996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.164078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.164159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.164188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.164284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.164368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.164393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.164501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.164585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.164610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.164687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.164757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.164782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.164855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.164938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.164962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.165043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.165152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.165176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.165251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.165338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.165363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.165445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.165518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.165543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.165685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.165761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.165785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.165878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.165957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.165983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.166073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.166147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.166172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.166282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.166384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.166409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.166494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.166571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.166596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.166679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.166761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.166786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.166862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.166951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.166979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.167073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.167154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.167180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.167263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.167344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.167369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.167457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.167569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.167593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.167712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.167793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.167818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.167921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.168001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.168026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.541 qpair failed and we were unable to recover it. 00:30:19.541 [2024-10-30 16:14:09.168105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.541 [2024-10-30 16:14:09.168183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.168209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.168299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.168377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.168402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.168482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.168554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.168579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.168696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.168772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.168797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.168874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.168957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.168982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.169092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.169163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.169188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.169290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.169364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.169388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.169500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.169611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.169636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.169742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.169814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.169839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.169916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.170055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.170081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.170186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.170381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.170407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.170487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.170563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.170588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.170665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.170776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.170800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.170887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.170973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.170998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.171078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.171192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.171217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.171304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.171375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.171399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.171470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.171556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.171580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.171654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.171762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.171787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.171867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.171940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.171966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.172043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.172115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.172140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.172226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.172312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.172338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.172449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.172527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.172551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.172624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.172702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.172726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.172849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.172925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.172950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.173032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.173147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.173172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.173247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.173328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.173353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.173467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.173540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.173565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.173640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.173716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.173741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.173818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.173903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.173927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.174066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.174152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.174177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.174252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.174335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.542 [2024-10-30 16:14:09.174367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.542 qpair failed and we were unable to recover it. 00:30:19.542 [2024-10-30 16:14:09.174480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.174553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.174578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.174687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.174773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.174798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.174907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.175010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.175034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.175111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.175223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.175248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.175338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.175418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.175443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.175520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.175601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.175626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.175740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.175818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.175843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.175929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.176035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.176060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.176136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.176238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.176297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.176384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.176520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.176545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.176634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.176708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.176734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.176834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.176908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.176933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.177020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.177095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.177120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.177206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.177286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.177311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.177422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.177505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.177530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.177604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.177711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.177735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.177843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.177924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.177949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.178058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.178166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.178191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.178275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.178356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.178381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.178464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.178573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.178599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.178712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.178798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.178824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.178901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.179041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.179065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.179148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.179228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.179253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.179338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.179443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.179468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.179555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.179663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.179688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.179765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.179871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.179896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.180037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.180109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.180133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.180246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.180354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.180380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.180464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.180540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.180565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.180644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.180723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.180748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.543 qpair failed and we were unable to recover it. 00:30:19.543 [2024-10-30 16:14:09.180844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.180934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.543 [2024-10-30 16:14:09.180963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.181077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.181162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.181188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.181269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.181351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.181377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.181493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.181571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.181596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.181683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.181791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.181816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.181902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.182006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.182032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.182152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.182236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.182271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.182381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.182471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.182496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.182609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.182721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.182746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.182827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.182933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.182959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.183065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.183154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.183179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.183269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.183348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.183373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.183451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.183559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.183585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.183668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.183749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.183773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.183885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.183957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.183981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.184058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.184139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.184165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.184286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.184366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.184391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.184473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.184548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.184574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.184654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.184731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.184756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.184845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.184929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.184955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.185036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.185120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.185147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.185229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.185345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.185372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.185485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.185593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.185619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.185732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.185845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.185871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.185979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.186088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.186114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.186191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.186279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.186306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.186426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.186504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.186529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.544 qpair failed and we were unable to recover it. 00:30:19.544 [2024-10-30 16:14:09.186639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.186720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.544 [2024-10-30 16:14:09.186745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.186836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.186922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.186947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.187027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.187132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.187157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.187233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.187322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.187351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.187473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.187558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.187584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.187662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.187774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.187801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.187882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.187961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.187985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.188098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.188176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.188202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.188304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.188446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.188472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.188554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.188706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.188732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.188810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.188894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.188920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.189005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.189108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.189133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.189245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.189331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.189357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.189438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.189512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.189541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.189646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.189756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.189782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.189864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.189950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.189975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.190053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.190161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.190186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.190277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.190353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.190378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.190461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.190570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.190595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.190677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.190761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.190787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.190897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.190978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.191004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.191089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.191189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.191215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.191306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.191385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.191410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.191495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.191566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.191596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.191673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.191759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.191785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.191861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.191936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.191962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.192074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.192153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.192182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.192267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.192347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.192373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.192456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.192545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.192571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.192676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.192751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.192776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.545 qpair failed and we were unable to recover it. 00:30:19.545 [2024-10-30 16:14:09.192913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.193025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.545 [2024-10-30 16:14:09.193051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.193136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.193217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.193241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.193340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.193444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.193469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.193558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.193667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.193697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.193784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.193862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.193886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.193965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.194074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.194099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.194174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.194281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.194307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.194384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.194469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.194493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.194600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.194681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.194708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.194785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.194865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.194892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.194982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.195055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.195081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.195165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.195237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.195266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.195405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.195528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.195553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.195656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.195764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.195794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.195882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.195965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.195990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.196128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.196199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.196224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.196346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.196458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.196483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.196568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.196647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.196673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.196756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.196838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.196864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.196958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.197081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.197110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.197200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.197281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.197310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.197401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.197486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.197511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.197592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.197707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.197733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.197816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.197924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.197949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.198044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.198120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.198146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.198264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.198343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.198369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.198452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.198564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.198590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.198674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.198750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.198774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.198864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.198947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.198973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.199057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.199164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.199190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.199267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.199378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.546 [2024-10-30 16:14:09.199404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.546 qpair failed and we were unable to recover it. 00:30:19.546 [2024-10-30 16:14:09.199485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.199600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.199627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.199710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.199821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.199848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.199939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.200048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.200073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.200169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.200249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.200280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.200362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.200475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.200501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.200583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.200689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.200715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.200789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.200863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.200888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.200973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.201048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.201073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.201181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.201293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.201321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.201403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.201480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.201506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.201586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.201668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.201693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.201797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.201879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.201905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.202016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.202092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.202116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.202230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.202320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.202347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.202458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.202573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.202599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.202710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.202789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.202819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.202898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.202972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.202997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.203085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.203163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.203188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.203269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.203345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.203370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.203474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.203547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.203572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.203682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.203793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.203818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.203891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.203993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.204018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.204098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.204214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.204240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.204331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.204419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.204445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.204528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.204604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.204629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.204770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.204849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.204874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.204948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.205054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.205079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.205164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.205241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.205272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.205363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.205442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.205467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.205553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.205635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.205660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.547 qpair failed and we were unable to recover it. 00:30:19.547 [2024-10-30 16:14:09.205751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.547 [2024-10-30 16:14:09.205835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.205862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.205978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.206059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.206084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.206165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.206249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.206303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.206422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.206521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.206549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.206633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.206722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.206747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.206835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.206910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.206937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.207027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.207133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.207158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.207243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.207328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.207353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.207443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.207525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.207550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.207627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.207706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.207733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.207843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.207979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.208004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.208091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.208174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.208201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.208286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.208392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.208417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.208543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.208624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.208650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.208731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.208805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.208831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.208939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.209049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.209077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.209157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.209234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.209267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.209352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.209434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.209461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.209572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.209661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.209688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.209799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.209886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.209912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.209990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.210065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.210091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.210171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.210280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.210306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.210392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.210498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.210523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.210647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.210731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.210757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.210844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.210925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.210951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.211032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.211112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.211138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.211218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.211336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.211362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.548 qpair failed and we were unable to recover it. 00:30:19.548 [2024-10-30 16:14:09.211472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.211583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.548 [2024-10-30 16:14:09.211609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.211693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.211769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.211794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.211878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.211958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.211984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.212091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.212203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.212229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.212320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.212407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.212433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.212518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.212627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.212652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.212775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.212873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.212901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.212984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.213068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.213093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.213168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.213238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.213283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.213377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.213505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.213531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.213623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.213700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.213725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.213834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.213911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.213936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.214027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.214115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.214141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.214253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.214342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.214367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.214453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.214560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.214586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.214667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.214802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.214828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.214910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.214990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.215016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.215135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.215216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.215241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.215362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.215447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.215474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.215556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.215638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.215663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.215742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.215846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.215872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.215954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.216031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.216056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.216170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.216250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.216283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.216361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.216438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.216463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.216551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.216629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.216653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.216736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.216816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.216842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.216934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.217017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.217043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.217125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.217201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.217226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.217322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.217396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.217421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.217499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.217585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.217611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.217698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.217795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.549 [2024-10-30 16:14:09.217821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.549 qpair failed and we were unable to recover it. 00:30:19.549 [2024-10-30 16:14:09.217911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.218015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.218040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.218124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.218203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.218228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.218322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.218430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.218455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.218538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.218646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.218672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.218763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.218839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.218864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.218941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.219035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.219061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.219145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.219250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.219283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.219368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.219452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.219478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.219593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.219705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.219730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.219815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.219889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.219914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.220026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.220135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.220160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.220237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.220327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.220354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.220465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.220545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.220570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.220679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.220766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.220791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.220870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.220946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.220970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.221082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.221174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.221199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.221314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.221402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.221428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.221508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.221618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.221646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.221730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.221804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.221829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.221912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.221990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.222016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.222097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.222216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.222243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.222334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.222414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.222439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.222523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.222603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.222629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.222736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.222830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.222855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.222970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.223049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.223074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.223153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.223232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.223272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.223360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.223483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.223509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.223586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.223694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.223720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.223802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.223943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.223968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.224082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.224168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.224194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.550 qpair failed and we were unable to recover it. 00:30:19.550 [2024-10-30 16:14:09.224275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.550 [2024-10-30 16:14:09.224355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.224381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.224457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.224563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.224588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.224701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.224780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.224805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.224911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.225002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.225027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.225103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.225184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.225212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.225311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.225389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.225419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.225507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.225584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.225609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.225692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.225768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.225793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.225904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.226017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.226043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.226128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.226237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.226277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.226370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.226449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.226475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.226588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.226668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.226692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.226769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.226847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.226872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.227012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.227101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.227125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.227214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.227306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.227332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.227413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.227527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.227557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.227639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.227725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.227750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.227847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.227954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.227980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.228062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.228139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.228164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.228242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.228327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.228353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.228438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.228516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.228541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.228631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.228708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.228733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.228819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.228923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.228948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.229043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.229119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.229144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.229224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.229314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.229340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.229416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.229500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.229531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.229624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.229731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.229757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.229874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.229947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.229972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.230088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.230198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.230223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.230322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.230397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.230423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.551 qpair failed and we were unable to recover it. 00:30:19.551 [2024-10-30 16:14:09.230534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.230613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.551 [2024-10-30 16:14:09.230639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.230718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.230797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.230822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.230900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.230983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.231009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.231148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.231233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.231265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.231351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.231434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.231459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.231546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.231627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.231654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.231745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.231881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.231907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.231991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.232066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.232091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.232231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.232314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.232339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.232417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.232500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.232527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.232605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.232686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.232711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.232832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.232906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.232931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.233009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.233088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.233112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.233194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.233322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.233348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.233460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.233568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.233594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.233673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.233744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.233769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.233860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.233980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.234007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.234090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.234199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.234224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.234316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.234394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.234421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.234495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.234614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.234644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.234752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.234859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.234885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.234964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.235078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.235105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.235184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.235274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.235302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.235391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.235475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.235500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.235579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.235662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.235689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.235777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.235862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.235888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.236001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.236109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.236134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.236212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.236333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.236358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.236439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.236517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.236544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.236634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.236710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.236736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.236843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.236917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.552 [2024-10-30 16:14:09.236943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.552 qpair failed and we were unable to recover it. 00:30:19.552 [2024-10-30 16:14:09.237029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.237107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.237132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.237240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.237372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.237398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.237488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.237566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.237591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.237717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.237823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.237848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.237958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.238041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.238067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.238152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.238237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.238280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.238372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.238449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.238475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.238553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.238660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.238685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.238764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.238837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.238862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.238935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.239006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.239032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.239105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.239230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.239262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.239339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.239419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.239445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.239518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.239624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.239649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.239722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.239807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.239833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.239941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.240018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.240043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.240127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.240243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.240276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.240368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.240448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.240474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.240586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.240664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.240690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.240773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.240856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.240882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.240995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.241084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.241109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.241216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.241302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.241328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.241405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.241479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.241505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.241579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.241666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.241692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.241802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.241885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.241912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.241990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.242068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.242094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.242182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.242301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.242328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.242409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.242487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.553 [2024-10-30 16:14:09.242511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.553 qpair failed and we were unable to recover it. 00:30:19.553 [2024-10-30 16:14:09.242599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.242674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.242699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.242773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.242857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.242882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.242968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.243080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.243105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.243184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.243266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.243292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.243377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.243455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.243480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.243561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.243644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.243670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.243809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.243892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.243919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.243997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.244086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.244112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.244226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.244357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.244387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.244473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.244585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.244611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.244724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.244833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.244858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.244944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.245021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.245046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.245157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.245235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.245268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.245352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.245429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.245454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.245535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.245649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.245674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.245782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.245885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.245910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.245988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.246064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.246089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.246193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.246282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.246309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.246399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.246489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.246518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.246598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.246677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.246703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.246795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.246875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.246901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.246979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.247055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.247080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.247165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.247248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.247282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.247364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.247444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.247470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.247609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.247692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.247717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.247828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.247905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.247931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.248008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.248086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.248111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.248186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.248269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.248295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.248370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.248455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.248480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.248561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.248666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.248691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.554 qpair failed and we were unable to recover it. 00:30:19.554 [2024-10-30 16:14:09.248808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.554 [2024-10-30 16:14:09.248885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.248910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.249001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.249077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.249102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.249183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.249260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.249285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.249368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.249446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.249471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.249550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.249636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.249660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.249739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.249813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.249838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.249922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.250004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.250030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.250102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.250208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.250233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.250320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.250399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.250428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.250506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.250614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.250639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.250717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.250823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.250848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.250939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.251019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.251045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.251126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.251204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.251230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.251317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.251401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.251426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.251502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.251582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.251607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.251682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.251762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.251787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.251862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.251970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.251994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.252073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.252149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.252174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.252250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.252335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.252359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.252444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.252532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.252557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.252648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.252735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.252760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.252834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.252909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.252934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.253042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.253121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.253147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.253222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.253307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.253332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.253417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.253499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.253523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.253634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.253721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.253747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.253859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.253939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.253963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.254043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.254126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.254151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.254228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.254310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.254335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.254415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.254492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.254517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.254600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.254681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.555 [2024-10-30 16:14:09.254708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.555 qpair failed and we were unable to recover it. 00:30:19.555 [2024-10-30 16:14:09.254790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.254867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.254892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.254983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.255089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.255119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.255206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.255298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.255324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.255407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.255532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.255558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.255667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.255772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.255798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.255875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.255987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.256012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.256096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.256169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.256195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.256309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.256392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.256417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.256513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.256633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.256662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.256781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.256859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.256886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.256964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.257037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.257062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.257200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.257313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.257339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.257419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.257497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.257523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.257601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.257679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.257704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.257819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.257898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.257923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.257997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.258071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.258096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.258180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.258264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.258292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.258376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.258456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.258481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.258604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.258712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.258738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.258816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.258925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.258952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.259058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.259166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.259192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.259284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.259391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.259417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.259500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.259616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.259641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.259751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.259834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.259858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.259941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.260020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.260047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.260158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.260234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.260266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.260349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.260442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.260468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.260550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.260626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.260652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.260773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.260888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.260913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.260993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.261069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.261094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.556 qpair failed and we were unable to recover it. 00:30:19.556 [2024-10-30 16:14:09.261176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.261289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.556 [2024-10-30 16:14:09.261324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.261411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.261494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.261520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.261606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.261682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.261707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.261797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.261873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.261898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.261975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.262083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.262109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.262188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.262280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.262306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.262382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.262493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.262518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.262603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.262674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.262699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.262807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.262920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.262944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.263027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.263102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.263127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.263233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.263322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.263348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.263459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.263543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.263568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.263652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.263730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.263755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.263861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.263937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.263962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.264055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.264179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.264207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.264291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.264369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.264394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.264475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.264579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.264604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.264708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.264787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.264811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.264915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.265001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.265025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.265102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.265177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.265202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.265311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.265390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.265416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.265501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.265585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.265610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.265720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.265795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.265820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.265925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.266003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.266028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.266110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.266194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.266219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.266311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.266386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.266412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.266525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.266634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.266661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.266738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.266819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.557 [2024-10-30 16:14:09.266844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.557 qpair failed and we were unable to recover it. 00:30:19.557 [2024-10-30 16:14:09.266922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.267001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.267026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.267140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.267220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.267245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.267343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.267420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.267445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.267561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.267640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.267666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.267742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.267856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.267882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.267963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.268042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.268067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.268145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.268217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.268242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.268359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.268438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.268463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.268574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.268652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.268678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.268793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.268871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.268898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.268970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.269053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.269084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.269172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.269262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.269289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.269365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.269447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.269473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.269611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.269695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.269722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.269846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.269954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.269979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.270057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.270140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.270165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.270260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.270341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.270367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.270476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.270552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.270578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.270661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.270741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.270767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.270874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.270987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.271012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.271107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.271185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.271218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.271342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.271421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.271446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.271528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.271612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.271639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.271725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.271804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.271830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.271906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.271992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.272017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.272092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.272168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.272192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.272270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.272382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.272407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.272482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.272586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.272611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.272691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.272794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.272819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.272931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.273007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.558 [2024-10-30 16:14:09.273034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.558 qpair failed and we were unable to recover it. 00:30:19.558 [2024-10-30 16:14:09.273110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.273186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.273215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.273329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.273417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.273443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.273527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.273664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.273689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.273775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.273881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.273907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.273987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.274076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.274101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.274213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.274295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.274321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.274402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.274473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.274499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.274609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.274717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.274742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.274821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.274904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.274930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.275011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.275086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.275111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.275251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.275340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.275368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.275459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.275566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.275591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.275672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.275756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.275783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.275889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.275972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.276002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.276109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.276219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.276244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.276335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.276411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.276437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.276548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.276627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.276652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.276734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.276845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.276872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.276952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.277037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.277064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.277179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.277268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.277294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.277377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.277456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.277481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.277577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.277657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.277682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.277788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.277867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.277893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.277975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.278055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.278080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.278159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.278268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.278295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.278382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.278469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.278496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.278576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.278656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.278681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.278800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.278911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.278936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.279067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.279147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.279173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.279291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.279371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.279397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.559 qpair failed and we were unable to recover it. 00:30:19.559 [2024-10-30 16:14:09.279476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.279555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.559 [2024-10-30 16:14:09.279580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.279695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.279777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.279802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.279915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.280031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.280057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.280168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.280277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.280303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.280384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.280464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.280489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.280599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.280676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.280701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.280813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.280890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.280915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.280998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.281103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.281129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.281206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.281291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.281322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.281400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.281476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.281501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.281581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.281688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.281714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.281792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.281881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.281908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.281991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.282068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.282092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.282185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.282295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.282322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.282410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.282490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.282515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.282611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.282697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.282723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.282833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.282910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.282935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.283010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.283090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.283115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.283193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.283275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.283300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.283385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.283460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.283485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.283564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.283639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.283663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.283777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.283856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.283882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.283954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.284059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.284083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.284157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.284230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.284264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.284343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.284423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.284448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.284523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.284606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.284631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.284712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.284792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.284818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.284899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.285010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.285036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.285117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.285227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.285252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.285346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.285429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.285457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.560 [2024-10-30 16:14:09.285537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.285612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.560 [2024-10-30 16:14:09.285637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.560 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.285778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.285852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.285877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.285956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.286029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.286055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.286141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.286248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.286281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.286366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.286441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.286467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.286549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.286624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.286649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.286754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.286832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.286857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.286941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.287021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.287048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.287125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.287227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.287253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.287363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.287443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.287468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.287550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.287624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.287649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.287745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.287840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.287869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.287980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.288070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.288098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.288178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.288322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.288348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.288432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.288510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.288535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.288618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.288694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.288720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.288814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.288891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.288915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.288991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.289067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.289092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.289197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.289284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.289310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.289389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.289467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.289493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.289607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.289684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.289709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.289799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.289873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.289900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.289980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.290090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.290115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.290220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.290308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.290335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.290419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.290496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.290522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.290639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.290749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.290775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.290854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.290959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.290984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.291094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.291169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.291194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.291277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.291360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.561 [2024-10-30 16:14:09.291385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.561 qpair failed and we were unable to recover it. 00:30:19.561 [2024-10-30 16:14:09.291468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.291542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.291568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.291676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.291751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.291777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.291853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.291973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.292001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.292081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.292164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.292189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.292275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.292351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.292377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.292460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.292534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.292558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.292701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.292777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.292803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.292912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.292986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.293012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.293125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.293201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.293226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.293315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.293390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.293416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.293494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.293608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.293634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.293719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.293802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.293827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.293936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.294019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.294044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.294120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.294197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.294222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.294310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.294396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.294423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.294511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.294622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.294647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.294761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.294839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.294864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.294972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.295058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.295084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.295165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.295241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.562 [2024-10-30 16:14:09.295272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.562 qpair failed and we were unable to recover it. 00:30:19.562 [2024-10-30 16:14:09.295390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.295476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.295501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.295614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.295690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.295716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.295834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.295910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.295936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.296016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.296101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.296126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.296235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.296322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.296347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.296424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.296562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.296588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.296669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.296749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.296773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.296850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.296926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.296951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.297030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.297140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.297164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.297248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.297345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.297370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.297459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.297596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.297622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.297721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.297798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.297823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.297904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.298027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.298054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.298132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.298232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.298266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.298357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.298465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.298490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.298568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.298646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.298673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.298817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.298897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.298922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.299009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.299087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.299112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.299252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.299336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.299361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.299470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.299552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.299577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.299718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.299793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.299819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.299896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.300005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.300031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.300120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.300198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.300224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.300312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.300393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.300424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.300507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.300648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.300674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.300765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.300844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.300870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.300982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.301059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.301085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.301162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.301240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-10-30 16:14:09.301273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.563 qpair failed and we were unable to recover it. 00:30:19.563 [2024-10-30 16:14:09.301384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.301462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.301487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.301607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.301716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.301742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.301849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.301935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.301961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.302073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.302144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.302170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.302253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.302354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.302380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.302461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.302539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.302570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.302679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.302789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.302815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.302894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.302969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.302996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.303100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.303176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.303202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.303293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.303380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.303406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.303483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.303630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.303655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.303740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.303824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.303850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.303927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.304013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.304039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.304115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.304193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.304219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.304309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.304386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.304412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.304490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.304567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.304598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.304680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.304767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.304793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.304898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.304984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.305010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.305085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.305163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.305188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.305271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.305351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.305377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.305456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.305533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.305559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.305669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.305741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.305767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.305846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.305935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.305961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.306040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.306118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.306144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.306230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.306312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.306337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.306416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.306492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.306523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.306610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.306683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.306708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.306786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.306893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.306919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.306999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.307104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.307129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.564 qpair failed and we were unable to recover it. 00:30:19.564 [2024-10-30 16:14:09.307206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.307286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-10-30 16:14:09.307312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.307399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.307477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.307503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.307583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.307689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.307714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.307793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.307872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.307898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.307970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.308046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.308071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.308153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.308235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.308265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.308344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.308453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.308478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.308572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.308686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.308713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.308852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.308928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.308954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.309037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.309121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.309147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.309225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.309314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.309341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.309420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.309524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.309549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.309622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.309697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.309722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.309836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.309947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.309972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.310083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.310163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.310188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.310295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.310371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.310397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.310473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.310557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.310582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.310692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.310771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.310797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.310874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.310950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.310974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.311057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.311141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.311167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.311245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.311334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.311360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.311437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.311541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.311567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.311657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.311732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.311758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.311840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.311945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.311970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.312056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.312136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.312161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.312250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.312340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.312365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.312445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.312521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.312548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.312634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.312741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.312766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.312870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.312952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.312979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.565 [2024-10-30 16:14:09.313061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.313166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-10-30 16:14:09.313192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.565 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.313268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.313343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.313368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.313455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.313568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.313594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.313671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.313748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.313772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.313882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.313995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.314020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.314132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.314211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.314238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.314323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.314430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.314454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.314540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.314628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.314654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.314743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.314852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.314878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.314987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.315065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.315090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.315166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.315286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.315312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.315393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.315475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.315499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.315580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.315689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.315714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.315791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.315894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.315919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.315995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.316104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.316128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.316207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.316286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.316312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.316424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.316503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.316528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.316608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.316690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.316715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.316808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.316887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.316914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.316995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.317136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.317161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.317252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.317336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.317362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.317475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.317566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.317591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.317671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.317754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.317780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.317873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.317955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.317982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.318069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.318176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.318201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.318289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.318374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.318401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.566 [2024-10-30 16:14:09.318480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.318586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.566 [2024-10-30 16:14:09.318612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.566 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.318692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.318802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.318828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.318941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.319022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.319046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.319189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.319299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.319325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.319402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.319513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.319541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.319625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.319705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.319731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.319811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.319887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.319912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.320023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.320099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.320125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.320234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.320321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.320348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.320465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.320542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.320567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.320648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.320720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.320745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.320849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.320956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.320981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.321063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.321168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.321192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.321276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.321364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.321391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.321466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.321547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.321572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.321662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.321775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.321801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.321877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.321955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.321979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.322057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.322168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.322195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.322283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.322398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.322425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.322505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.322613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.322638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.322747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.322826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.322851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.322933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.323017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.323042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.323158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.323270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.323297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.323411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.323495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.323520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.323604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.323682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.323707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.323785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.323868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.323893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.323969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.324077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.324102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.324279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.324388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.324414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.324527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.324605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.324629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.324710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.324785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.324810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.567 qpair failed and we were unable to recover it. 00:30:19.567 [2024-10-30 16:14:09.324894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.567 [2024-10-30 16:14:09.324979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.325005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.325086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.325162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.325187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.325269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.325366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.325392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.325473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.325560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.325587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.325681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.325758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.325782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.325861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.325950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.325975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.326089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.326166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.326191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.326307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.326412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.326437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.326516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.326600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.326627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.326731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.326812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.326838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.326929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.327044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.327068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.327152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.327229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.327261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.327344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.327462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.327488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.327565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.327639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.327664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.327742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.327822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.327847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.327928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.328068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.328094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.328181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.328265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.328292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.328378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.328456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.328482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.328591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.328679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.328705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.328908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.328984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.329009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.329082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.329158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.329183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.329272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.329361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.329386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.329499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.329613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.329638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.329719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.329826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.329851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.329929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.330037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.330063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.330152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.330247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.330294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.330384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.330466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.330492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.330573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.330682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.330707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.330818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.330928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.330954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.568 qpair failed and we were unable to recover it. 00:30:19.568 [2024-10-30 16:14:09.331030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.568 [2024-10-30 16:14:09.331136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.331161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.331250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.331336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.331362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.331445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.331533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.331559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.331665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.331749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.331775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.331856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.331933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.331958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.332035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.332113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.332140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.332252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.332342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.332368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.332478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.332550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.332575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.332690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.332765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.332791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.332896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.332970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.332995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.333075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.333155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.333181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.333267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.333411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.333437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.333522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.333598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.333624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.333712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.333790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.333823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.333901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.333980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.334006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.334120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.334230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.334275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.334364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.334443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.334471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.334551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.334659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.334685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.334764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.334873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.334900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.334977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.335051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.335077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.335164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.335251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.335285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.335392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.335472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.335498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.335576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.335656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.335682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.335757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.335833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.335863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.335975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.336051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.336076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.336170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.336249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.336281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.336357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.336440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.336465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.336575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.336655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.336680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.336760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.336834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.336860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.569 [2024-10-30 16:14:09.336966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.337074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.569 [2024-10-30 16:14:09.337100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.569 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.337211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.337297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.337324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.337400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.337506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.337531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.337611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.337717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.337744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.337882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.337960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.337992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.338081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.338218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.338243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.338333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.338445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.338470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.338588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.338673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.338697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.338775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.338851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.338877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.338983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.339064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.339090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.339216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.339312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.339338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.339421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.339506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.339531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.339614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.339697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.339722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.339798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.339903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.339929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.340039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.340116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.340141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.340232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.340315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.340341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.340450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.340531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.340556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.340667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.340784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.340810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.340892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.340971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.340996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.341074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.341178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.341203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.341312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.341410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.341436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.341516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.341624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.341649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.341727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.341838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.341865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.341973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.342049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.342074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.342150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.342266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.342291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.342409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.342493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.342518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.342627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.342705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.342730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.342809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.342890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.342915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.342994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.343104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.343130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.570 qpair failed and we were unable to recover it. 00:30:19.570 [2024-10-30 16:14:09.343221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.343307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.570 [2024-10-30 16:14:09.343332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.343413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.343495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.343521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.343629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.343737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.343763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.343842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.343948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.343974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.344062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.344168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.344194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.344308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.344387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.344413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.344525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.344599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.344625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.344731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.344801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.344826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.344931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.345036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.345061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.345139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.345261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.345288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.345374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.345449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.345475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.345588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.345672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.345696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.345802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.345880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.345905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.346017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.346127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.346152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.346229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.346323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.346349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.346468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.346577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.346602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.346714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.346824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.346849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.346956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.347032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.347057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.347138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.347213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.347238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.347326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.347434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.347460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.347571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.347651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.347676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.347755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.347832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.347858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.347937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.348045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.348069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.571 qpair failed and we were unable to recover it. 00:30:19.571 [2024-10-30 16:14:09.348146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.348230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.571 [2024-10-30 16:14:09.348263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.348383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.348494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.348518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.348595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.348727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.348752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.348837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.348911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.348936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.349015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.349130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.349154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.349245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.349328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.349353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.349435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.349541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.349565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.349650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.349737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.349762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.349872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.349956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.349983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.350064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.350178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.350205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.350290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.350370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.350395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.350480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.350589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.350614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.350695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.350774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.350799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.350914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.351027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.351053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.351166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.351244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.351275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.351382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.351493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.351519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.351606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.351685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.351711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.351792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.351899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.351923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.352034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.352109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.352136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.352215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.352332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.352358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.352441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.352548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.352572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.352662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.352737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.352763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.352850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.352964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.352989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.353073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.353148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.353173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.353282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.353365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.353389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.353481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.353559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.353585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.353672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.353753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.353779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.353888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.353967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.353993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.354081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.354158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.354183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.354272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.354362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.354389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.572 qpair failed and we were unable to recover it. 00:30:19.572 [2024-10-30 16:14:09.354479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.572 [2024-10-30 16:14:09.354557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.354582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.354690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.354797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.354821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.354906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.355012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.355037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.355148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.355225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.355250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.355331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.355440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.355466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.355547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.355655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.355682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.355761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.355844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.355869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.355956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.356033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.356058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.356131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.356242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.356273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.356385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.356492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.356518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.356602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.356711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.356736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.356819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.356898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.356923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.357033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.357112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.357139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.357224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.357318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.357345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.357427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.357536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.357561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.357667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.357742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.357767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.357851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.357929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.357954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.358063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.358201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.358226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.358333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.358419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.358445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.358527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.358601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.358627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.358710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.358815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.358840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.358918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.359029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.359054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.359134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.359242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.359276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.359385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.359501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.359527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.359608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.359691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.359717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.359801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.359871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.359896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.359979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.360082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.360107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.360214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.360301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.360326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.360411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.360490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.360514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.360628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.360733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.360758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.573 [2024-10-30 16:14:09.360839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.360911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.573 [2024-10-30 16:14:09.360935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.573 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.361014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.361087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.361112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.361188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.361269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.361295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.361377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.361510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.361537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.361615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.361697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.361725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.361811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.361921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.361946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.362022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.362102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.362128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.362244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.362329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.362354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.362448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.362526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.362551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.362641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.362723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.362749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.362863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.362946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.362972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.363048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.363119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.363144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.363250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.363353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.363380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.363468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.363548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.363575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.363656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.363790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.363816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.363893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.363972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.363997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.364072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.364151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.364176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.364287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.364364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.364390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.364470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.364579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.364606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.364726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.364843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.364870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.364980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.365089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.365117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.365194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.365280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.365308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.365400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.365478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.365503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.365588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.365669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.365702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.365811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.365891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.365917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.365997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.366069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.366095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.366205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.366286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.366312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.366400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.366474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.366498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.366579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.366691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.366717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.366822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.366901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.366927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.367011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.367097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.367122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.574 qpair failed and we were unable to recover it. 00:30:19.574 [2024-10-30 16:14:09.367201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.574 [2024-10-30 16:14:09.367286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.367312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.367394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.367473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.367498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.367579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.367654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.367685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.367802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.367879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.367904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.367987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.368065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.368090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.368170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.368245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.368276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.368367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.368475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.368500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.368583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.368667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.368692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.368772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.368845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.368871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.368954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.369038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.369065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.369148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.369219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.369245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.369370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.369456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.369482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.369558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.369639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.369668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.369779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.369858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.369883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.369988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.370099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.370124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.370199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.370308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.370334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.370414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.370494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.370520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.575 [2024-10-30 16:14:09.370606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.370692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.575 [2024-10-30 16:14:09.370717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.575 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.370797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.370873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.370897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.370982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.371060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.371086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.371161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.371236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.371269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.371347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.371421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.371447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.371528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.371610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.371640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.371730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.371801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.371826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.371911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.371988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.372014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.372122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.372199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.372224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.372309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.372394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.372419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.372493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.372572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.372598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.372710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.372786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.372811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.372932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.373012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.373036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.373114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.373218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.373243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.373330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.373405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-10-30 16:14:09.373429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-10-30 16:14:09.373513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.373598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.373624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.373710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.373814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.373839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.373920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.373991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.374016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.374094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.374170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.374194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.374277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.374356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.374382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.374463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.374584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.374609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.374687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.374761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.374786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.374871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.374979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.375004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.375081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.375156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.375182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.375268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.375342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.375367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.375455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.375533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.375557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.375644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.375720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.375746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.375823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.375929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.375954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.376028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.376108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.376134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.376243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.376358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.376384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.376466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.376542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.376567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.376644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.376716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.376741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.376847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.376954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.376979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.377054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.377143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.377170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.377246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.377330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.377355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.377443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.377518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.377543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.377626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.377737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.377761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.377838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.377914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.377939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.378017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.378119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.378143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.378232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.378346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.378372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.378479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.378556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.378582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.378661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.378742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.378768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.378850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.378986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.379012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.379091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.379177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.379203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.379302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.379383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-10-30 16:14:09.379409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-10-30 16:14:09.379494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.379577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.379602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.379689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.379794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.379820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.379898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.380020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.380047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.380153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.380228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.380252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.380339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.380419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.380445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.380556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.380645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.380671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.380783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.380855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.380879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.380960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.381072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.381099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.381178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.381275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.381301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.381378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.381490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.381515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.381599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.381676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.381701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.381829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.381938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.381963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.382072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.382151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.382176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.382248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.382354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.382381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.382459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.382538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.382563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.382673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.382797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.382822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.382900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.383004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.383029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.383105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.383184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.383209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.383321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.383407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.383432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.383537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.383617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.383642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.383716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.383794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.383818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.383904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.383979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.384005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.384096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.384174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.384198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.384281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.384359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.384384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.384469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.384549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.384575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.384682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.384786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.384812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.384926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.385031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.385056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.385135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.385244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.385276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.385381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.385467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.385492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.385605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.385683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.385709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-10-30 16:14:09.385793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-10-30 16:14:09.385911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.385935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.386016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.386109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.386133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.386213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.386299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.386325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.386407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.386518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.386544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.386631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.386709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.386734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.386873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.386980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.387004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.387086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.387158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.387183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.387293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.387382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.387406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.387488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.387568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.387594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.387671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.387810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.387836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.387919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.388026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.388052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.388149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.388279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.388310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.388401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.388514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.388540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.388626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.388709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.388734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.388843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.388920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.388945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.389026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.389135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.389160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.389277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.389361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.389387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.389470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.389584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.389610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.389687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.389768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.389793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.389908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.389995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.390020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.390131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.390212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.390237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.390327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.390417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.390443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.390526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.390630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.390659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.390772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.390886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.390912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.390996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.391076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.391102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.391189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.391325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.391350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.391432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.391508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.391534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.391619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.391713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.391738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.391818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.391891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.391917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.391995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.392080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.392105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-10-30 16:14:09.392215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.392298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-10-30 16:14:09.392323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.392402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.392489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.392516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.392627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.392705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.392730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.392810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.392886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.392913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.392990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.393103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.393128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.393211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.393299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.393325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.393405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.393483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.393508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.393587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.393700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.393727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.393841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.393924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.393950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.394031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.394103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.394128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.394327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.394406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.394432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.394512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.394652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.394678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.394757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.394835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.394860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.394998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.395082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.395107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.395203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.395309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.395339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.395430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.395510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.395536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.395617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.395701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.395728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.395869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.395954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.395980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.396053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.396133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.396159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.396273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.396354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.396380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.396463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.396546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.396571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.396677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.396767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.396795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.396878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.396988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.397013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.397120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.397199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.397223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.397305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.397388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.397415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.397532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.397616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.397642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-10-30 16:14:09.397752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.397827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-10-30 16:14:09.397852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.397962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.398071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.398097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.398208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.398294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.398322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.398410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.398525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.398550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.398660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.398742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.398766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.398851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.398960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.398989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.399067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.399172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.399197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.399306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.399389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.399415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.399521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.399599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.399626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.399740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.399817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.399842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.399922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.400035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.400060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.400168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.400244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.400278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.400361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.400443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.400469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.400608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.400683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.400708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.400803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.400886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.400911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.400987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.401060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.401090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.401170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.401281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.401307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.401393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.401503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.401529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.401639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.401749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.401775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.401866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.401942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.401967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.402081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.402219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.402244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.402348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.402426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.402451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.402567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.402646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.402674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.402756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.402842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.402867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.402953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.403033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.403060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.403167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.403247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.403288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.403370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.403483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.403508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.403589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.403673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.403698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.403809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.403894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.403920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.404000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.404078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.404103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.872 [2024-10-30 16:14:09.404184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.404288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.872 [2024-10-30 16:14:09.404313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.872 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.404396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.404479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.404504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.404585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.404667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.404692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.404801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.404889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.404916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.404997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.405073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.405098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.405180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.405263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.405294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.405407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.405494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.405518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.405603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.405686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.405712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.405790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.405869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.405893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.405983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.406057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.406082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.406200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.406305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.406332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.406411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.406489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.406515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.406602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.406708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.406733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.406817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.406934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.406959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.407034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.407116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.407143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.407225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.407306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.407331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.407419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.407531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.407556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.407638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.407714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.407740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.407820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.407893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.407918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.408024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.408103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.408130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.408212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.408298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.408323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.408407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.408503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.408528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.408617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.408696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.408721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.408802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.408907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.408933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.409049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.409162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.409188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.409268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.409358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.409383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.409465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.409567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.409593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.409679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.409756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.409781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.409859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.409940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.409965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.410073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.410185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.410211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.410305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.410408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.410432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.873 qpair failed and we were unable to recover it. 00:30:19.873 [2024-10-30 16:14:09.410541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.873 [2024-10-30 16:14:09.410616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.410641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.410718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.410800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.410826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.410935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.411020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.411045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.411124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.411206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.411232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.411380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.411461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.411487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.411603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.411685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.411710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.411816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.411922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.411947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.412054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.412130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.412156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.412272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.412349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.412374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.412451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.412526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.412552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.412672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.412783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.412809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.412886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.412995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.413021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.413097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.413169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.413195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.413317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.413430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.413456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.413541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.413618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.413643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.413765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.413872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.413898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.413986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.414092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.414118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.414199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.414312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.414339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.414416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.414496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.414522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.414614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.414695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.414721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.414803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.414886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.414913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.415027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.415140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.415165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.415249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.415331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.415357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.415437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.415517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.415545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.415652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.415729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.415755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.415835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.415943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.415969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.416049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.416131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.416158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.416263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.416344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.416369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.416450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.416532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.416559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.416666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.416740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.416766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.874 qpair failed and we were unable to recover it. 00:30:19.874 [2024-10-30 16:14:09.416847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.416921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.874 [2024-10-30 16:14:09.416946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.417024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.417134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.417160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.417243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.417324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.417350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.417435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.417544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.417570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.417678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.417763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.417790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.417911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.417988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.418015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.418097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.418177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.418202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.418297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.418407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.418433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.418512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.418592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.418618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.418694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.418772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.418798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.418873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.418949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.418974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.419057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.419130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.419156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.419238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.419328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.419354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.419440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.419516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.419543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.419622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.419730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.419756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.419901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.419974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.420000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.420077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.420150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.420176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.420285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.420364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.420390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.420470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.420545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.420571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.420656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.420740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.420767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.420852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.420932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.420958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.421034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.421107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.421131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.421205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.421282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.421309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.421392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.421475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.421500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.421577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.421697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.421723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.421835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.421915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.421940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.422018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.422098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.422122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.422200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.422291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.422318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.422431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.422513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.422539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.422646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.422754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.422779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.422869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.422973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.875 [2024-10-30 16:14:09.422999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.875 qpair failed and we were unable to recover it. 00:30:19.875 [2024-10-30 16:14:09.423082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.423162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.423187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.423268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.423376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.423401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.423487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.423595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.423621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.423704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.423816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.423841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.423927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.424040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.424066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.424145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.424234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.424265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.424345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.424428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.424453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.424530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.424617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.424643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.424724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.424801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.424827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.424905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.424979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.425004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.425080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.425182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.425209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.425289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.425373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.425399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.425489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.425566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.425592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.425704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.425810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.425836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.425912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.425997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.426022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.426104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.426178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.426204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.426291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.426367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.426392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.426500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.426609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.426633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.426710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.426823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.426849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.426923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.427002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.427027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.427135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.427213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.427238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.427325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.427404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.427431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.427511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.427656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.427683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.427763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.427852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.427879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.427967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.428050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.428077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.428192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.428300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.876 [2024-10-30 16:14:09.428327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.876 qpair failed and we were unable to recover it. 00:30:19.876 [2024-10-30 16:14:09.428407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.428486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.428513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.428625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.428706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.428734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.428849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.428930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.428956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.429044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.429116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.429142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.429222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.429319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.429347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.429432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.429535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.429562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.429646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.429754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.429780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.429857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.429947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.429974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.430053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.430165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.430192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.430334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.430453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.430480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.430565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.430679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.430706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.430784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.430933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.430960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.431084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.431167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.431194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.431278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.431361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.431388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.431467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.431584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.431610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.431735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.431814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.431841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.431933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.432071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.432097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.432178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.432268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.432295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.432374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.432454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.432486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.432604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.432722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.432748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.432841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.432912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.432939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.433022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.433136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.433163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.433243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.433330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.433356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.433433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.433543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.433569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.433676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.433751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.433777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.433857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.433938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.433965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.434110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.434196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.434221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.434357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.434465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.434492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.434578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.434685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.434720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.434832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.434977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.877 [2024-10-30 16:14:09.435003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.877 qpair failed and we were unable to recover it. 00:30:19.877 [2024-10-30 16:14:09.435086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.435225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.435270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.435357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.435443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.435470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.435579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.435664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.435691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.435804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.435891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.435916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.436035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.436114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.436140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.436269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.436348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.436375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.436487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.436574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.436601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.436714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.436791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.436818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.436899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.436976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.437008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.437118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.437225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.437268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.437357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.437471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.437498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.437587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.437703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.437731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.437817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.437931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.437958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.438048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.438132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.438160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.438242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.438365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.438392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.438506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.438596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.438622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.438707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.438785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.438812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.438897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.439002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.439029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.439117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.439220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.439262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.439357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.439434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.439461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.439563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.439642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.439669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.439779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.439856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.439882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.439969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.440048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.440074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.440161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.440266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.440294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.440373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.440480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.440507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.440598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.440704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.440731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.440817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.440926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.440953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.441062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.441137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.441164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.441290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.441379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.441406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.441499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.441591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.441620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.878 qpair failed and we were unable to recover it. 00:30:19.878 [2024-10-30 16:14:09.441729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.878 [2024-10-30 16:14:09.441810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.441836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.441947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.442037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.442065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.442153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.442233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.442275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.442358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.442444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.442471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.442596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.442682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.442709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.442787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.442865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.442892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.443001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.443111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.443138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.443222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.443352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.443379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.443461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.443542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.443573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.443659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.443768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.443795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.443887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.443971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.443998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.444107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.444212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.444238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.444352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.444468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.444495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.444577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.444664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.444691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.444802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.444916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.444942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.445018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.445096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.445124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.445235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.445368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.445395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.445479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.445563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.445590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.445676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.445784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.445811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.445906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.446016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.446043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.446124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.446207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.446234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.446337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.446415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.446441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.446523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.446611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.446637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.446750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.446838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.446865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.446943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.447019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.447046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.447185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.447277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.447304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.447390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.447473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.447500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.447651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.447765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.447791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.447877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.447962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.447988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.448105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.448211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.448238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.879 [2024-10-30 16:14:09.448362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.448438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.879 [2024-10-30 16:14:09.448465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.879 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.448581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.448699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.448726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.448805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.448912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.448939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.449045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.449154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.449181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.449283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.449391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.449419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.449508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.449589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.449616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.449697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.449802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.449829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.449940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.450028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.450055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.450133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.450212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.450239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.450371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.450456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.450484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.450572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.450669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.450695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.450803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.450878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.450904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.450996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.451085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.451112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.451222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.451350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.451377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.451458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.451537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.451563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.451643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.451719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.451746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.451824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.451925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.451951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.452030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.452101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.452128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.452270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.452353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.452379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.452462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.452538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.452564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.452649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.452767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.452793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.452877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.452951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.452977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.453084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.453165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.453194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.453322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.453428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.453455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.453567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.453649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.453677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.453790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.453876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.453904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.454022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.454164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.454191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.880 [2024-10-30 16:14:09.454284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.454356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.880 [2024-10-30 16:14:09.454384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.880 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.454491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.454581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.454608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.454710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.454801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.454832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.454917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.455002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.455029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.455106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.455184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.455211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.455330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.455417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.455444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.455525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.455614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.455639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.455725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.455830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.455856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.455936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.456015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.456040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.456117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.456193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.456218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.456319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.456448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.456479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.456574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.456665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.456692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.456786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.456877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.456904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.456996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.457077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.457104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.457186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.457331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.457358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.457437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.457524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.457551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.457699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.457815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.457842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.457932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.458055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.458082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.458167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.458290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.458318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.458403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.458493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.458521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.458640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.458718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.458745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.458856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.458937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.458966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.459085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.459179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.459206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.459297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.459411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.459438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.459517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.459632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.459659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.459773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.459889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.459916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.459996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.460112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.460139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.460218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.460311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.460339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.460427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.460538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.460565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.460651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.460771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.460807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.460894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.460972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.881 [2024-10-30 16:14:09.460998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.881 qpair failed and we were unable to recover it. 00:30:19.881 [2024-10-30 16:14:09.461081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.461197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.461224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.461324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.461403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.461431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.461525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.461624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.461651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.461745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.461827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.461854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.461959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.462068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.462095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.462185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.462269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.462297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.462378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.462459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.462486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.462606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.462690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.462716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.462833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.462911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.462938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.463023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.463106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.463133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.463216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.463318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.463346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.463433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.463517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.463544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.463632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.463711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.463738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.463858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.463967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.463993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.464073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.464209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.464235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.464325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.464403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.464429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.464513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.464598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.464625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.464739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.464849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.464876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.464959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.465074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.465102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.465214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.465303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.465331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.465418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.465501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.465529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.465656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.465759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.465791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.465905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.465987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.466014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.466100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.466176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.466202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.466317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.466429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.466456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.466570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.466692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.466719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.466832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.466946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.466972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.467088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.467164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.467191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.467320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.467402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.467429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.882 qpair failed and we were unable to recover it. 00:30:19.882 [2024-10-30 16:14:09.467508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.882 [2024-10-30 16:14:09.467602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.467627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.467710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.467819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.467846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.467927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.468031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.468065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.468148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.468270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.468298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.468382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.468469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.468495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.468581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.468655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.468682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.468769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.468883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.468910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.468987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.469069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.469095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.469172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.469289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.469318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.469401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.469480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.469507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.469651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.469728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.469754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.469863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.469941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.469968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.470054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.470135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.470166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.470264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.470341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.470367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.470452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.470534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.470566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.470645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.470786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.470813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.470897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.470976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.471005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.471119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.471196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.471222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.471320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.471427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.471454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.471594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.471703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.471729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.471812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.471901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.471927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.472032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.472111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.472138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.472223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.472323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.472355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.472439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.472515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.472541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.472625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.472701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.472729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.472843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.472922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.472951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.473033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.473127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.473155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.473234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.473331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.473359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.473436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.473544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.473570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.883 qpair failed and we were unable to recover it. 00:30:19.883 [2024-10-30 16:14:09.473653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.883 [2024-10-30 16:14:09.473772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.473799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.473907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.473984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.474011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.474105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.474285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.474314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.474396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.474506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.474533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.474681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.474763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.474790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.474902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.474981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.475008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.475114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.475218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.475262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.475349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.475428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.475455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.475532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.475649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.475675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.475788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.475869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.475894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.475975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.476051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.476076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.476215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.476321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.476348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.476466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.476547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.476573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.476689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.476829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.476856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.476943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.477021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.477048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.477129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.477208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.477235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.477359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.477435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.477462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.477577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.477652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.477679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.477794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.477909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.477936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.478046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.478125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.478151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.478242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.478384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.478415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.478511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.478588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.478616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.478702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.478829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.478857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.478964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.479051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.479078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.479169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.479278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.479307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.479419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.479534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.479565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.479649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.479733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.884 [2024-10-30 16:14:09.479760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.884 qpair failed and we were unable to recover it. 00:30:19.884 [2024-10-30 16:14:09.479840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.479932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.479958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.480038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.480165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.480203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.480327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.480404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.480431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.480513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.480593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.480620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.480703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.480791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.480818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.480933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.481018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.481045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.481152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.481267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.481295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.481417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.481496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.481522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.481601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.481710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.481737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.481815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.481924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.481951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.482065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.482146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.482173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.482268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.482352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.482379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.482493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.482606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.482643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.482737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.482812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.482839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.482955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.483033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.483060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.483138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.483223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.483297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.483417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.483523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.483549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.483649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.483738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.483764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.483845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.483920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.483947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.484057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.484146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.484174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.484270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.484360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.484388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.484499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.484585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.484618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.484699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.484803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.484830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.484938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.485019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.485047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.485125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.485229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.485267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.485349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.485426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.485453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.485566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.485645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.485671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.485755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.485864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.485891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.485972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.486078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.486104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.486187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.486292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.885 [2024-10-30 16:14:09.486320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.885 qpair failed and we were unable to recover it. 00:30:19.885 [2024-10-30 16:14:09.486433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.486573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.486601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.486684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.486821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.486847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.486928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.487050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.487078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.487220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.487318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.487346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.487457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.487564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.487590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.487667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.487776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.487802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.487881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.487990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.488017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.488100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.488214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.488241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.488342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.488421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.488449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.488649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.488784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.488810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.488895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.489002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.489028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.489114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.489220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.489265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.489375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.489462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.489489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.489582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.489662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.489689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.489773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.489861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.489888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.490001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.490078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.490106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.490300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.490374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.490401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.490488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.490682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.490710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.490854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.490936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.490965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.491077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.491163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.491190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.491275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.491467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.491494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.491586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.491700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.491728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.491814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.491926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.491953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.492062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.492138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.492165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.492265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.492376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.492402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.492485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.492583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.492610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.492723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.492805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.492832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.492915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.493005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.493032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.493113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.493225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.493269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.493382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.493465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.493492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.886 qpair failed and we were unable to recover it. 00:30:19.886 [2024-10-30 16:14:09.493577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.886 [2024-10-30 16:14:09.493690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.493718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.493793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.493904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.493931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc54c000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.494024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.494111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.494138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.494218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.494317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.494346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.494432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.494518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.494545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.494623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.494758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.494784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.494871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.494946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.494973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.495086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.495175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.495202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.495317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.495399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.495427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.495519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.495603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.495631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.495713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.495818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.495845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.496041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.496117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.496144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.496230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.496328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.496356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.496465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.496573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.496600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.496715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.496788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.496814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.496922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.497006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.497033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.497139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.497219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.497261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.497343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.497427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.497454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.497598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.497679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.497705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.497787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.497898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.497926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.498015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.498124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.498152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.498239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.498334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.498360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.498443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.498529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.498568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.498650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.498730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.498757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.498840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.498917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.498943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.499019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.499096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.499123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.499270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.499353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.499380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.499469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.499561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.499588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.499699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.499773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.499799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.499873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.499952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.499978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.887 qpair failed and we were unable to recover it. 00:30:19.887 [2024-10-30 16:14:09.500057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.500182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.887 [2024-10-30 16:14:09.500210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.500308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.500412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.500439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.500548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.500620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.500647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.500728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.500802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.500829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.500940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.501046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.501072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.501180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.501276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.501303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.501383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.501461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.501488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.501617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.501720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.501751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.501833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.501941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.501967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.502082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.502190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.502216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.502305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.502386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.502414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.502525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.502612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.502639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.502755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.502836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.502862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.502949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.503059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.503085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.503168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.503285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.503313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.503395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.503473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.503499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.503597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.503703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.503729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.503842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.503979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.504009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.504134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.504211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.504237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.504352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.504462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.504489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.504575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.504664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.504692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.504831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.504913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.504941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.505015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.505133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.505160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.505252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.505339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.505366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.505447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.505558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.505584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.505702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.505810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.505837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.505928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.506008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.506034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.506143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.506218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.506277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.506366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.506448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.506476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.506591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.506673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.506700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.506782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.506860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.888 [2024-10-30 16:14:09.506886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.888 qpair failed and we were unable to recover it. 00:30:19.888 [2024-10-30 16:14:09.506971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.507045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.507072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.507195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.507278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.507306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.507423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.507535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.507562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.507680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.507758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.507785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.507870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.507945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.507972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.508054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.508198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.508225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.508312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.508392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.508424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.508539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.508616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.508642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.508732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.508809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.508835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.508947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.509032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.509059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.509174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.509304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.509332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.509476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.509554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.509581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.509661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.509768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.509795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.509875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.510067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.510094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.510173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.510303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.510331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.510421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.510500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.510527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.510604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.510680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.510707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.510805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.510911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.510937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.511020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.511125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.511151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.511267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.511346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.511373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.511459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.511564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.511591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.511672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.511750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.511776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.511862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.511935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.511961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.512039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.512118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.512144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.512284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.512378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.512405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.512522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.512596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.512622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.889 [2024-10-30 16:14:09.512700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.512775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.889 [2024-10-30 16:14:09.512800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.889 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.512885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.512991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.513017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.513105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.513192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.513218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.513308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.513389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.513415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.513533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.513645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.513673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.513782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.513860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.513887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.513972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.514078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.514104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.514179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.514285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.514312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.514388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.514473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.514499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.514583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.514690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.514717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.514807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.514894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.514920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.515045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.515121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.515147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.515228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.515367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.515394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.515536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.515663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.515695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.515776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.515856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.515883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.515992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.516097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.516123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.516208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.516321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.516350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.516440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.516521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.516548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.516629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.516709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.516736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.516853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.516963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.516989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.517103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.517223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.517249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.517340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.517418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.517445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.517524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.517631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.517657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.517774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.517886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.517913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.518026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.518133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.518159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.518286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.518372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.518398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.518503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.518615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.518642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.518720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.518832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.518859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.518936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.519011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.519039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.519129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.519240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.519273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.519357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.519465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.519492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.890 qpair failed and we were unable to recover it. 00:30:19.890 [2024-10-30 16:14:09.519582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.890 [2024-10-30 16:14:09.519660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.519687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.519773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.519850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.519876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.519961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.520034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.520060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.520169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.520243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.520281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.520374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.520464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.520490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.520568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.520647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.520674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.520764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.520842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.520870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.520945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.521026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.521052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.521131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.521239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.521273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.521364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.521442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.521469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.521557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.521637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.521665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.521776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.521858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.521884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.521993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.522072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.522099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.522174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.522267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.522296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.522411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.522499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.522527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.522640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.522720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.522747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.522832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.522941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.522968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.523048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.523126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.523153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.523268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.523406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.523433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.523540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.523618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.523644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.523741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.523897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.523927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.524044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.524162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.524189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.524302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.524384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.524410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.524519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.524625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.524650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.524727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.524801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.524826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.524965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.525043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.525069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.525154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.525238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.525270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.525381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.525488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.525514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.525596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.525674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.525701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.525776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.525880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.525907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.891 qpair failed and we were unable to recover it. 00:30:19.891 [2024-10-30 16:14:09.525990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.526099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.891 [2024-10-30 16:14:09.526125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.526240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.526345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.526373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.526464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.526538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.526564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.526674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.526759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.526785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.526865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.526973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.526999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.527082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.527191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.527219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.527341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.527452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.527479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.527563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.527639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.527664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.527773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.527881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.527906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.528022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.528128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.528154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.528267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.528355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.528381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.528463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.528571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.528597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.528677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.528786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.528811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.528896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.528977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.529004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.529087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.529176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.529204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.529293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.529372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.529399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.529480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.529587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.529614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.529727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.529798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.529823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.529902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.530014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.530041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.530124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.530240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.530292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.530379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.530496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.530523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.530647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.530760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.530787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.530901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.531009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.531036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.531114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.531195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.531223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.531327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.531412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.531438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.531519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.531626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.531653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.531733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.531818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.531845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.531954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.532037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.532063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.532173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.532246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.532281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.532393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.532473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.532500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.532611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.532690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.892 [2024-10-30 16:14:09.532716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.892 qpair failed and we were unable to recover it. 00:30:19.892 [2024-10-30 16:14:09.532792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.532896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.532934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.533016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.533151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.533177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.533274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.533355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.533381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.533469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.533550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.533590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.533703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.533788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.533814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.533895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.534003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.534030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.534123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.534199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.534226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.534309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.534392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.534420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.534535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.534646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.534673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.534756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.534868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.534899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.534979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.535088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.535114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.535195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.535286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.535314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.535424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.535537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.535563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.535644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.535717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.535743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.535861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.535976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.536003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.536083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.536160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.536187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.536301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.536418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.536446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.536529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.536610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.536637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.536723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.536824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.536849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.536925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.537026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.537057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.537167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.537238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.537270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.537384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.537465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.537490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.537602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.537683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.537710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.537794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.537873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.537900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.537989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.538067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.538093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.538169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.538245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.538294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.893 [2024-10-30 16:14:09.538376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.538456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.893 [2024-10-30 16:14:09.538482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.893 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.538575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.538685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.538712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.538823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.538896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.538922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.539035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.539118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.539149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.539275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.539354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.539380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.539465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.539571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.539597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.539711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.539787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.539813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.539887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.539992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.540019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.540162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.540249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.540280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.540363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.540438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.540463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.540550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.540629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.540656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.540738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.540822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.540847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.540927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.541031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.541057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.541178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.541327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.541359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.541441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.541548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.541574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.541651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.541756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.541782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.541892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.541966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.541991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.542074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.542186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.542213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.542297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.542403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.542430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.542513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.542593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.542621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.542737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.542822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.542848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.542962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.543037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.543063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.543171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.543283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.543310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.543389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.543469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.543495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.543642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.543759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.543784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.543868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.543954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.543981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.544063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.544174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.544200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.544288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.544377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.544403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.544488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.544575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.544601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.544683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.544756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.544783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.544863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.544946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.544973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.894 qpair failed and we were unable to recover it. 00:30:19.894 [2024-10-30 16:14:09.545053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.894 [2024-10-30 16:14:09.545138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.545166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.545283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.545363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.545389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.545472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.545552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.545578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.545699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.545776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.545801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.545882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.545992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.546018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.546101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.546188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.546215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.546307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.546421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.546447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.546530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.546637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.546663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.546744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.546832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.546858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.546958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.547033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.547060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.547148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.547225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.547251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.547367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.547450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.547476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.547570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.547656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.547682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.547768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.547881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.547908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.547985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.548070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.548096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.548181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.548252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.548284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.548398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.548480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.548506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.548591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.548698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.548725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.548801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.548885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.548912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.548989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.549094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.549120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.549205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.549288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.549314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.549406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.549514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.549540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.549656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.549764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.549790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.549871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.549955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.549981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.550094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.550180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.550206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.550294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.550375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.550403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.550484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.550591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.550617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.550693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.550767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.550793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.550905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.550985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.551012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.551093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.551210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.551236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.895 qpair failed and we were unable to recover it. 00:30:19.895 [2024-10-30 16:14:09.551356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.551439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.895 [2024-10-30 16:14:09.551466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.551552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.551656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.551682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.551762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.551874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.551900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.551980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.552055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.552081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.552172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.552254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.552286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.552403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.552492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.552518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.552629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.552721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.552747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.552857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.552930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.552956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.553036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.553111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.553137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.553247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.553344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.553370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.553447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.553534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.553562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.553676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.553755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.553781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.553863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.553937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.553964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.554058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.554134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.554160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.554246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.554336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.554364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.554484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.554574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.554600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.554690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.554771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.554797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.554888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.554968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.554995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.555103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.555183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.555209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.555293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.555371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.555397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.555505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.555583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.555608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.555715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.555794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.555819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.555904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.555987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.556014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.556106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.556209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.556236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.556326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.556417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.556445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.556528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.556640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.556666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.556745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.556887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.556913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.557001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.557081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.557109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.557193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.557308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.557335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.557446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.557526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.557552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.557639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.557750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.896 [2024-10-30 16:14:09.557777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.896 qpair failed and we were unable to recover it. 00:30:19.896 [2024-10-30 16:14:09.557857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.558134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.558159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.558240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.558356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.558383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.558466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.558547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.558573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 16:14:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:19.897 [2024-10-30 16:14:09.558683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 16:14:09 -- common/autotest_common.sh@852 -- # return 0 00:30:19.897 [2024-10-30 16:14:09.558795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.558822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 16:14:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:19.897 [2024-10-30 16:14:09.558913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 16:14:09 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:19.897 [2024-10-30 16:14:09.558995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.559022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 16:14:09 -- common/autotest_common.sh@10 -- # set +x 00:30:19.897 [2024-10-30 16:14:09.559133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.559213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.559239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc550000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.559366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.559457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.559484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.559570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.559651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.559677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.559788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.559892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.559918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.560002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.560081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.560108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.560249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.560333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.560359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.560446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.560519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.560550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.560628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.560705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.560730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.560842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.560922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.560949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.561066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.561164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.561192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.561278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.561388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.561414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.561500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.561608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.561634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.561711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.561791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.561817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.561934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.562040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.562065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.562207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.562284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.562311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.562393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.562468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.562494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.562635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.562712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.562744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.562839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.562930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.562956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.563047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.563132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.563157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.563248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.563347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.563372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.563449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.563529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.897 [2024-10-30 16:14:09.563555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.897 qpair failed and we were unable to recover it. 00:30:19.897 [2024-10-30 16:14:09.563644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.563751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.563778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.563889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.563969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.563995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.564070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.564152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.564178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.564267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.564377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.564403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.564490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.564585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.564612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.564689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.564775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.564806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.564918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.565005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.565031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.565143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.565266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.565293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.565378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.565458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.565483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.565570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.565657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.565683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.565795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.565875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.565901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.566053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.566130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.566157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.566242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.566334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.566360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.566449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.566528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.566553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.566632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.566721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.566747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.566856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.566976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.567006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.567133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.567208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.567233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.567333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.567412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.567439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.567529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.567613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.567639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.567758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.567833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.567858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.567931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.568017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.568044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.568130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.568215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.568242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.568335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.568420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.568446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.568568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.568652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.568678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.568784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.568894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.568920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.569033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.569117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.569143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.569279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.569369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.569395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.569477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.569556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.569588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.569671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.569745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.569770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.569853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.569945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.898 [2024-10-30 16:14:09.569971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.898 qpair failed and we were unable to recover it. 00:30:19.898 [2024-10-30 16:14:09.570085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.570158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.570183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.570276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.570365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.570392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.570501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.570588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.570613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.570710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.570793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.570819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.570916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.571024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.571049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.571127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.571237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.571273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.571366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.571440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.571466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.571587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.571694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.571720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.571803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.571888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.571914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.572000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.572076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.572101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.572223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.572310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.572336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.572409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.572486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.572511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.572607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.572719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.572745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.572857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.572997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.573032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.573165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.573278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.573316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.573403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.573478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.573504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.573605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.573711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.573737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.573849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.573926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.573952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.574028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.574132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.574157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.574282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.574368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.574395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.574485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.574566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.574593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.574670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.574775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.574801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.574927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.575043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.575069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.575181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.575266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.575293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.575372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.575451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.575477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.575598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 16:14:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:19.899 [2024-10-30 16:14:09.575706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.575742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 16:14:09 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:19.899 [2024-10-30 16:14:09.575859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 16:14:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.899 [2024-10-30 16:14:09.575942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.575969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 16:14:09 -- common/autotest_common.sh@10 -- # set +x 00:30:19.899 [2024-10-30 16:14:09.576054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.576139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.576165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.576292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.576376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.576402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.899 qpair failed and we were unable to recover it. 00:30:19.899 [2024-10-30 16:14:09.576512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.899 [2024-10-30 16:14:09.576592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.576618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.576703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.576782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.576808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.576921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.577026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.577052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.577133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.577206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.577230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.577366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.577442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.577468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.577549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.577665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.577691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.577774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.577845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.577870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.577979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.578084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.578109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.578204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.578311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.578337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.578428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.578502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.578527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.578649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.578755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.578780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.578860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.578933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.578958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.579048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.579128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.579154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.579235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.579331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.579358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.579438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.579547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.579580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.579724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.579814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.579840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.579982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.580073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.580099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.580181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.580269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.580296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.580381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.580465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.580491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.580586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.580665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.580690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.580838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.580920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.580945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.581053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.581132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.581158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.581244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.581338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.581364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.581481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.581589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.581626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.581733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.581842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.581867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.581950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.582031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.582057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.582139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.582252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.582284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.582378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.582465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.582490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.582618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.582694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.582719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.900 qpair failed and we were unable to recover it. 00:30:19.900 [2024-10-30 16:14:09.582812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.900 [2024-10-30 16:14:09.582925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.582951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.583072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.583178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.583204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.583304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.583391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.583417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.583498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.583589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.583616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.583706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.583820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.583846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.583966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.584105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.584131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.584249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.584337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.584364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.584475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.584571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.584597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.584685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.584768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.584793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.584877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.584985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.585010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.585101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.585208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.585233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.585375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.585462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.585489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.585609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.585702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.585728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.585811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.585924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.585949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.586029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.586142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.586167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.586247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.586351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.586377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.586485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.586607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.586633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.586725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.586819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.586845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.586952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.587046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.587071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.587149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.587264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.587291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.587380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.587468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.587495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.587588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.587706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.587730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.587841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.587944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.587968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.588084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.588172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.588198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.588282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.588358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.588384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.588491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.588612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.588638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.588720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.588834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.588860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.588951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.589029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.589058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.589198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.589313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.589339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.589422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.589498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.589525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.589617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.589724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.589748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.589827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.589900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.589926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.901 [2024-10-30 16:14:09.590005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.590085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.901 [2024-10-30 16:14:09.590110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.901 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.590186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.590272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.590299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.590410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.590494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.590520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.590645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.590722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.590747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.590830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.590935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.590961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.591100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.591180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.591210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.591306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.591385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.591411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.591503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.591587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.591613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.591694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.591807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.591831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.591938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.592043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.592067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.592188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.592274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.592300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.592412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.592491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.592517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.592609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.592724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.592751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.592837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.592944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.592971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.593087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.593194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.593220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.593342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.593421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.593451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.593536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.593661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.593687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.593765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.593844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.593869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.593982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.594053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.594080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.594195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.594323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.594350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.594449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.594560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.594585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.594668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.594778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.594804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.594890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.594970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.594995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.595112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.595226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.595267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.595360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.595471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.595497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.595587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.595730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.595756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.595876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.595987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.596015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.596101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.596188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.596213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.596338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.596419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.596446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.596594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.596678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.902 [2024-10-30 16:14:09.596704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.902 qpair failed and we were unable to recover it. 00:30:19.902 [2024-10-30 16:14:09.596797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.596946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.596973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.597051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.597161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.597186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc558000b90 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.597312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.597417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.597448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.597538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.597681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.597707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.597790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.597881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.597907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.597995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.598074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.598099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 Malloc0 00:30:19.903 [2024-10-30 16:14:09.598196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.598330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.598357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.598468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 16:14:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.903 [2024-10-30 16:14:09.598586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.598621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 16:14:09 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:19.903 [2024-10-30 16:14:09.598740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 16:14:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.903 [2024-10-30 16:14:09.598849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.598874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 16:14:09 -- common/autotest_common.sh@10 -- # set +x 00:30:19.903 [2024-10-30 16:14:09.598948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.599033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.599059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.599145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.599228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.599271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.599360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.599434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.599460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.599537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.599662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.599688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.599771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.599878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.599904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.599984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.600061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.600086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.600197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.600307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.600334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.600455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.600548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.600573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.600661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.600740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.600766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.600844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.600928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.600954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.601030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.601104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.601130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.601212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.601323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.601350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.601462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.601539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.601569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.601657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.601742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.601768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.601879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.601886] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:19.903 [2024-10-30 16:14:09.601989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.602013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.602094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.602182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.602206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.602299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.602386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.602413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.602502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.602615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.602640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.602721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.602798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.602836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.602930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.603007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.603032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.603149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.603227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.603266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.603347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.603434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.603464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.903 qpair failed and we were unable to recover it. 00:30:19.903 [2024-10-30 16:14:09.603584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.603679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.903 [2024-10-30 16:14:09.603704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.603787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.603871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.603897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.603984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.604067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.604092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.604172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.604265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.604291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.604403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.604509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.604539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.604634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.604714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.604740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.604848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.604927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.604952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.605027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.605104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.605130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.605237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.605331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.605357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.605441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.605526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.605562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.605673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.605778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.605804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.605919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.605994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.606020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.606111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.606225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.606263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.606352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.606432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.606457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.606543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.606649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.606679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.606764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.606847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.606872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.606953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.607030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.607055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.607136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.607245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.607277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.607399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.607505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.607530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.607626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.607703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.607728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.607814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.607893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.607918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.607995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.608079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.608105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.608192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.608314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.608340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.608437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.608521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.608546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.608654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.608729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.608754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.608842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.608956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.608982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.609061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.609136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.609161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.609281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.609364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.609390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.609507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.609589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.609623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.609732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.609812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.609837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.609948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.610030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.610054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 16:14:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.904 [2024-10-30 16:14:09.610140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 16:14:09 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:19.904 [2024-10-30 16:14:09.610224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.610265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.610346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 16:14:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.904 [2024-10-30 16:14:09.610428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.610454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 16:14:09 -- common/autotest_common.sh@10 -- # set +x 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.610571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.610648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.610674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.610783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.610871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.610896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.904 qpair failed and we were unable to recover it. 00:30:19.904 [2024-10-30 16:14:09.610983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.611093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.904 [2024-10-30 16:14:09.611118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.611230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.611322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.611348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.611427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.611566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.611591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.611731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.611805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.611831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.611922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.611997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.612021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.612104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.612177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.612202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.612311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.612392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.612418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.612502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.612615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.612641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.612720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.612834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.612860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.612956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.613036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.613065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.613148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.613288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.613314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.613402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.613484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.613509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.613664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.613774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.613799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.613916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.614026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.614051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.614131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.614210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.614235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.614353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.614435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.614461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.614548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.614633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.614659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.614751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.614831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.614856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.614938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.615043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.615068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.615158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.615269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.615300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.615378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.615457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.615483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.615574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.615683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.615708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.615787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.615891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.615916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.616035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.616125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.616150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.616232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.616323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.616349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.616439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.616512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.616539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.616636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.616760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.616784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.616867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.616950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.616975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.617086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.617168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.617193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.617285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.617425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.617451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.617535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.617657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.617682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.617765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.617878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.617904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.905 [2024-10-30 16:14:09.617984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.618065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.905 [2024-10-30 16:14:09.618092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.905 qpair failed and we were unable to recover it. 00:30:19.906 16:14:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.906 [2024-10-30 16:14:09.618208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 16:14:09 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:19.906 [2024-10-30 16:14:09.618376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.618404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 16:14:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.906 [2024-10-30 16:14:09.618493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 16:14:09 -- common/autotest_common.sh@10 -- # set +x 00:30:19.906 [2024-10-30 16:14:09.618584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.618609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.618699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.618790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.618815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.618897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.618975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.619000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.619107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.619184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.619209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.619308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.619381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.619407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.619526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.619645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.619671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.619777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.619861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.619887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.619976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.620083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.620107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.620218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.620300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.620326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.620413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.620492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.620518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.620604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.620696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.620722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.620812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.620915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.620951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.621061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.621166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.621192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.621285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.621391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.621417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.621496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.621583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.621608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.621728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.621835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.621864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.621951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.622034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.622060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.622141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.622260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.622287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.622374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.622462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.622487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.622573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.622660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.622686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.622779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.622865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.622890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.623007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.623112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.623137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.623225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.623343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.623368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.623484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.623572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.623597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.623708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.623796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.623821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.623933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.624037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.624067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.624149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.624266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.624291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.624374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.624448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.624473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.624572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.624649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.624674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.624757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.624832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.624856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.624933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.625013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.625037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.625151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.625230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.625268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.625349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.625461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.625487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.906 qpair failed and we were unable to recover it. 00:30:19.906 [2024-10-30 16:14:09.625612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.906 [2024-10-30 16:14:09.625694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.625719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.625841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.625927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.625953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.626065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.626143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.626169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 16:14:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.626297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 16:14:09 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:19.907 [2024-10-30 16:14:09.626380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.626405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 16:14:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.907 [2024-10-30 16:14:09.626500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 16:14:09 -- common/autotest_common.sh@10 -- # set +x 00:30:19.907 [2024-10-30 16:14:09.626618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.626643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.626727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.626808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.626835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.626925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.627032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.627058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.627144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.627230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.627265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.627353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.627433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.627459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.627575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.627711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.627738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.627830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.627943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.627968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.628054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.628134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.628159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.628278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.628368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.628394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.628481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.628594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.628620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.628731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.628815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.628840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.628925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.629030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.629056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.629199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.629286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.629312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.629405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.629487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.629513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.629609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.629694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.629720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.629807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.629891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.629916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2303f20 with addr=10.0.0.2, port=4420 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.630025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.907 [2024-10-30 16:14:09.630127] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:19.907 [2024-10-30 16:14:09.632845] posix.c: 670:posix_sock_psk_use_session_client_cb: *ERROR*: PSK is not set 00:30:19.907 [2024-10-30 16:14:09.632921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2303f20 (107): Transport endpoint is not connected 00:30:19.907 [2024-10-30 16:14:09.632988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 16:14:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.907 16:14:09 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:19.907 16:14:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:19.907 16:14:09 -- common/autotest_common.sh@10 -- # set +x 00:30:19.907 16:14:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:19.907 16:14:09 -- host/target_disconnect.sh@58 -- # wait 2549473 00:30:19.907 [2024-10-30 16:14:09.642508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.907 [2024-10-30 16:14:09.642642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.907 [2024-10-30 16:14:09.642671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.907 [2024-10-30 16:14:09.642687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.907 [2024-10-30 16:14:09.642701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:19.907 [2024-10-30 16:14:09.642731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.652492] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.907 [2024-10-30 16:14:09.652585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.907 [2024-10-30 16:14:09.652612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.907 [2024-10-30 16:14:09.652627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.907 [2024-10-30 16:14:09.652641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:19.907 [2024-10-30 16:14:09.652670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.662542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.907 [2024-10-30 16:14:09.662662] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.907 [2024-10-30 16:14:09.662688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.907 [2024-10-30 16:14:09.662703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.907 [2024-10-30 16:14:09.662717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:19.907 [2024-10-30 16:14:09.662746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.672487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.907 [2024-10-30 16:14:09.672580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.907 [2024-10-30 16:14:09.672607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.907 [2024-10-30 16:14:09.672622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.907 [2024-10-30 16:14:09.672636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:19.907 [2024-10-30 16:14:09.672665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.682546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.907 [2024-10-30 16:14:09.682647] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.907 [2024-10-30 16:14:09.682679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.907 [2024-10-30 16:14:09.682695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.907 [2024-10-30 16:14:09.682708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:19.907 [2024-10-30 16:14:09.682737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:19.907 qpair failed and we were unable to recover it. 00:30:19.907 [2024-10-30 16:14:09.692541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.907 [2024-10-30 16:14:09.692638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.907 [2024-10-30 16:14:09.692668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.907 [2024-10-30 16:14:09.692685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.907 [2024-10-30 16:14:09.692699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:19.907 [2024-10-30 16:14:09.692729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:19.908 qpair failed and we were unable to recover it. 00:30:19.908 [2024-10-30 16:14:09.702538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:19.908 [2024-10-30 16:14:09.702640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:19.908 [2024-10-30 16:14:09.702666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:19.908 [2024-10-30 16:14:09.702681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:19.908 [2024-10-30 16:14:09.702695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:19.908 [2024-10-30 16:14:09.702725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:19.908 qpair failed and we were unable to recover it. 00:30:20.166 [2024-10-30 16:14:09.712553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.166 [2024-10-30 16:14:09.712651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.166 [2024-10-30 16:14:09.712679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.166 [2024-10-30 16:14:09.712696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.166 [2024-10-30 16:14:09.712711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.166 [2024-10-30 16:14:09.712741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-10-30 16:14:09.722539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.166 [2024-10-30 16:14:09.722639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.166 [2024-10-30 16:14:09.722667] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.166 [2024-10-30 16:14:09.722683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.166 [2024-10-30 16:14:09.722697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.166 [2024-10-30 16:14:09.722733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-10-30 16:14:09.732581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.166 [2024-10-30 16:14:09.732674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.166 [2024-10-30 16:14:09.732703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.166 [2024-10-30 16:14:09.732719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.166 [2024-10-30 16:14:09.732733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.166 [2024-10-30 16:14:09.732761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-10-30 16:14:09.742617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.166 [2024-10-30 16:14:09.742708] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.166 [2024-10-30 16:14:09.742733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.166 [2024-10-30 16:14:09.742748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.166 [2024-10-30 16:14:09.742762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.166 [2024-10-30 16:14:09.742791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-10-30 16:14:09.752642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.166 [2024-10-30 16:14:09.752733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.166 [2024-10-30 16:14:09.752763] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.166 [2024-10-30 16:14:09.752780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.166 [2024-10-30 16:14:09.752793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.166 [2024-10-30 16:14:09.752824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-10-30 16:14:09.762704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.166 [2024-10-30 16:14:09.762832] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.166 [2024-10-30 16:14:09.762858] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.166 [2024-10-30 16:14:09.762873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.166 [2024-10-30 16:14:09.762886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.166 [2024-10-30 16:14:09.762915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-10-30 16:14:09.772686] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.166 [2024-10-30 16:14:09.772792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.166 [2024-10-30 16:14:09.772826] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.166 [2024-10-30 16:14:09.772842] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.166 [2024-10-30 16:14:09.772856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.166 [2024-10-30 16:14:09.772884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-10-30 16:14:09.782718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.166 [2024-10-30 16:14:09.782820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.166 [2024-10-30 16:14:09.782846] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.166 [2024-10-30 16:14:09.782860] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.166 [2024-10-30 16:14:09.782874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.166 [2024-10-30 16:14:09.782903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-10-30 16:14:09.792769] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.166 [2024-10-30 16:14:09.792907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.166 [2024-10-30 16:14:09.792938] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.166 [2024-10-30 16:14:09.792954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.166 [2024-10-30 16:14:09.792968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.166 [2024-10-30 16:14:09.792998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.802771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.802864] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.802891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.802907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.802921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.802950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.812823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.812916] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.812942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.812956] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.812970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.813005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.822864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.822969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.822995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.823010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.823024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.823052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.832916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.833027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.833057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.833076] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.833090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.833122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.842934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.843030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.843057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.843072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.843086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.843115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.852961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.853052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.853077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.853090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.853103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.853131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.863026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.863125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.863157] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.863172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.863186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.863216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.873009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.873103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.873130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.873145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.873158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.873187] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.883047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.883162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.883188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.883203] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.883217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.883246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.893060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.893184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.893210] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.893225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.893239] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.893277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.903188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.903290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.903316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.903331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.903345] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.903380] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.913112] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.913206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.913232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.913247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.913269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.913299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.923173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.923304] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.923331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.923346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.923359] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.923389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.933181] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.933280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.933307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.933322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.933335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.933365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.943239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.943344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.943370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.943385] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.943398] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.943427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.953229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.953339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.953371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.953386] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.953399] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.953428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.963316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.963410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.963436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.963451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.963465] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.963493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.973293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.973381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.973406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.973420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.973434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.973463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.983355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.983454] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.983480] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.983494] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.983509] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.983547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:09.993355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:09.993463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:09.993489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:09.993504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:09.993523] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:09.993552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:10.003449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:10.003542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:10.003570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:10.003585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:10.003598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:10.003628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:10.013415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:10.013507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:10.013533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:10.013551] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:10.013564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:10.013593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:10.023565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:10.023666] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:10.023702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:10.023717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:10.023731] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:10.023761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:10.033557] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:10.033672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:10.033701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:10.033716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:10.033730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:10.033760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-10-30 16:14:10.043519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.167 [2024-10-30 16:14:10.043626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.167 [2024-10-30 16:14:10.043653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.167 [2024-10-30 16:14:10.043667] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.167 [2024-10-30 16:14:10.043681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.167 [2024-10-30 16:14:10.043711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.425 [2024-10-30 16:14:10.053584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.425 [2024-10-30 16:14:10.053705] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.425 [2024-10-30 16:14:10.053734] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.425 [2024-10-30 16:14:10.053749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.425 [2024-10-30 16:14:10.053763] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.425 [2024-10-30 16:14:10.053793] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.425 qpair failed and we were unable to recover it. 00:30:20.425 [2024-10-30 16:14:10.063581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.425 [2024-10-30 16:14:10.063683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.425 [2024-10-30 16:14:10.063709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.425 [2024-10-30 16:14:10.063723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.425 [2024-10-30 16:14:10.063737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.425 [2024-10-30 16:14:10.063766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.425 qpair failed and we were unable to recover it. 00:30:20.425 [2024-10-30 16:14:10.073621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.425 [2024-10-30 16:14:10.073716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.425 [2024-10-30 16:14:10.073743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.425 [2024-10-30 16:14:10.073757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.425 [2024-10-30 16:14:10.073771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.425 [2024-10-30 16:14:10.073800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.425 qpair failed and we were unable to recover it. 00:30:20.425 [2024-10-30 16:14:10.083707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.425 [2024-10-30 16:14:10.083805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.425 [2024-10-30 16:14:10.083832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.425 [2024-10-30 16:14:10.083846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.425 [2024-10-30 16:14:10.083866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.425 [2024-10-30 16:14:10.083895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.425 qpair failed and we were unable to recover it. 00:30:20.425 [2024-10-30 16:14:10.093693] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.425 [2024-10-30 16:14:10.093782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.425 [2024-10-30 16:14:10.093808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.425 [2024-10-30 16:14:10.093822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.425 [2024-10-30 16:14:10.093836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.425 [2024-10-30 16:14:10.093864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.425 qpair failed and we were unable to recover it. 00:30:20.425 [2024-10-30 16:14:10.103745] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.425 [2024-10-30 16:14:10.103869] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.425 [2024-10-30 16:14:10.103898] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.425 [2024-10-30 16:14:10.103913] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.425 [2024-10-30 16:14:10.103926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.425 [2024-10-30 16:14:10.103956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.425 qpair failed and we were unable to recover it. 00:30:20.425 [2024-10-30 16:14:10.113726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.425 [2024-10-30 16:14:10.113819] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.425 [2024-10-30 16:14:10.113845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.425 [2024-10-30 16:14:10.113860] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.425 [2024-10-30 16:14:10.113874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.425 [2024-10-30 16:14:10.113903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.425 qpair failed and we were unable to recover it. 00:30:20.425 [2024-10-30 16:14:10.123782] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.425 [2024-10-30 16:14:10.123876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.425 [2024-10-30 16:14:10.123903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.425 [2024-10-30 16:14:10.123918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.425 [2024-10-30 16:14:10.123932] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.425 [2024-10-30 16:14:10.123960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.425 qpair failed and we were unable to recover it. 00:30:20.425 [2024-10-30 16:14:10.133780] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.425 [2024-10-30 16:14:10.133893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.425 [2024-10-30 16:14:10.133920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.425 [2024-10-30 16:14:10.133944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.425 [2024-10-30 16:14:10.133956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.425 [2024-10-30 16:14:10.133986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.425 qpair failed and we were unable to recover it. 00:30:20.425 [2024-10-30 16:14:10.143894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.425 [2024-10-30 16:14:10.144029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.425 [2024-10-30 16:14:10.144054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.425 [2024-10-30 16:14:10.144071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.425 [2024-10-30 16:14:10.144085] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.425 [2024-10-30 16:14:10.144115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.425 qpair failed and we were unable to recover it. 00:30:20.425 [2024-10-30 16:14:10.153844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.425 [2024-10-30 16:14:10.153974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.425 [2024-10-30 16:14:10.153999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.425 [2024-10-30 16:14:10.154013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.425 [2024-10-30 16:14:10.154027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.425 [2024-10-30 16:14:10.154055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.425 qpair failed and we were unable to recover it. 00:30:20.425 [2024-10-30 16:14:10.163950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.425 [2024-10-30 16:14:10.164047] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.425 [2024-10-30 16:14:10.164071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.425 [2024-10-30 16:14:10.164085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.425 [2024-10-30 16:14:10.164098] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.425 [2024-10-30 16:14:10.164127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.425 qpair failed and we were unable to recover it. 00:30:20.425 [2024-10-30 16:14:10.173928] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.425 [2024-10-30 16:14:10.174021] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.426 [2024-10-30 16:14:10.174050] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.426 [2024-10-30 16:14:10.174065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.426 [2024-10-30 16:14:10.174085] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.426 [2024-10-30 16:14:10.174114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.426 qpair failed and we were unable to recover it. 00:30:20.426 [2024-10-30 16:14:10.183969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.426 [2024-10-30 16:14:10.184066] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.426 [2024-10-30 16:14:10.184092] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.426 [2024-10-30 16:14:10.184107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.426 [2024-10-30 16:14:10.184120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.426 [2024-10-30 16:14:10.184149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.426 qpair failed and we were unable to recover it. 00:30:20.426 [2024-10-30 16:14:10.193953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.426 [2024-10-30 16:14:10.194046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.426 [2024-10-30 16:14:10.194073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.426 [2024-10-30 16:14:10.194088] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.426 [2024-10-30 16:14:10.194102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.426 [2024-10-30 16:14:10.194130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.426 qpair failed and we were unable to recover it. 00:30:20.426 [2024-10-30 16:14:10.204004] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.426 [2024-10-30 16:14:10.204098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.426 [2024-10-30 16:14:10.204124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.426 [2024-10-30 16:14:10.204138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.426 [2024-10-30 16:14:10.204152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.426 [2024-10-30 16:14:10.204181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.426 qpair failed and we were unable to recover it. 00:30:20.426 [2024-10-30 16:14:10.214050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.426 [2024-10-30 16:14:10.214179] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.426 [2024-10-30 16:14:10.214205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.426 [2024-10-30 16:14:10.214220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.426 [2024-10-30 16:14:10.214233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.426 [2024-10-30 16:14:10.214280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.426 qpair failed and we were unable to recover it. 00:30:20.426 [2024-10-30 16:14:10.224065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.426 [2024-10-30 16:14:10.224168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.426 [2024-10-30 16:14:10.224194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.426 [2024-10-30 16:14:10.224209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.426 [2024-10-30 16:14:10.224222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.426 [2024-10-30 16:14:10.224266] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.426 qpair failed and we were unable to recover it. 00:30:20.426 [2024-10-30 16:14:10.234113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.426 [2024-10-30 16:14:10.234215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.426 [2024-10-30 16:14:10.234240] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.426 [2024-10-30 16:14:10.234266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.426 [2024-10-30 16:14:10.234280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.426 [2024-10-30 16:14:10.234310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.426 qpair failed and we were unable to recover it. 00:30:20.426 [2024-10-30 16:14:10.244120] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.426 [2024-10-30 16:14:10.244218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.426 [2024-10-30 16:14:10.244260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.426 [2024-10-30 16:14:10.244276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.426 [2024-10-30 16:14:10.244289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.426 [2024-10-30 16:14:10.244319] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.426 qpair failed and we were unable to recover it. 00:30:20.426 [2024-10-30 16:14:10.254112] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.426 [2024-10-30 16:14:10.254203] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.426 [2024-10-30 16:14:10.254229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.426 [2024-10-30 16:14:10.254249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.426 [2024-10-30 16:14:10.254269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.426 [2024-10-30 16:14:10.254299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.426 qpair failed and we were unable to recover it. 00:30:20.426 [2024-10-30 16:14:10.264168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.426 [2024-10-30 16:14:10.264274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.426 [2024-10-30 16:14:10.264299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.426 [2024-10-30 16:14:10.264314] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.426 [2024-10-30 16:14:10.264333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.426 [2024-10-30 16:14:10.264363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.426 qpair failed and we were unable to recover it. 00:30:20.426 [2024-10-30 16:14:10.274218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.426 [2024-10-30 16:14:10.274328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.426 [2024-10-30 16:14:10.274352] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.426 [2024-10-30 16:14:10.274366] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.426 [2024-10-30 16:14:10.274378] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.426 [2024-10-30 16:14:10.274409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.426 qpair failed and we were unable to recover it. 00:30:20.426 [2024-10-30 16:14:10.284220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.426 [2024-10-30 16:14:10.284329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.426 [2024-10-30 16:14:10.284356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.426 [2024-10-30 16:14:10.284370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.426 [2024-10-30 16:14:10.284384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.426 [2024-10-30 16:14:10.284413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.426 qpair failed and we were unable to recover it. 00:30:20.426 [2024-10-30 16:14:10.294276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.426 [2024-10-30 16:14:10.294384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.426 [2024-10-30 16:14:10.294412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.426 [2024-10-30 16:14:10.294430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.426 [2024-10-30 16:14:10.294444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.426 [2024-10-30 16:14:10.294474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.426 qpair failed and we were unable to recover it. 00:30:20.683 [2024-10-30 16:14:10.304302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.683 [2024-10-30 16:14:10.304402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.683 [2024-10-30 16:14:10.304430] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.683 [2024-10-30 16:14:10.304445] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.683 [2024-10-30 16:14:10.304460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.683 [2024-10-30 16:14:10.304491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.683 qpair failed and we were unable to recover it. 00:30:20.683 [2024-10-30 16:14:10.314318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.683 [2024-10-30 16:14:10.314413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.683 [2024-10-30 16:14:10.314443] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.683 [2024-10-30 16:14:10.314460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.683 [2024-10-30 16:14:10.314473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.683 [2024-10-30 16:14:10.314503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.683 qpair failed and we were unable to recover it. 00:30:20.683 [2024-10-30 16:14:10.324372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.683 [2024-10-30 16:14:10.324502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.683 [2024-10-30 16:14:10.324529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.683 [2024-10-30 16:14:10.324544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.683 [2024-10-30 16:14:10.324558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.683 [2024-10-30 16:14:10.324586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.683 qpair failed and we were unable to recover it. 00:30:20.683 [2024-10-30 16:14:10.334360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.683 [2024-10-30 16:14:10.334447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.683 [2024-10-30 16:14:10.334472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.683 [2024-10-30 16:14:10.334486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.683 [2024-10-30 16:14:10.334499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.683 [2024-10-30 16:14:10.334527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.683 qpair failed and we were unable to recover it. 00:30:20.683 [2024-10-30 16:14:10.344449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.683 [2024-10-30 16:14:10.344547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.683 [2024-10-30 16:14:10.344573] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.683 [2024-10-30 16:14:10.344589] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.683 [2024-10-30 16:14:10.344603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.683 [2024-10-30 16:14:10.344632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.683 qpair failed and we were unable to recover it. 00:30:20.683 [2024-10-30 16:14:10.354433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.683 [2024-10-30 16:14:10.354558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.683 [2024-10-30 16:14:10.354585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.683 [2024-10-30 16:14:10.354605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.683 [2024-10-30 16:14:10.354619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.683 [2024-10-30 16:14:10.354648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.683 qpair failed and we were unable to recover it. 00:30:20.683 [2024-10-30 16:14:10.364466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.683 [2024-10-30 16:14:10.364552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.683 [2024-10-30 16:14:10.364577] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.683 [2024-10-30 16:14:10.364591] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.683 [2024-10-30 16:14:10.364603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.683 [2024-10-30 16:14:10.364631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.683 qpair failed and we were unable to recover it. 00:30:20.683 [2024-10-30 16:14:10.374586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.683 [2024-10-30 16:14:10.374712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.683 [2024-10-30 16:14:10.374739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.683 [2024-10-30 16:14:10.374754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.683 [2024-10-30 16:14:10.374767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.683 [2024-10-30 16:14:10.374796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.683 qpair failed and we were unable to recover it. 00:30:20.683 [2024-10-30 16:14:10.384519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.683 [2024-10-30 16:14:10.384607] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.683 [2024-10-30 16:14:10.384632] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.683 [2024-10-30 16:14:10.384646] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.683 [2024-10-30 16:14:10.384658] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.683 [2024-10-30 16:14:10.384688] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.683 qpair failed and we were unable to recover it. 00:30:20.683 [2024-10-30 16:14:10.394569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.683 [2024-10-30 16:14:10.394654] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.683 [2024-10-30 16:14:10.394679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.683 [2024-10-30 16:14:10.394693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.683 [2024-10-30 16:14:10.394705] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.683 [2024-10-30 16:14:10.394733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.683 qpair failed and we were unable to recover it. 00:30:20.683 [2024-10-30 16:14:10.404577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.683 [2024-10-30 16:14:10.404692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.683 [2024-10-30 16:14:10.404717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.683 [2024-10-30 16:14:10.404733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.683 [2024-10-30 16:14:10.404746] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.683 [2024-10-30 16:14:10.404775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.683 qpair failed and we were unable to recover it. 00:30:20.683 [2024-10-30 16:14:10.414629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.683 [2024-10-30 16:14:10.414714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.683 [2024-10-30 16:14:10.414738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.683 [2024-10-30 16:14:10.414753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.683 [2024-10-30 16:14:10.414765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.683 [2024-10-30 16:14:10.414793] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.683 qpair failed and we were unable to recover it. 00:30:20.683 [2024-10-30 16:14:10.424681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.683 [2024-10-30 16:14:10.424770] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.683 [2024-10-30 16:14:10.424794] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.683 [2024-10-30 16:14:10.424808] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.683 [2024-10-30 16:14:10.424820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.683 [2024-10-30 16:14:10.424848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.683 qpair failed and we were unable to recover it. 00:30:20.683 [2024-10-30 16:14:10.434671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.683 [2024-10-30 16:14:10.434754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.683 [2024-10-30 16:14:10.434779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.683 [2024-10-30 16:14:10.434793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.683 [2024-10-30 16:14:10.434806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.683 [2024-10-30 16:14:10.434833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.683 qpair failed and we were unable to recover it. 00:30:20.684 [2024-10-30 16:14:10.444728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.684 [2024-10-30 16:14:10.444807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.684 [2024-10-30 16:14:10.444832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.684 [2024-10-30 16:14:10.444852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.684 [2024-10-30 16:14:10.444866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.684 [2024-10-30 16:14:10.444895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.684 qpair failed and we were unable to recover it. 00:30:20.684 [2024-10-30 16:14:10.454728] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.684 [2024-10-30 16:14:10.454826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.684 [2024-10-30 16:14:10.454855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.684 [2024-10-30 16:14:10.454870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.684 [2024-10-30 16:14:10.454884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.684 [2024-10-30 16:14:10.454914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.684 qpair failed and we were unable to recover it. 00:30:20.684 [2024-10-30 16:14:10.464811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.684 [2024-10-30 16:14:10.464903] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.684 [2024-10-30 16:14:10.464929] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.684 [2024-10-30 16:14:10.464944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.684 [2024-10-30 16:14:10.464957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.684 [2024-10-30 16:14:10.464986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.684 qpair failed and we were unable to recover it. 00:30:20.684 [2024-10-30 16:14:10.474798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.684 [2024-10-30 16:14:10.474884] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.684 [2024-10-30 16:14:10.474910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.684 [2024-10-30 16:14:10.474925] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.684 [2024-10-30 16:14:10.474938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.684 [2024-10-30 16:14:10.474966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.684 qpair failed and we were unable to recover it. 00:30:20.684 [2024-10-30 16:14:10.484839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.684 [2024-10-30 16:14:10.484931] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.684 [2024-10-30 16:14:10.484956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.684 [2024-10-30 16:14:10.484969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.684 [2024-10-30 16:14:10.484982] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.684 [2024-10-30 16:14:10.485010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.684 qpair failed and we were unable to recover it. 00:30:20.684 [2024-10-30 16:14:10.494843] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.684 [2024-10-30 16:14:10.494930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.684 [2024-10-30 16:14:10.494955] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.684 [2024-10-30 16:14:10.494969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.684 [2024-10-30 16:14:10.494981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.684 [2024-10-30 16:14:10.495010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.684 qpair failed and we were unable to recover it. 00:30:20.684 [2024-10-30 16:14:10.504938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.684 [2024-10-30 16:14:10.505075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.684 [2024-10-30 16:14:10.505102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.684 [2024-10-30 16:14:10.505117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.684 [2024-10-30 16:14:10.505130] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.684 [2024-10-30 16:14:10.505159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.684 qpair failed and we were unable to recover it. 00:30:20.684 [2024-10-30 16:14:10.514918] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.684 [2024-10-30 16:14:10.515061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.684 [2024-10-30 16:14:10.515091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.684 [2024-10-30 16:14:10.515107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.684 [2024-10-30 16:14:10.515121] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.684 [2024-10-30 16:14:10.515149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.684 qpair failed and we were unable to recover it. 00:30:20.684 [2024-10-30 16:14:10.524926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.684 [2024-10-30 16:14:10.525008] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.684 [2024-10-30 16:14:10.525033] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.684 [2024-10-30 16:14:10.525047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.684 [2024-10-30 16:14:10.525060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.684 [2024-10-30 16:14:10.525089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.684 qpair failed and we were unable to recover it. 00:30:20.684 [2024-10-30 16:14:10.534980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.684 [2024-10-30 16:14:10.535070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.684 [2024-10-30 16:14:10.535095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.684 [2024-10-30 16:14:10.535116] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.684 [2024-10-30 16:14:10.535129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.684 [2024-10-30 16:14:10.535158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.684 qpair failed and we were unable to recover it. 00:30:20.684 [2024-10-30 16:14:10.545055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.684 [2024-10-30 16:14:10.545152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.684 [2024-10-30 16:14:10.545178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.684 [2024-10-30 16:14:10.545192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.684 [2024-10-30 16:14:10.545204] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.684 [2024-10-30 16:14:10.545232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.684 qpair failed and we were unable to recover it. 00:30:20.684 [2024-10-30 16:14:10.555051] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.684 [2024-10-30 16:14:10.555139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.684 [2024-10-30 16:14:10.555164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.684 [2024-10-30 16:14:10.555178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.684 [2024-10-30 16:14:10.555191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.684 [2024-10-30 16:14:10.555220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.684 qpair failed and we were unable to recover it. 00:30:20.942 [2024-10-30 16:14:10.565041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.942 [2024-10-30 16:14:10.565127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.942 [2024-10-30 16:14:10.565154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.942 [2024-10-30 16:14:10.565170] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.942 [2024-10-30 16:14:10.565182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.942 [2024-10-30 16:14:10.565212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.942 qpair failed and we were unable to recover it. 00:30:20.942 [2024-10-30 16:14:10.575167] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.942 [2024-10-30 16:14:10.575252] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.942 [2024-10-30 16:14:10.575284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.942 [2024-10-30 16:14:10.575299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.942 [2024-10-30 16:14:10.575312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.942 [2024-10-30 16:14:10.575341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.942 qpair failed and we were unable to recover it. 00:30:20.942 [2024-10-30 16:14:10.585099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.942 [2024-10-30 16:14:10.585228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.942 [2024-10-30 16:14:10.585254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.942 [2024-10-30 16:14:10.585277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.942 [2024-10-30 16:14:10.585291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.942 [2024-10-30 16:14:10.585320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.942 qpair failed and we were unable to recover it. 00:30:20.942 [2024-10-30 16:14:10.595140] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.942 [2024-10-30 16:14:10.595231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.942 [2024-10-30 16:14:10.595262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.942 [2024-10-30 16:14:10.595279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.942 [2024-10-30 16:14:10.595292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.942 [2024-10-30 16:14:10.595320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.942 qpair failed and we were unable to recover it. 00:30:20.942 [2024-10-30 16:14:10.605175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.942 [2024-10-30 16:14:10.605267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.942 [2024-10-30 16:14:10.605292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.942 [2024-10-30 16:14:10.605307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.942 [2024-10-30 16:14:10.605319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.942 [2024-10-30 16:14:10.605348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.942 qpair failed and we were unable to recover it. 00:30:20.942 [2024-10-30 16:14:10.615187] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.942 [2024-10-30 16:14:10.615280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.942 [2024-10-30 16:14:10.615306] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.942 [2024-10-30 16:14:10.615320] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.942 [2024-10-30 16:14:10.615333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.942 [2024-10-30 16:14:10.615361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.942 qpair failed and we were unable to recover it. 00:30:20.942 [2024-10-30 16:14:10.625270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.942 [2024-10-30 16:14:10.625362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.942 [2024-10-30 16:14:10.625388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.942 [2024-10-30 16:14:10.625409] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.942 [2024-10-30 16:14:10.625422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.942 [2024-10-30 16:14:10.625451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.942 qpair failed and we were unable to recover it. 00:30:20.942 [2024-10-30 16:14:10.635244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.942 [2024-10-30 16:14:10.635334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.942 [2024-10-30 16:14:10.635358] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.942 [2024-10-30 16:14:10.635373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.942 [2024-10-30 16:14:10.635386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.942 [2024-10-30 16:14:10.635414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.942 qpair failed and we were unable to recover it. 00:30:20.942 [2024-10-30 16:14:10.645279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.942 [2024-10-30 16:14:10.645368] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.942 [2024-10-30 16:14:10.645392] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.942 [2024-10-30 16:14:10.645406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.942 [2024-10-30 16:14:10.645418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.942 [2024-10-30 16:14:10.645447] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.942 qpair failed and we were unable to recover it. 00:30:20.942 [2024-10-30 16:14:10.655330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.942 [2024-10-30 16:14:10.655419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.942 [2024-10-30 16:14:10.655444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.942 [2024-10-30 16:14:10.655458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.942 [2024-10-30 16:14:10.655470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.942 [2024-10-30 16:14:10.655499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.942 qpair failed and we were unable to recover it. 00:30:20.942 [2024-10-30 16:14:10.665357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.942 [2024-10-30 16:14:10.665450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.942 [2024-10-30 16:14:10.665475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.942 [2024-10-30 16:14:10.665488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.942 [2024-10-30 16:14:10.665501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.942 [2024-10-30 16:14:10.665530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.942 qpair failed and we were unable to recover it. 00:30:20.942 [2024-10-30 16:14:10.675400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.942 [2024-10-30 16:14:10.675503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.942 [2024-10-30 16:14:10.675529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.942 [2024-10-30 16:14:10.675543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.942 [2024-10-30 16:14:10.675556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.942 [2024-10-30 16:14:10.675586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.942 qpair failed and we were unable to recover it. 00:30:20.942 [2024-10-30 16:14:10.685408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.942 [2024-10-30 16:14:10.685494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.942 [2024-10-30 16:14:10.685519] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.942 [2024-10-30 16:14:10.685533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.943 [2024-10-30 16:14:10.685546] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.943 [2024-10-30 16:14:10.685574] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.943 qpair failed and we were unable to recover it. 00:30:20.943 [2024-10-30 16:14:10.695462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.943 [2024-10-30 16:14:10.695549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.943 [2024-10-30 16:14:10.695574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.943 [2024-10-30 16:14:10.695588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.943 [2024-10-30 16:14:10.695601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.943 [2024-10-30 16:14:10.695630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.943 qpair failed and we were unable to recover it. 00:30:20.943 [2024-10-30 16:14:10.705485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.943 [2024-10-30 16:14:10.705615] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.943 [2024-10-30 16:14:10.705640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.943 [2024-10-30 16:14:10.705654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.943 [2024-10-30 16:14:10.705667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.943 [2024-10-30 16:14:10.705696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.943 qpair failed and we were unable to recover it. 00:30:20.943 [2024-10-30 16:14:10.715505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.943 [2024-10-30 16:14:10.715593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.943 [2024-10-30 16:14:10.715623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.943 [2024-10-30 16:14:10.715639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.943 [2024-10-30 16:14:10.715651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.943 [2024-10-30 16:14:10.715681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.943 qpair failed and we were unable to recover it. 00:30:20.943 [2024-10-30 16:14:10.725577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.943 [2024-10-30 16:14:10.725683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.943 [2024-10-30 16:14:10.725711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.943 [2024-10-30 16:14:10.725727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.943 [2024-10-30 16:14:10.725740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.943 [2024-10-30 16:14:10.725771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.943 qpair failed and we were unable to recover it. 00:30:20.943 [2024-10-30 16:14:10.735544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.943 [2024-10-30 16:14:10.735642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.943 [2024-10-30 16:14:10.735667] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.943 [2024-10-30 16:14:10.735682] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.943 [2024-10-30 16:14:10.735695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.943 [2024-10-30 16:14:10.735725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.943 qpair failed and we were unable to recover it. 00:30:20.943 [2024-10-30 16:14:10.745595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.943 [2024-10-30 16:14:10.745706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.943 [2024-10-30 16:14:10.745731] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.943 [2024-10-30 16:14:10.745745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.943 [2024-10-30 16:14:10.745758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.943 [2024-10-30 16:14:10.745787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.943 qpair failed and we were unable to recover it. 00:30:20.943 [2024-10-30 16:14:10.755612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.943 [2024-10-30 16:14:10.755700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.943 [2024-10-30 16:14:10.755730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.943 [2024-10-30 16:14:10.755747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.943 [2024-10-30 16:14:10.755759] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.943 [2024-10-30 16:14:10.755789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.943 qpair failed and we were unable to recover it. 00:30:20.943 [2024-10-30 16:14:10.765663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.943 [2024-10-30 16:14:10.765783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.943 [2024-10-30 16:14:10.765810] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.943 [2024-10-30 16:14:10.765825] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.943 [2024-10-30 16:14:10.765838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.943 [2024-10-30 16:14:10.765867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.943 qpair failed and we were unable to recover it. 00:30:20.943 [2024-10-30 16:14:10.775700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.943 [2024-10-30 16:14:10.775825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.943 [2024-10-30 16:14:10.775852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.943 [2024-10-30 16:14:10.775867] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.943 [2024-10-30 16:14:10.775880] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.943 [2024-10-30 16:14:10.775910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.943 qpair failed and we were unable to recover it. 00:30:20.943 [2024-10-30 16:14:10.785720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.943 [2024-10-30 16:14:10.785847] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.943 [2024-10-30 16:14:10.785873] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.943 [2024-10-30 16:14:10.785888] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.943 [2024-10-30 16:14:10.785901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.943 [2024-10-30 16:14:10.785932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.943 qpair failed and we were unable to recover it. 00:30:20.943 [2024-10-30 16:14:10.795700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.943 [2024-10-30 16:14:10.795834] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.943 [2024-10-30 16:14:10.795860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.943 [2024-10-30 16:14:10.795874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.943 [2024-10-30 16:14:10.795887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.943 [2024-10-30 16:14:10.795917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.943 qpair failed and we were unable to recover it. 00:30:20.943 [2024-10-30 16:14:10.805768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.943 [2024-10-30 16:14:10.805857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.943 [2024-10-30 16:14:10.805887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.943 [2024-10-30 16:14:10.805903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.943 [2024-10-30 16:14:10.805916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.943 [2024-10-30 16:14:10.805946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.943 qpair failed and we were unable to recover it. 00:30:20.943 [2024-10-30 16:14:10.815755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:20.943 [2024-10-30 16:14:10.815857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:20.943 [2024-10-30 16:14:10.815884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:20.943 [2024-10-30 16:14:10.815899] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:20.943 [2024-10-30 16:14:10.815912] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:20.943 [2024-10-30 16:14:10.815948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:20.943 qpair failed and we were unable to recover it. 00:30:21.202 [2024-10-30 16:14:10.825853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.202 [2024-10-30 16:14:10.825945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.202 [2024-10-30 16:14:10.825972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.202 [2024-10-30 16:14:10.825986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.202 [2024-10-30 16:14:10.825999] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.202 [2024-10-30 16:14:10.826029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.202 qpair failed and we were unable to recover it. 00:30:21.202 [2024-10-30 16:14:10.835838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.202 [2024-10-30 16:14:10.835953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.202 [2024-10-30 16:14:10.835984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.202 [2024-10-30 16:14:10.835999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.202 [2024-10-30 16:14:10.836012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.202 [2024-10-30 16:14:10.836042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.202 qpair failed and we were unable to recover it. 00:30:21.202 [2024-10-30 16:14:10.845854] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.202 [2024-10-30 16:14:10.845942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.202 [2024-10-30 16:14:10.845968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.202 [2024-10-30 16:14:10.845984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.202 [2024-10-30 16:14:10.845997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.202 [2024-10-30 16:14:10.846032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.202 qpair failed and we were unable to recover it. 00:30:21.202 [2024-10-30 16:14:10.855882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.202 [2024-10-30 16:14:10.855971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.202 [2024-10-30 16:14:10.855998] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.202 [2024-10-30 16:14:10.856013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.202 [2024-10-30 16:14:10.856027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.202 [2024-10-30 16:14:10.856057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.202 qpair failed and we were unable to recover it. 00:30:21.202 [2024-10-30 16:14:10.865930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.202 [2024-10-30 16:14:10.866018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.202 [2024-10-30 16:14:10.866045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.202 [2024-10-30 16:14:10.866059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.202 [2024-10-30 16:14:10.866072] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.202 [2024-10-30 16:14:10.866102] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.202 qpair failed and we were unable to recover it. 00:30:21.202 [2024-10-30 16:14:10.876008] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.202 [2024-10-30 16:14:10.876139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.202 [2024-10-30 16:14:10.876166] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.202 [2024-10-30 16:14:10.876180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.202 [2024-10-30 16:14:10.876194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.202 [2024-10-30 16:14:10.876222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.202 qpair failed and we were unable to recover it. 00:30:21.202 [2024-10-30 16:14:10.885966] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.202 [2024-10-30 16:14:10.886053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.202 [2024-10-30 16:14:10.886079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.202 [2024-10-30 16:14:10.886093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.202 [2024-10-30 16:14:10.886105] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.202 [2024-10-30 16:14:10.886134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.202 qpair failed and we were unable to recover it. 00:30:21.202 [2024-10-30 16:14:10.895990] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.202 [2024-10-30 16:14:10.896085] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.202 [2024-10-30 16:14:10.896113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.202 [2024-10-30 16:14:10.896129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.202 [2024-10-30 16:14:10.896142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.202 [2024-10-30 16:14:10.896170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.202 qpair failed and we were unable to recover it. 00:30:21.202 [2024-10-30 16:14:10.906070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.202 [2024-10-30 16:14:10.906162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:10.906187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:10.906201] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.203 [2024-10-30 16:14:10.906213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.203 [2024-10-30 16:14:10.906241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.203 qpair failed and we were unable to recover it. 00:30:21.203 [2024-10-30 16:14:10.916075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.203 [2024-10-30 16:14:10.916204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:10.916228] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:10.916243] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.203 [2024-10-30 16:14:10.916264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.203 [2024-10-30 16:14:10.916302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.203 qpair failed and we were unable to recover it. 00:30:21.203 [2024-10-30 16:14:10.926087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.203 [2024-10-30 16:14:10.926176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:10.926201] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:10.926215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.203 [2024-10-30 16:14:10.926228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.203 [2024-10-30 16:14:10.926263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.203 qpair failed and we were unable to recover it. 00:30:21.203 [2024-10-30 16:14:10.936111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.203 [2024-10-30 16:14:10.936194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:10.936219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:10.936233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.203 [2024-10-30 16:14:10.936245] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.203 [2024-10-30 16:14:10.936286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.203 qpair failed and we were unable to recover it. 00:30:21.203 [2024-10-30 16:14:10.946188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.203 [2024-10-30 16:14:10.946287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:10.946312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:10.946327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.203 [2024-10-30 16:14:10.946339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.203 [2024-10-30 16:14:10.946367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.203 qpair failed and we were unable to recover it. 00:30:21.203 [2024-10-30 16:14:10.956217] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.203 [2024-10-30 16:14:10.956332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:10.956360] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:10.956377] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.203 [2024-10-30 16:14:10.956391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.203 [2024-10-30 16:14:10.956422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.203 qpair failed and we were unable to recover it. 00:30:21.203 [2024-10-30 16:14:10.966215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.203 [2024-10-30 16:14:10.966305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:10.966330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:10.966344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.203 [2024-10-30 16:14:10.966357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.203 [2024-10-30 16:14:10.966386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.203 qpair failed and we were unable to recover it. 00:30:21.203 [2024-10-30 16:14:10.976234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.203 [2024-10-30 16:14:10.976326] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:10.976352] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:10.976366] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.203 [2024-10-30 16:14:10.976379] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.203 [2024-10-30 16:14:10.976408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.203 qpair failed and we were unable to recover it. 00:30:21.203 [2024-10-30 16:14:10.986284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.203 [2024-10-30 16:14:10.986372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:10.986402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:10.986417] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.203 [2024-10-30 16:14:10.986431] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.203 [2024-10-30 16:14:10.986459] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.203 qpair failed and we were unable to recover it. 00:30:21.203 [2024-10-30 16:14:10.996318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.203 [2024-10-30 16:14:10.996412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:10.996437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:10.996451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.203 [2024-10-30 16:14:10.996465] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.203 [2024-10-30 16:14:10.996494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.203 qpair failed and we were unable to recover it. 00:30:21.203 [2024-10-30 16:14:11.006344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.203 [2024-10-30 16:14:11.006430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:11.006455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:11.006469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.203 [2024-10-30 16:14:11.006482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.203 [2024-10-30 16:14:11.006511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.203 qpair failed and we were unable to recover it. 00:30:21.203 [2024-10-30 16:14:11.016361] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.203 [2024-10-30 16:14:11.016483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:11.016508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:11.016523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.203 [2024-10-30 16:14:11.016536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.203 [2024-10-30 16:14:11.016565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.203 qpair failed and we were unable to recover it. 00:30:21.203 [2024-10-30 16:14:11.026414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.203 [2024-10-30 16:14:11.026539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:11.026568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:11.026584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.203 [2024-10-30 16:14:11.026598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.203 [2024-10-30 16:14:11.026634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.203 qpair failed and we were unable to recover it. 00:30:21.203 [2024-10-30 16:14:11.036410] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.203 [2024-10-30 16:14:11.036501] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:11.036527] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:11.036542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.203 [2024-10-30 16:14:11.036556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.203 [2024-10-30 16:14:11.036585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.203 qpair failed and we were unable to recover it. 00:30:21.203 [2024-10-30 16:14:11.046467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.203 [2024-10-30 16:14:11.046557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.203 [2024-10-30 16:14:11.046582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.203 [2024-10-30 16:14:11.046597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.204 [2024-10-30 16:14:11.046610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.204 [2024-10-30 16:14:11.046638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.204 qpair failed and we were unable to recover it. 00:30:21.204 [2024-10-30 16:14:11.056471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.204 [2024-10-30 16:14:11.056601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.204 [2024-10-30 16:14:11.056627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.204 [2024-10-30 16:14:11.056641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.204 [2024-10-30 16:14:11.056655] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.204 [2024-10-30 16:14:11.056684] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.204 qpair failed and we were unable to recover it. 00:30:21.204 [2024-10-30 16:14:11.066517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.204 [2024-10-30 16:14:11.066640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.204 [2024-10-30 16:14:11.066664] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.204 [2024-10-30 16:14:11.066678] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.204 [2024-10-30 16:14:11.066691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.204 [2024-10-30 16:14:11.066721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.204 qpair failed and we were unable to recover it. 00:30:21.204 [2024-10-30 16:14:11.076529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.204 [2024-10-30 16:14:11.076658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.204 [2024-10-30 16:14:11.076693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.204 [2024-10-30 16:14:11.076709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.204 [2024-10-30 16:14:11.076723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.204 [2024-10-30 16:14:11.076753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.204 qpair failed and we were unable to recover it. 00:30:21.463 [2024-10-30 16:14:11.086532] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.463 [2024-10-30 16:14:11.086620] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.463 [2024-10-30 16:14:11.086647] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.463 [2024-10-30 16:14:11.086662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.463 [2024-10-30 16:14:11.086674] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.463 [2024-10-30 16:14:11.086704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-10-30 16:14:11.096587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.463 [2024-10-30 16:14:11.096715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.463 [2024-10-30 16:14:11.096742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.463 [2024-10-30 16:14:11.096757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.463 [2024-10-30 16:14:11.096771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.463 [2024-10-30 16:14:11.096801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.463 qpair failed and we were unable to recover it. 00:30:21.463 [2024-10-30 16:14:11.106625] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.106721] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.106746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.464 [2024-10-30 16:14:11.106760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.464 [2024-10-30 16:14:11.106773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.464 [2024-10-30 16:14:11.106801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-10-30 16:14:11.116615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.116705] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.116730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.464 [2024-10-30 16:14:11.116744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.464 [2024-10-30 16:14:11.116756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.464 [2024-10-30 16:14:11.116791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-10-30 16:14:11.126655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.126743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.126768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.464 [2024-10-30 16:14:11.126782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.464 [2024-10-30 16:14:11.126794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.464 [2024-10-30 16:14:11.126823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-10-30 16:14:11.136700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.136787] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.136811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.464 [2024-10-30 16:14:11.136826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.464 [2024-10-30 16:14:11.136839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.464 [2024-10-30 16:14:11.136867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-10-30 16:14:11.146737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.146827] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.146852] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.464 [2024-10-30 16:14:11.146866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.464 [2024-10-30 16:14:11.146878] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.464 [2024-10-30 16:14:11.146906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-10-30 16:14:11.156727] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.156813] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.156838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.464 [2024-10-30 16:14:11.156852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.464 [2024-10-30 16:14:11.156864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.464 [2024-10-30 16:14:11.156893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-10-30 16:14:11.166837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.166924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.166954] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.464 [2024-10-30 16:14:11.166969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.464 [2024-10-30 16:14:11.166982] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.464 [2024-10-30 16:14:11.167010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-10-30 16:14:11.176799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.176883] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.176907] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.464 [2024-10-30 16:14:11.176921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.464 [2024-10-30 16:14:11.176933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.464 [2024-10-30 16:14:11.176962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-10-30 16:14:11.186867] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.186961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.186985] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.464 [2024-10-30 16:14:11.186999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.464 [2024-10-30 16:14:11.187011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.464 [2024-10-30 16:14:11.187039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-10-30 16:14:11.196881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.196966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.196990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.464 [2024-10-30 16:14:11.197004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.464 [2024-10-30 16:14:11.197016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.464 [2024-10-30 16:14:11.197044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-10-30 16:14:11.206877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.206966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.206991] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.464 [2024-10-30 16:14:11.207005] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.464 [2024-10-30 16:14:11.207023] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.464 [2024-10-30 16:14:11.207052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-10-30 16:14:11.216909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.217004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.217028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.464 [2024-10-30 16:14:11.217042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.464 [2024-10-30 16:14:11.217054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.464 [2024-10-30 16:14:11.217082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-10-30 16:14:11.226950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.227065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.227090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.464 [2024-10-30 16:14:11.227104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.464 [2024-10-30 16:14:11.227118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.464 [2024-10-30 16:14:11.227147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-10-30 16:14:11.236994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.237084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.237108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.464 [2024-10-30 16:14:11.237122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.464 [2024-10-30 16:14:11.237134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.464 [2024-10-30 16:14:11.237163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.464 qpair failed and we were unable to recover it. 00:30:21.464 [2024-10-30 16:14:11.247004] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.464 [2024-10-30 16:14:11.247115] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.464 [2024-10-30 16:14:11.247140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.465 [2024-10-30 16:14:11.247154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.465 [2024-10-30 16:14:11.247167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.465 [2024-10-30 16:14:11.247197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-10-30 16:14:11.257038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.465 [2024-10-30 16:14:11.257130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.465 [2024-10-30 16:14:11.257158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.465 [2024-10-30 16:14:11.257173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.465 [2024-10-30 16:14:11.257186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.465 [2024-10-30 16:14:11.257216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-10-30 16:14:11.267081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.465 [2024-10-30 16:14:11.267211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.465 [2024-10-30 16:14:11.267238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.465 [2024-10-30 16:14:11.267253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.465 [2024-10-30 16:14:11.267279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.465 [2024-10-30 16:14:11.267309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-10-30 16:14:11.277091] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.465 [2024-10-30 16:14:11.277175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.465 [2024-10-30 16:14:11.277203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.465 [2024-10-30 16:14:11.277217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.465 [2024-10-30 16:14:11.277230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.465 [2024-10-30 16:14:11.277268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-10-30 16:14:11.287106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.465 [2024-10-30 16:14:11.287189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.465 [2024-10-30 16:14:11.287215] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.465 [2024-10-30 16:14:11.287230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.465 [2024-10-30 16:14:11.287244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.465 [2024-10-30 16:14:11.287281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-10-30 16:14:11.297143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.465 [2024-10-30 16:14:11.297226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.465 [2024-10-30 16:14:11.297251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.465 [2024-10-30 16:14:11.297275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.465 [2024-10-30 16:14:11.297298] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.465 [2024-10-30 16:14:11.297328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-10-30 16:14:11.307183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.465 [2024-10-30 16:14:11.307281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.465 [2024-10-30 16:14:11.307307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.465 [2024-10-30 16:14:11.307323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.465 [2024-10-30 16:14:11.307335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.465 [2024-10-30 16:14:11.307365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-10-30 16:14:11.317185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.465 [2024-10-30 16:14:11.317282] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.465 [2024-10-30 16:14:11.317307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.465 [2024-10-30 16:14:11.317322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.465 [2024-10-30 16:14:11.317335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.465 [2024-10-30 16:14:11.317365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-10-30 16:14:11.327246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.465 [2024-10-30 16:14:11.327342] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.465 [2024-10-30 16:14:11.327372] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.465 [2024-10-30 16:14:11.327390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.465 [2024-10-30 16:14:11.327404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.465 [2024-10-30 16:14:11.327435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.465 [2024-10-30 16:14:11.337265] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.465 [2024-10-30 16:14:11.337400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.465 [2024-10-30 16:14:11.337428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.465 [2024-10-30 16:14:11.337443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.465 [2024-10-30 16:14:11.337458] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.465 [2024-10-30 16:14:11.337488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.465 qpair failed and we were unable to recover it. 00:30:21.724 [2024-10-30 16:14:11.347307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.724 [2024-10-30 16:14:11.347427] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.724 [2024-10-30 16:14:11.347455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.724 [2024-10-30 16:14:11.347471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.725 [2024-10-30 16:14:11.347485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.725 [2024-10-30 16:14:11.347515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.725 qpair failed and we were unable to recover it. 00:30:21.725 [2024-10-30 16:14:11.357366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.725 [2024-10-30 16:14:11.357451] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.725 [2024-10-30 16:14:11.357477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.725 [2024-10-30 16:14:11.357492] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.725 [2024-10-30 16:14:11.357504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.725 [2024-10-30 16:14:11.357534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.725 qpair failed and we were unable to recover it. 00:30:21.725 [2024-10-30 16:14:11.367352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.725 [2024-10-30 16:14:11.367434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.725 [2024-10-30 16:14:11.367460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.725 [2024-10-30 16:14:11.367475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.725 [2024-10-30 16:14:11.367488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.725 [2024-10-30 16:14:11.367518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.725 qpair failed and we were unable to recover it. 00:30:21.725 [2024-10-30 16:14:11.377411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.725 [2024-10-30 16:14:11.377502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.725 [2024-10-30 16:14:11.377528] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.725 [2024-10-30 16:14:11.377543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.725 [2024-10-30 16:14:11.377556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.725 [2024-10-30 16:14:11.377585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.725 qpair failed and we were unable to recover it. 00:30:21.725 [2024-10-30 16:14:11.387459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.725 [2024-10-30 16:14:11.387585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.725 [2024-10-30 16:14:11.387611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.725 [2024-10-30 16:14:11.387625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.725 [2024-10-30 16:14:11.387644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.725 [2024-10-30 16:14:11.387673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.725 qpair failed and we were unable to recover it. 00:30:21.725 [2024-10-30 16:14:11.397441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.725 [2024-10-30 16:14:11.397548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.725 [2024-10-30 16:14:11.397574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.725 [2024-10-30 16:14:11.397588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.725 [2024-10-30 16:14:11.397600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.725 [2024-10-30 16:14:11.397630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.725 qpair failed and we were unable to recover it. 00:30:21.725 [2024-10-30 16:14:11.407490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.725 [2024-10-30 16:14:11.407573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.725 [2024-10-30 16:14:11.407599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.725 [2024-10-30 16:14:11.407614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.725 [2024-10-30 16:14:11.407627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.725 [2024-10-30 16:14:11.407656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.725 qpair failed and we were unable to recover it. 00:30:21.725 [2024-10-30 16:14:11.417520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.725 [2024-10-30 16:14:11.417646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.725 [2024-10-30 16:14:11.417671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.725 [2024-10-30 16:14:11.417686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.725 [2024-10-30 16:14:11.417698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.725 [2024-10-30 16:14:11.417729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.725 qpair failed and we were unable to recover it. 00:30:21.725 [2024-10-30 16:14:11.427528] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.725 [2024-10-30 16:14:11.427617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.725 [2024-10-30 16:14:11.427643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.725 [2024-10-30 16:14:11.427657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.725 [2024-10-30 16:14:11.427670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.725 [2024-10-30 16:14:11.427700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.725 qpair failed and we were unable to recover it. 00:30:21.725 [2024-10-30 16:14:11.437578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.725 [2024-10-30 16:14:11.437679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.725 [2024-10-30 16:14:11.437705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.725 [2024-10-30 16:14:11.437720] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.725 [2024-10-30 16:14:11.437732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.725 [2024-10-30 16:14:11.437761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.725 qpair failed and we were unable to recover it. 00:30:21.725 [2024-10-30 16:14:11.447612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.725 [2024-10-30 16:14:11.447699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.725 [2024-10-30 16:14:11.447729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.725 [2024-10-30 16:14:11.447744] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.725 [2024-10-30 16:14:11.447758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.725 [2024-10-30 16:14:11.447786] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.725 qpair failed and we were unable to recover it. 00:30:21.725 [2024-10-30 16:14:11.457602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.725 [2024-10-30 16:14:11.457694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.725 [2024-10-30 16:14:11.457720] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.725 [2024-10-30 16:14:11.457735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.725 [2024-10-30 16:14:11.457747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.725 [2024-10-30 16:14:11.457778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.725 qpair failed and we were unable to recover it. 00:30:21.725 [2024-10-30 16:14:11.467656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.725 [2024-10-30 16:14:11.467746] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.725 [2024-10-30 16:14:11.467772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.725 [2024-10-30 16:14:11.467786] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.725 [2024-10-30 16:14:11.467799] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.725 [2024-10-30 16:14:11.467829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.725 qpair failed and we were unable to recover it. 00:30:21.725 [2024-10-30 16:14:11.477653] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.725 [2024-10-30 16:14:11.477736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.725 [2024-10-30 16:14:11.477762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.725 [2024-10-30 16:14:11.477776] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.725 [2024-10-30 16:14:11.477796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.725 [2024-10-30 16:14:11.477825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.725 qpair failed and we were unable to recover it. 00:30:21.725 [2024-10-30 16:14:11.487685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.725 [2024-10-30 16:14:11.487786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.725 [2024-10-30 16:14:11.487812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.726 [2024-10-30 16:14:11.487826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.726 [2024-10-30 16:14:11.487839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.726 [2024-10-30 16:14:11.487868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.726 qpair failed and we were unable to recover it. 00:30:21.726 [2024-10-30 16:14:11.497773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.726 [2024-10-30 16:14:11.497886] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.726 [2024-10-30 16:14:11.497912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.726 [2024-10-30 16:14:11.497927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.726 [2024-10-30 16:14:11.497940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.726 [2024-10-30 16:14:11.497970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.726 qpair failed and we were unable to recover it. 00:30:21.726 [2024-10-30 16:14:11.507808] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.726 [2024-10-30 16:14:11.507932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.726 [2024-10-30 16:14:11.507958] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.726 [2024-10-30 16:14:11.507973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.726 [2024-10-30 16:14:11.507985] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.726 [2024-10-30 16:14:11.508015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.726 qpair failed and we were unable to recover it. 00:30:21.726 [2024-10-30 16:14:11.517812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.726 [2024-10-30 16:14:11.517904] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.726 [2024-10-30 16:14:11.517930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.726 [2024-10-30 16:14:11.517944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.726 [2024-10-30 16:14:11.517957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.726 [2024-10-30 16:14:11.517987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.726 qpair failed and we were unable to recover it. 00:30:21.726 [2024-10-30 16:14:11.527816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.726 [2024-10-30 16:14:11.527902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.726 [2024-10-30 16:14:11.527928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.726 [2024-10-30 16:14:11.527943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.726 [2024-10-30 16:14:11.527956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.726 [2024-10-30 16:14:11.527985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.726 qpair failed and we were unable to recover it. 00:30:21.726 [2024-10-30 16:14:11.537831] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.726 [2024-10-30 16:14:11.537912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.726 [2024-10-30 16:14:11.537938] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.726 [2024-10-30 16:14:11.537952] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.726 [2024-10-30 16:14:11.537965] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.726 [2024-10-30 16:14:11.537995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.726 qpair failed and we were unable to recover it. 00:30:21.726 [2024-10-30 16:14:11.547888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.726 [2024-10-30 16:14:11.547976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.726 [2024-10-30 16:14:11.548001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.726 [2024-10-30 16:14:11.548016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.726 [2024-10-30 16:14:11.548029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.726 [2024-10-30 16:14:11.548058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.726 qpair failed and we were unable to recover it. 00:30:21.726 [2024-10-30 16:14:11.557911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.726 [2024-10-30 16:14:11.557997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.726 [2024-10-30 16:14:11.558024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.726 [2024-10-30 16:14:11.558039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.726 [2024-10-30 16:14:11.558051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.726 [2024-10-30 16:14:11.558081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.726 qpair failed and we were unable to recover it. 00:30:21.726 [2024-10-30 16:14:11.567979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.726 [2024-10-30 16:14:11.568091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.726 [2024-10-30 16:14:11.568117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.726 [2024-10-30 16:14:11.568137] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.726 [2024-10-30 16:14:11.568152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.726 [2024-10-30 16:14:11.568181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.726 qpair failed and we were unable to recover it. 00:30:21.726 [2024-10-30 16:14:11.577961] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.726 [2024-10-30 16:14:11.578039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.726 [2024-10-30 16:14:11.578065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.726 [2024-10-30 16:14:11.578079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.726 [2024-10-30 16:14:11.578092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.726 [2024-10-30 16:14:11.578121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.726 qpair failed and we were unable to recover it. 00:30:21.726 [2024-10-30 16:14:11.587986] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.726 [2024-10-30 16:14:11.588079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.726 [2024-10-30 16:14:11.588106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.726 [2024-10-30 16:14:11.588121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.726 [2024-10-30 16:14:11.588133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.726 [2024-10-30 16:14:11.588163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.726 qpair failed and we were unable to recover it. 00:30:21.726 [2024-10-30 16:14:11.598087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.726 [2024-10-30 16:14:11.598230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.726 [2024-10-30 16:14:11.598265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.726 [2024-10-30 16:14:11.598282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.726 [2024-10-30 16:14:11.598297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.726 [2024-10-30 16:14:11.598327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.726 qpair failed and we were unable to recover it. 00:30:21.985 [2024-10-30 16:14:11.608051] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.985 [2024-10-30 16:14:11.608138] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.985 [2024-10-30 16:14:11.608165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.985 [2024-10-30 16:14:11.608180] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.985 [2024-10-30 16:14:11.608193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.985 [2024-10-30 16:14:11.608222] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.985 qpair failed and we were unable to recover it. 00:30:21.985 [2024-10-30 16:14:11.618063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.985 [2024-10-30 16:14:11.618157] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.985 [2024-10-30 16:14:11.618183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.985 [2024-10-30 16:14:11.618198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.985 [2024-10-30 16:14:11.618213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.985 [2024-10-30 16:14:11.618242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.986 qpair failed and we were unable to recover it. 00:30:21.986 [2024-10-30 16:14:11.628131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.986 [2024-10-30 16:14:11.628226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.986 [2024-10-30 16:14:11.628252] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.986 [2024-10-30 16:14:11.628274] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.986 [2024-10-30 16:14:11.628287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.986 [2024-10-30 16:14:11.628316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.986 qpair failed and we were unable to recover it. 00:30:21.986 [2024-10-30 16:14:11.638120] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.986 [2024-10-30 16:14:11.638209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.986 [2024-10-30 16:14:11.638235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.986 [2024-10-30 16:14:11.638250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.986 [2024-10-30 16:14:11.638272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.986 [2024-10-30 16:14:11.638302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.986 qpair failed and we were unable to recover it. 00:30:21.986 [2024-10-30 16:14:11.648172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.986 [2024-10-30 16:14:11.648268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.986 [2024-10-30 16:14:11.648295] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.986 [2024-10-30 16:14:11.648310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.986 [2024-10-30 16:14:11.648323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.986 [2024-10-30 16:14:11.648351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.986 qpair failed and we were unable to recover it. 00:30:21.986 [2024-10-30 16:14:11.658169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.986 [2024-10-30 16:14:11.658254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.986 [2024-10-30 16:14:11.658287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.986 [2024-10-30 16:14:11.658307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.986 [2024-10-30 16:14:11.658321] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.986 [2024-10-30 16:14:11.658350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.986 qpair failed and we were unable to recover it. 00:30:21.986 [2024-10-30 16:14:11.668278] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.986 [2024-10-30 16:14:11.668374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.986 [2024-10-30 16:14:11.668403] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.986 [2024-10-30 16:14:11.668419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.986 [2024-10-30 16:14:11.668432] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.986 [2024-10-30 16:14:11.668463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.986 qpair failed and we were unable to recover it. 00:30:21.986 [2024-10-30 16:14:11.678250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.986 [2024-10-30 16:14:11.678349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.986 [2024-10-30 16:14:11.678375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.986 [2024-10-30 16:14:11.678390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.986 [2024-10-30 16:14:11.678402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.986 [2024-10-30 16:14:11.678433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.986 qpair failed and we were unable to recover it. 00:30:21.986 [2024-10-30 16:14:11.688296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.986 [2024-10-30 16:14:11.688384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.986 [2024-10-30 16:14:11.688410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.986 [2024-10-30 16:14:11.688424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.986 [2024-10-30 16:14:11.688437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.986 [2024-10-30 16:14:11.688467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.986 qpair failed and we were unable to recover it. 00:30:21.986 [2024-10-30 16:14:11.698314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.986 [2024-10-30 16:14:11.698441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.986 [2024-10-30 16:14:11.698467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.986 [2024-10-30 16:14:11.698482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.986 [2024-10-30 16:14:11.698495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.986 [2024-10-30 16:14:11.698525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.986 qpair failed and we were unable to recover it. 00:30:21.986 [2024-10-30 16:14:11.708341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.986 [2024-10-30 16:14:11.708434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.986 [2024-10-30 16:14:11.708459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.986 [2024-10-30 16:14:11.708474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.986 [2024-10-30 16:14:11.708487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.986 [2024-10-30 16:14:11.708517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.986 qpair failed and we were unable to recover it. 00:30:21.986 [2024-10-30 16:14:11.718392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.986 [2024-10-30 16:14:11.718485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.986 [2024-10-30 16:14:11.718511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.986 [2024-10-30 16:14:11.718526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.986 [2024-10-30 16:14:11.718539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.986 [2024-10-30 16:14:11.718569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.986 qpair failed and we were unable to recover it. 00:30:21.986 [2024-10-30 16:14:11.728390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.986 [2024-10-30 16:14:11.728525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.986 [2024-10-30 16:14:11.728550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.986 [2024-10-30 16:14:11.728564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.986 [2024-10-30 16:14:11.728577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.986 [2024-10-30 16:14:11.728608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.986 qpair failed and we were unable to recover it. 00:30:21.986 [2024-10-30 16:14:11.738458] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.986 [2024-10-30 16:14:11.738557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.986 [2024-10-30 16:14:11.738583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.986 [2024-10-30 16:14:11.738598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.986 [2024-10-30 16:14:11.738610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.986 [2024-10-30 16:14:11.738640] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.986 qpair failed and we were unable to recover it. 00:30:21.986 [2024-10-30 16:14:11.748475] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.986 [2024-10-30 16:14:11.748599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.986 [2024-10-30 16:14:11.748625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.986 [2024-10-30 16:14:11.748645] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.986 [2024-10-30 16:14:11.748659] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.986 [2024-10-30 16:14:11.748688] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.986 qpair failed and we were unable to recover it. 00:30:21.986 [2024-10-30 16:14:11.758471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.986 [2024-10-30 16:14:11.758555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.986 [2024-10-30 16:14:11.758581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.986 [2024-10-30 16:14:11.758595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.986 [2024-10-30 16:14:11.758608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.987 [2024-10-30 16:14:11.758638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.987 qpair failed and we were unable to recover it. 00:30:21.987 [2024-10-30 16:14:11.768509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.987 [2024-10-30 16:14:11.768634] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.987 [2024-10-30 16:14:11.768660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.987 [2024-10-30 16:14:11.768675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.987 [2024-10-30 16:14:11.768687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.987 [2024-10-30 16:14:11.768717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.987 qpair failed and we were unable to recover it. 00:30:21.987 [2024-10-30 16:14:11.778547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.987 [2024-10-30 16:14:11.778633] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.987 [2024-10-30 16:14:11.778662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.987 [2024-10-30 16:14:11.778677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.987 [2024-10-30 16:14:11.778692] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.987 [2024-10-30 16:14:11.778721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.987 qpair failed and we were unable to recover it. 00:30:21.987 [2024-10-30 16:14:11.788552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.987 [2024-10-30 16:14:11.788644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.987 [2024-10-30 16:14:11.788670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.987 [2024-10-30 16:14:11.788685] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.987 [2024-10-30 16:14:11.788697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.987 [2024-10-30 16:14:11.788727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.987 qpair failed and we were unable to recover it. 00:30:21.987 [2024-10-30 16:14:11.798587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.987 [2024-10-30 16:14:11.798709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.987 [2024-10-30 16:14:11.798735] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.987 [2024-10-30 16:14:11.798749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.987 [2024-10-30 16:14:11.798762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.987 [2024-10-30 16:14:11.798790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.987 qpair failed and we were unable to recover it. 00:30:21.987 [2024-10-30 16:14:11.808605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.987 [2024-10-30 16:14:11.808691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.987 [2024-10-30 16:14:11.808716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.987 [2024-10-30 16:14:11.808730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.987 [2024-10-30 16:14:11.808744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.987 [2024-10-30 16:14:11.808773] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.987 qpair failed and we were unable to recover it. 00:30:21.987 [2024-10-30 16:14:11.818616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.987 [2024-10-30 16:14:11.818707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.987 [2024-10-30 16:14:11.818736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.987 [2024-10-30 16:14:11.818753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.987 [2024-10-30 16:14:11.818767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.987 [2024-10-30 16:14:11.818797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.987 qpair failed and we were unable to recover it. 00:30:21.987 [2024-10-30 16:14:11.828691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.987 [2024-10-30 16:14:11.828783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.987 [2024-10-30 16:14:11.828813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.987 [2024-10-30 16:14:11.828828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.987 [2024-10-30 16:14:11.828843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.987 [2024-10-30 16:14:11.828872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.987 qpair failed and we were unable to recover it. 00:30:21.987 [2024-10-30 16:14:11.838722] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.987 [2024-10-30 16:14:11.838813] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.987 [2024-10-30 16:14:11.838838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.987 [2024-10-30 16:14:11.838859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.987 [2024-10-30 16:14:11.838874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.987 [2024-10-30 16:14:11.838903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.987 qpair failed and we were unable to recover it. 00:30:21.987 [2024-10-30 16:14:11.848764] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.987 [2024-10-30 16:14:11.848855] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.987 [2024-10-30 16:14:11.848881] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.987 [2024-10-30 16:14:11.848896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.987 [2024-10-30 16:14:11.848910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.987 [2024-10-30 16:14:11.848939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.987 qpair failed and we were unable to recover it. 00:30:21.987 [2024-10-30 16:14:11.858764] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.987 [2024-10-30 16:14:11.858851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.987 [2024-10-30 16:14:11.858877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.987 [2024-10-30 16:14:11.858891] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.987 [2024-10-30 16:14:11.858905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:21.987 [2024-10-30 16:14:11.858934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.987 qpair failed and we were unable to recover it. 00:30:22.247 [2024-10-30 16:14:11.868788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.247 [2024-10-30 16:14:11.868887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.247 [2024-10-30 16:14:11.868915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.247 [2024-10-30 16:14:11.868930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.247 [2024-10-30 16:14:11.868944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.247 [2024-10-30 16:14:11.868975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.247 qpair failed and we were unable to recover it. 00:30:22.247 [2024-10-30 16:14:11.878840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.247 [2024-10-30 16:14:11.878939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.247 [2024-10-30 16:14:11.878965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.247 [2024-10-30 16:14:11.878980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.247 [2024-10-30 16:14:11.878994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.247 [2024-10-30 16:14:11.879023] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.247 qpair failed and we were unable to recover it. 00:30:22.247 [2024-10-30 16:14:11.888881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.247 [2024-10-30 16:14:11.888971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.247 [2024-10-30 16:14:11.888998] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.247 [2024-10-30 16:14:11.889013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.247 [2024-10-30 16:14:11.889026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.247 [2024-10-30 16:14:11.889055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.247 qpair failed and we were unable to recover it. 00:30:22.247 [2024-10-30 16:14:11.898889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.247 [2024-10-30 16:14:11.898982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.247 [2024-10-30 16:14:11.899011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.247 [2024-10-30 16:14:11.899028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.247 [2024-10-30 16:14:11.899042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.247 [2024-10-30 16:14:11.899072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.247 qpair failed and we were unable to recover it. 00:30:22.247 [2024-10-30 16:14:11.908911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.247 [2024-10-30 16:14:11.909006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.247 [2024-10-30 16:14:11.909033] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.247 [2024-10-30 16:14:11.909048] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.247 [2024-10-30 16:14:11.909061] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.247 [2024-10-30 16:14:11.909091] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.247 qpair failed and we were unable to recover it. 00:30:22.247 [2024-10-30 16:14:11.918935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.247 [2024-10-30 16:14:11.919032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.247 [2024-10-30 16:14:11.919058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.247 [2024-10-30 16:14:11.919073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.247 [2024-10-30 16:14:11.919087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.247 [2024-10-30 16:14:11.919115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.247 qpair failed and we were unable to recover it. 00:30:22.247 [2024-10-30 16:14:11.929031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.247 [2024-10-30 16:14:11.929129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.247 [2024-10-30 16:14:11.929161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.247 [2024-10-30 16:14:11.929177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.247 [2024-10-30 16:14:11.929191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.247 [2024-10-30 16:14:11.929221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.247 qpair failed and we were unable to recover it. 00:30:22.247 [2024-10-30 16:14:11.938997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.247 [2024-10-30 16:14:11.939079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.247 [2024-10-30 16:14:11.939106] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.247 [2024-10-30 16:14:11.939121] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.247 [2024-10-30 16:14:11.939135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.247 [2024-10-30 16:14:11.939164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.247 qpair failed and we were unable to recover it. 00:30:22.247 [2024-10-30 16:14:11.949039] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.247 [2024-10-30 16:14:11.949136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.247 [2024-10-30 16:14:11.949162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.247 [2024-10-30 16:14:11.949176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.247 [2024-10-30 16:14:11.949190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.247 [2024-10-30 16:14:11.949218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.247 qpair failed and we were unable to recover it. 00:30:22.247 [2024-10-30 16:14:11.959060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.247 [2024-10-30 16:14:11.959157] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.247 [2024-10-30 16:14:11.959186] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.247 [2024-10-30 16:14:11.959201] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.247 [2024-10-30 16:14:11.959215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.247 [2024-10-30 16:14:11.959252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.247 qpair failed and we were unable to recover it. 00:30:22.247 [2024-10-30 16:14:11.969110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.247 [2024-10-30 16:14:11.969214] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.247 [2024-10-30 16:14:11.969249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.247 [2024-10-30 16:14:11.969270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.247 [2024-10-30 16:14:11.969285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.247 [2024-10-30 16:14:11.969314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.247 qpair failed and we were unable to recover it. 00:30:22.247 [2024-10-30 16:14:11.979106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.247 [2024-10-30 16:14:11.979201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.247 [2024-10-30 16:14:11.979228] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.248 [2024-10-30 16:14:11.979251] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.248 [2024-10-30 16:14:11.979273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.248 [2024-10-30 16:14:11.979305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-10-30 16:14:11.989176] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.248 [2024-10-30 16:14:11.989319] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.248 [2024-10-30 16:14:11.989345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.248 [2024-10-30 16:14:11.989360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.248 [2024-10-30 16:14:11.989374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.248 [2024-10-30 16:14:11.989403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-10-30 16:14:11.999198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.248 [2024-10-30 16:14:11.999312] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.248 [2024-10-30 16:14:11.999337] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.248 [2024-10-30 16:14:11.999351] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.248 [2024-10-30 16:14:11.999363] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.248 [2024-10-30 16:14:11.999392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-10-30 16:14:12.009231] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.248 [2024-10-30 16:14:12.009371] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.248 [2024-10-30 16:14:12.009397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.248 [2024-10-30 16:14:12.009412] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.248 [2024-10-30 16:14:12.009425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.248 [2024-10-30 16:14:12.009454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-10-30 16:14:12.019220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.248 [2024-10-30 16:14:12.019330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.248 [2024-10-30 16:14:12.019365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.248 [2024-10-30 16:14:12.019382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.248 [2024-10-30 16:14:12.019396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.248 [2024-10-30 16:14:12.019426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-10-30 16:14:12.029304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.248 [2024-10-30 16:14:12.029403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.248 [2024-10-30 16:14:12.029433] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.248 [2024-10-30 16:14:12.029448] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.248 [2024-10-30 16:14:12.029461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.248 [2024-10-30 16:14:12.029491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-10-30 16:14:12.039307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.248 [2024-10-30 16:14:12.039424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.248 [2024-10-30 16:14:12.039451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.248 [2024-10-30 16:14:12.039465] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.248 [2024-10-30 16:14:12.039479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.248 [2024-10-30 16:14:12.039508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-10-30 16:14:12.049322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.248 [2024-10-30 16:14:12.049413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.248 [2024-10-30 16:14:12.049439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.248 [2024-10-30 16:14:12.049454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.248 [2024-10-30 16:14:12.049467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.248 [2024-10-30 16:14:12.049496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-10-30 16:14:12.059341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.248 [2024-10-30 16:14:12.059435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.248 [2024-10-30 16:14:12.059461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.248 [2024-10-30 16:14:12.059476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.248 [2024-10-30 16:14:12.059489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.248 [2024-10-30 16:14:12.059527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-10-30 16:14:12.069409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.248 [2024-10-30 16:14:12.069531] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.248 [2024-10-30 16:14:12.069557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.248 [2024-10-30 16:14:12.069571] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.248 [2024-10-30 16:14:12.069584] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.248 [2024-10-30 16:14:12.069613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-10-30 16:14:12.079421] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.248 [2024-10-30 16:14:12.079514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.248 [2024-10-30 16:14:12.079541] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.248 [2024-10-30 16:14:12.079556] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.248 [2024-10-30 16:14:12.079569] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.248 [2024-10-30 16:14:12.079598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-10-30 16:14:12.089415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.248 [2024-10-30 16:14:12.089507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.248 [2024-10-30 16:14:12.089535] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.248 [2024-10-30 16:14:12.089549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.248 [2024-10-30 16:14:12.089563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.248 [2024-10-30 16:14:12.089591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-10-30 16:14:12.099493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.248 [2024-10-30 16:14:12.099614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.248 [2024-10-30 16:14:12.099640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.248 [2024-10-30 16:14:12.099655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.248 [2024-10-30 16:14:12.099669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.248 [2024-10-30 16:14:12.099699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-10-30 16:14:12.109520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.248 [2024-10-30 16:14:12.109618] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.248 [2024-10-30 16:14:12.109650] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.248 [2024-10-30 16:14:12.109665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.248 [2024-10-30 16:14:12.109679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.248 [2024-10-30 16:14:12.109707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.248 qpair failed and we were unable to recover it. 00:30:22.248 [2024-10-30 16:14:12.119501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.249 [2024-10-30 16:14:12.119604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.249 [2024-10-30 16:14:12.119630] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.249 [2024-10-30 16:14:12.119645] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.249 [2024-10-30 16:14:12.119659] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.249 [2024-10-30 16:14:12.119687] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.249 qpair failed and we were unable to recover it. 00:30:22.508 [2024-10-30 16:14:12.129542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.508 [2024-10-30 16:14:12.129636] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.508 [2024-10-30 16:14:12.129671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.508 [2024-10-30 16:14:12.129699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.508 [2024-10-30 16:14:12.129716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.508 [2024-10-30 16:14:12.129747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.508 qpair failed and we were unable to recover it. 00:30:22.508 [2024-10-30 16:14:12.139600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.508 [2024-10-30 16:14:12.139703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.508 [2024-10-30 16:14:12.139730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.508 [2024-10-30 16:14:12.139745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.508 [2024-10-30 16:14:12.139759] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.508 [2024-10-30 16:14:12.139789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.508 qpair failed and we were unable to recover it. 00:30:22.508 [2024-10-30 16:14:12.149677] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.508 [2024-10-30 16:14:12.149817] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.508 [2024-10-30 16:14:12.149843] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.508 [2024-10-30 16:14:12.149859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.508 [2024-10-30 16:14:12.149872] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.508 [2024-10-30 16:14:12.149908] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.508 qpair failed and we were unable to recover it. 00:30:22.508 [2024-10-30 16:14:12.159663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.508 [2024-10-30 16:14:12.159779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.508 [2024-10-30 16:14:12.159805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.508 [2024-10-30 16:14:12.159820] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.508 [2024-10-30 16:14:12.159834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.508 [2024-10-30 16:14:12.159863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.508 qpair failed and we were unable to recover it. 00:30:22.508 [2024-10-30 16:14:12.169721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.508 [2024-10-30 16:14:12.169821] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.508 [2024-10-30 16:14:12.169846] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.508 [2024-10-30 16:14:12.169861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.509 [2024-10-30 16:14:12.169874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.509 [2024-10-30 16:14:12.169902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.509 qpair failed and we were unable to recover it. 00:30:22.509 [2024-10-30 16:14:12.179696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.509 [2024-10-30 16:14:12.179786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.509 [2024-10-30 16:14:12.179812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.509 [2024-10-30 16:14:12.179826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.509 [2024-10-30 16:14:12.179840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.509 [2024-10-30 16:14:12.179868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.509 qpair failed and we were unable to recover it. 00:30:22.509 [2024-10-30 16:14:12.189774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.509 [2024-10-30 16:14:12.189920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.509 [2024-10-30 16:14:12.189945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.509 [2024-10-30 16:14:12.189960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.509 [2024-10-30 16:14:12.189973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.509 [2024-10-30 16:14:12.190002] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.509 qpair failed and we were unable to recover it. 00:30:22.509 [2024-10-30 16:14:12.199778] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.509 [2024-10-30 16:14:12.199868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.509 [2024-10-30 16:14:12.199899] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.509 [2024-10-30 16:14:12.199915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.509 [2024-10-30 16:14:12.199929] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.509 [2024-10-30 16:14:12.199958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.509 qpair failed and we were unable to recover it. 00:30:22.509 [2024-10-30 16:14:12.209777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.509 [2024-10-30 16:14:12.209859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.509 [2024-10-30 16:14:12.209883] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.509 [2024-10-30 16:14:12.209898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.509 [2024-10-30 16:14:12.209910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.509 [2024-10-30 16:14:12.209938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.509 qpair failed and we were unable to recover it. 00:30:22.509 [2024-10-30 16:14:12.219791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.509 [2024-10-30 16:14:12.219884] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.509 [2024-10-30 16:14:12.219908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.509 [2024-10-30 16:14:12.219922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.509 [2024-10-30 16:14:12.219934] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.509 [2024-10-30 16:14:12.219963] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.509 qpair failed and we were unable to recover it. 00:30:22.509 [2024-10-30 16:14:12.229858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.509 [2024-10-30 16:14:12.229969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.509 [2024-10-30 16:14:12.229994] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.509 [2024-10-30 16:14:12.230007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.509 [2024-10-30 16:14:12.230021] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.509 [2024-10-30 16:14:12.230050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.509 qpair failed and we were unable to recover it. 00:30:22.509 [2024-10-30 16:14:12.239884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.509 [2024-10-30 16:14:12.239973] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.509 [2024-10-30 16:14:12.239997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.509 [2024-10-30 16:14:12.240011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.509 [2024-10-30 16:14:12.240023] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.509 [2024-10-30 16:14:12.240058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.509 qpair failed and we were unable to recover it. 00:30:22.509 [2024-10-30 16:14:12.249889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.509 [2024-10-30 16:14:12.249975] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.509 [2024-10-30 16:14:12.250000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.509 [2024-10-30 16:14:12.250015] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.509 [2024-10-30 16:14:12.250027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.509 [2024-10-30 16:14:12.250056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.509 qpair failed and we were unable to recover it. 00:30:22.509 [2024-10-30 16:14:12.259947] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.509 [2024-10-30 16:14:12.260032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.509 [2024-10-30 16:14:12.260057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.509 [2024-10-30 16:14:12.260071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.509 [2024-10-30 16:14:12.260084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.509 [2024-10-30 16:14:12.260112] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.509 qpair failed and we were unable to recover it. 00:30:22.509 [2024-10-30 16:14:12.269978] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.509 [2024-10-30 16:14:12.270076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.509 [2024-10-30 16:14:12.270101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.509 [2024-10-30 16:14:12.270116] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.509 [2024-10-30 16:14:12.270128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.509 [2024-10-30 16:14:12.270157] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.509 qpair failed and we were unable to recover it. 00:30:22.509 [2024-10-30 16:14:12.280061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.509 [2024-10-30 16:14:12.280151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.509 [2024-10-30 16:14:12.280175] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.509 [2024-10-30 16:14:12.280189] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.509 [2024-10-30 16:14:12.280201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.509 [2024-10-30 16:14:12.280230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.509 qpair failed and we were unable to recover it. 00:30:22.509 [2024-10-30 16:14:12.290008] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.509 [2024-10-30 16:14:12.290097] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.509 [2024-10-30 16:14:12.290128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.509 [2024-10-30 16:14:12.290143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.509 [2024-10-30 16:14:12.290155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.509 [2024-10-30 16:14:12.290184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.509 qpair failed and we were unable to recover it. 00:30:22.509 [2024-10-30 16:14:12.300066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.509 [2024-10-30 16:14:12.300155] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.509 [2024-10-30 16:14:12.300180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.509 [2024-10-30 16:14:12.300195] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.509 [2024-10-30 16:14:12.300207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.509 [2024-10-30 16:14:12.300236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.509 qpair failed and we were unable to recover it. 00:30:22.509 [2024-10-30 16:14:12.310102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.509 [2024-10-30 16:14:12.310201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.509 [2024-10-30 16:14:12.310226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.509 [2024-10-30 16:14:12.310240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.510 [2024-10-30 16:14:12.310252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.510 [2024-10-30 16:14:12.310288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.510 qpair failed and we were unable to recover it. 00:30:22.510 [2024-10-30 16:14:12.320166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.510 [2024-10-30 16:14:12.320263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.510 [2024-10-30 16:14:12.320288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.510 [2024-10-30 16:14:12.320302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.510 [2024-10-30 16:14:12.320314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.510 [2024-10-30 16:14:12.320343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.510 qpair failed and we were unable to recover it. 00:30:22.510 [2024-10-30 16:14:12.330138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.510 [2024-10-30 16:14:12.330233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.510 [2024-10-30 16:14:12.330271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.510 [2024-10-30 16:14:12.330290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.510 [2024-10-30 16:14:12.330302] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.510 [2024-10-30 16:14:12.330338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.510 qpair failed and we were unable to recover it. 00:30:22.510 [2024-10-30 16:14:12.340160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.510 [2024-10-30 16:14:12.340280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.510 [2024-10-30 16:14:12.340305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.510 [2024-10-30 16:14:12.340319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.510 [2024-10-30 16:14:12.340332] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.510 [2024-10-30 16:14:12.340362] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.510 qpair failed and we were unable to recover it. 00:30:22.510 [2024-10-30 16:14:12.350208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.510 [2024-10-30 16:14:12.350309] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.510 [2024-10-30 16:14:12.350334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.510 [2024-10-30 16:14:12.350348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.510 [2024-10-30 16:14:12.350360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.510 [2024-10-30 16:14:12.350389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.510 qpair failed and we were unable to recover it. 00:30:22.510 [2024-10-30 16:14:12.360212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.510 [2024-10-30 16:14:12.360348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.510 [2024-10-30 16:14:12.360375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.510 [2024-10-30 16:14:12.360391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.510 [2024-10-30 16:14:12.360404] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.510 [2024-10-30 16:14:12.360433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.510 qpair failed and we were unable to recover it. 00:30:22.510 [2024-10-30 16:14:12.370245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.510 [2024-10-30 16:14:12.370366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.510 [2024-10-30 16:14:12.370391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.510 [2024-10-30 16:14:12.370405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.510 [2024-10-30 16:14:12.370418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.510 [2024-10-30 16:14:12.370449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.510 qpair failed and we were unable to recover it. 00:30:22.510 [2024-10-30 16:14:12.380282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.510 [2024-10-30 16:14:12.380370] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.510 [2024-10-30 16:14:12.380405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.510 [2024-10-30 16:14:12.380423] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.510 [2024-10-30 16:14:12.380437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.510 [2024-10-30 16:14:12.380468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.510 qpair failed and we were unable to recover it. 00:30:22.770 [2024-10-30 16:14:12.390356] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.770 [2024-10-30 16:14:12.390455] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.770 [2024-10-30 16:14:12.390484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.770 [2024-10-30 16:14:12.390499] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.770 [2024-10-30 16:14:12.390519] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.770 [2024-10-30 16:14:12.390550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-10-30 16:14:12.400344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.770 [2024-10-30 16:14:12.400448] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.770 [2024-10-30 16:14:12.400477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.770 [2024-10-30 16:14:12.400492] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.770 [2024-10-30 16:14:12.400504] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.770 [2024-10-30 16:14:12.400534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-10-30 16:14:12.410364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.770 [2024-10-30 16:14:12.410460] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.770 [2024-10-30 16:14:12.410487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.770 [2024-10-30 16:14:12.410503] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.770 [2024-10-30 16:14:12.410515] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.770 [2024-10-30 16:14:12.410544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-10-30 16:14:12.420403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.770 [2024-10-30 16:14:12.420492] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.770 [2024-10-30 16:14:12.420518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.770 [2024-10-30 16:14:12.420533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.770 [2024-10-30 16:14:12.420559] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.770 [2024-10-30 16:14:12.420589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-10-30 16:14:12.430431] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.770 [2024-10-30 16:14:12.430525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.770 [2024-10-30 16:14:12.430552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.770 [2024-10-30 16:14:12.430566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.770 [2024-10-30 16:14:12.430579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.770 [2024-10-30 16:14:12.430609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-10-30 16:14:12.440448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.770 [2024-10-30 16:14:12.440545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.770 [2024-10-30 16:14:12.440571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.770 [2024-10-30 16:14:12.440585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.770 [2024-10-30 16:14:12.440597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.770 [2024-10-30 16:14:12.440626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-10-30 16:14:12.450468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.770 [2024-10-30 16:14:12.450593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.770 [2024-10-30 16:14:12.450620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.770 [2024-10-30 16:14:12.450635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.770 [2024-10-30 16:14:12.450648] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.770 [2024-10-30 16:14:12.450677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-10-30 16:14:12.460485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.770 [2024-10-30 16:14:12.460580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.770 [2024-10-30 16:14:12.460607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.770 [2024-10-30 16:14:12.460622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.770 [2024-10-30 16:14:12.460634] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.770 [2024-10-30 16:14:12.460671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.770 qpair failed and we were unable to recover it. 00:30:22.770 [2024-10-30 16:14:12.470534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.770 [2024-10-30 16:14:12.470629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.770 [2024-10-30 16:14:12.470656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.770 [2024-10-30 16:14:12.470670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.770 [2024-10-30 16:14:12.470683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.470712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-10-30 16:14:12.480589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.771 [2024-10-30 16:14:12.480675] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.771 [2024-10-30 16:14:12.480701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.771 [2024-10-30 16:14:12.480716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.771 [2024-10-30 16:14:12.480729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.480757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-10-30 16:14:12.490615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.771 [2024-10-30 16:14:12.490719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.771 [2024-10-30 16:14:12.490746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.771 [2024-10-30 16:14:12.490761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.771 [2024-10-30 16:14:12.490774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.490802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-10-30 16:14:12.500717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.771 [2024-10-30 16:14:12.500811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.771 [2024-10-30 16:14:12.500837] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.771 [2024-10-30 16:14:12.500852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.771 [2024-10-30 16:14:12.500882] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.500910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-10-30 16:14:12.510657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.771 [2024-10-30 16:14:12.510748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.771 [2024-10-30 16:14:12.510773] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.771 [2024-10-30 16:14:12.510787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.771 [2024-10-30 16:14:12.510808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.510837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-10-30 16:14:12.520690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.771 [2024-10-30 16:14:12.520790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.771 [2024-10-30 16:14:12.520816] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.771 [2024-10-30 16:14:12.520831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.771 [2024-10-30 16:14:12.520847] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.520875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-10-30 16:14:12.530705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.771 [2024-10-30 16:14:12.530801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.771 [2024-10-30 16:14:12.530826] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.771 [2024-10-30 16:14:12.530840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.771 [2024-10-30 16:14:12.530852] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.530881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-10-30 16:14:12.540771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.771 [2024-10-30 16:14:12.540857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.771 [2024-10-30 16:14:12.540881] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.771 [2024-10-30 16:14:12.540895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.771 [2024-10-30 16:14:12.540909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.540937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-10-30 16:14:12.550788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.771 [2024-10-30 16:14:12.550878] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.771 [2024-10-30 16:14:12.550902] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.771 [2024-10-30 16:14:12.550916] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.771 [2024-10-30 16:14:12.550927] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.550956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-10-30 16:14:12.560828] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.771 [2024-10-30 16:14:12.560945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.771 [2024-10-30 16:14:12.560970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.771 [2024-10-30 16:14:12.560984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.771 [2024-10-30 16:14:12.560997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.561024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-10-30 16:14:12.570835] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.771 [2024-10-30 16:14:12.570955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.771 [2024-10-30 16:14:12.570979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.771 [2024-10-30 16:14:12.570993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.771 [2024-10-30 16:14:12.571006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.571035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-10-30 16:14:12.580860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.771 [2024-10-30 16:14:12.580944] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.771 [2024-10-30 16:14:12.580968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.771 [2024-10-30 16:14:12.580983] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.771 [2024-10-30 16:14:12.580995] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.581023] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-10-30 16:14:12.590917] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.771 [2024-10-30 16:14:12.591042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.771 [2024-10-30 16:14:12.591066] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.771 [2024-10-30 16:14:12.591081] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.771 [2024-10-30 16:14:12.591094] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.591124] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-10-30 16:14:12.600906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.771 [2024-10-30 16:14:12.601008] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.771 [2024-10-30 16:14:12.601032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.771 [2024-10-30 16:14:12.601046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.771 [2024-10-30 16:14:12.601064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.601094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.771 [2024-10-30 16:14:12.610975] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.771 [2024-10-30 16:14:12.611106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.771 [2024-10-30 16:14:12.611131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.771 [2024-10-30 16:14:12.611147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.771 [2024-10-30 16:14:12.611160] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.771 [2024-10-30 16:14:12.611188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.771 qpair failed and we were unable to recover it. 00:30:22.772 [2024-10-30 16:14:12.621006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.772 [2024-10-30 16:14:12.621114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.772 [2024-10-30 16:14:12.621138] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.772 [2024-10-30 16:14:12.621153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.772 [2024-10-30 16:14:12.621165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.772 [2024-10-30 16:14:12.621194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-10-30 16:14:12.631036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.772 [2024-10-30 16:14:12.631135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.772 [2024-10-30 16:14:12.631159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.772 [2024-10-30 16:14:12.631173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.772 [2024-10-30 16:14:12.631185] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.772 [2024-10-30 16:14:12.631214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.772 qpair failed and we were unable to recover it. 00:30:22.772 [2024-10-30 16:14:12.641066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.772 [2024-10-30 16:14:12.641159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.772 [2024-10-30 16:14:12.641184] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.772 [2024-10-30 16:14:12.641198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.772 [2024-10-30 16:14:12.641210] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:22.772 [2024-10-30 16:14:12.641239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.772 qpair failed and we were unable to recover it. 00:30:23.031 [2024-10-30 16:14:12.651084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.031 [2024-10-30 16:14:12.651227] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.031 [2024-10-30 16:14:12.651266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.031 [2024-10-30 16:14:12.651287] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.031 [2024-10-30 16:14:12.651300] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.031 [2024-10-30 16:14:12.651331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.031 qpair failed and we were unable to recover it. 00:30:23.031 [2024-10-30 16:14:12.661089] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.031 [2024-10-30 16:14:12.661177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.031 [2024-10-30 16:14:12.661204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.031 [2024-10-30 16:14:12.661219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.031 [2024-10-30 16:14:12.661231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.031 [2024-10-30 16:14:12.661271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.031 qpair failed and we were unable to recover it. 00:30:23.031 [2024-10-30 16:14:12.671139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.031 [2024-10-30 16:14:12.671233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.031 [2024-10-30 16:14:12.671268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.031 [2024-10-30 16:14:12.671285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.031 [2024-10-30 16:14:12.671297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.031 [2024-10-30 16:14:12.671327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.031 qpair failed and we were unable to recover it. 00:30:23.031 [2024-10-30 16:14:12.681244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.031 [2024-10-30 16:14:12.681378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.031 [2024-10-30 16:14:12.681405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.031 [2024-10-30 16:14:12.681420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.031 [2024-10-30 16:14:12.681434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.031 [2024-10-30 16:14:12.681463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.031 qpair failed and we were unable to recover it. 00:30:23.031 [2024-10-30 16:14:12.691171] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.031 [2024-10-30 16:14:12.691269] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.031 [2024-10-30 16:14:12.691296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.031 [2024-10-30 16:14:12.691310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.031 [2024-10-30 16:14:12.691327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.031 [2024-10-30 16:14:12.691357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.031 qpair failed and we were unable to recover it. 00:30:23.031 [2024-10-30 16:14:12.701240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.031 [2024-10-30 16:14:12.701350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.031 [2024-10-30 16:14:12.701375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.031 [2024-10-30 16:14:12.701390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.031 [2024-10-30 16:14:12.701403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.031 [2024-10-30 16:14:12.701432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.031 qpair failed and we were unable to recover it. 00:30:23.031 [2024-10-30 16:14:12.711239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.031 [2024-10-30 16:14:12.711341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.031 [2024-10-30 16:14:12.711366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.031 [2024-10-30 16:14:12.711381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.031 [2024-10-30 16:14:12.711393] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.031 [2024-10-30 16:14:12.711421] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.031 qpair failed and we were unable to recover it. 00:30:23.031 [2024-10-30 16:14:12.721317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.031 [2024-10-30 16:14:12.721403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.031 [2024-10-30 16:14:12.721428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.031 [2024-10-30 16:14:12.721442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.031 [2024-10-30 16:14:12.721454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.031 [2024-10-30 16:14:12.721483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.031 qpair failed and we were unable to recover it. 00:30:23.031 [2024-10-30 16:14:12.731330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.031 [2024-10-30 16:14:12.731430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.031 [2024-10-30 16:14:12.731455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.031 [2024-10-30 16:14:12.731469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.031 [2024-10-30 16:14:12.731481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.031 [2024-10-30 16:14:12.731510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.031 qpair failed and we were unable to recover it. 00:30:23.031 [2024-10-30 16:14:12.741369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.031 [2024-10-30 16:14:12.741454] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.031 [2024-10-30 16:14:12.741479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.031 [2024-10-30 16:14:12.741494] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.031 [2024-10-30 16:14:12.741506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.031 [2024-10-30 16:14:12.741535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.031 qpair failed and we were unable to recover it. 00:30:23.031 [2024-10-30 16:14:12.751363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.032 [2024-10-30 16:14:12.751483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.032 [2024-10-30 16:14:12.751508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.032 [2024-10-30 16:14:12.751524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.032 [2024-10-30 16:14:12.751537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.032 [2024-10-30 16:14:12.751566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.032 qpair failed and we were unable to recover it. 00:30:23.032 [2024-10-30 16:14:12.761395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.032 [2024-10-30 16:14:12.761485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.032 [2024-10-30 16:14:12.761510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.032 [2024-10-30 16:14:12.761524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.032 [2024-10-30 16:14:12.761536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.032 [2024-10-30 16:14:12.761565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.032 qpair failed and we were unable to recover it. 00:30:23.032 [2024-10-30 16:14:12.771474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.032 [2024-10-30 16:14:12.771562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.032 [2024-10-30 16:14:12.771590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.032 [2024-10-30 16:14:12.771605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.032 [2024-10-30 16:14:12.771618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.032 [2024-10-30 16:14:12.771648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.032 qpair failed and we were unable to recover it. 00:30:23.032 [2024-10-30 16:14:12.781453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.032 [2024-10-30 16:14:12.781544] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.032 [2024-10-30 16:14:12.781569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.032 [2024-10-30 16:14:12.781588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.032 [2024-10-30 16:14:12.781603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.032 [2024-10-30 16:14:12.781632] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.032 qpair failed and we were unable to recover it. 00:30:23.032 [2024-10-30 16:14:12.791505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.032 [2024-10-30 16:14:12.791596] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.032 [2024-10-30 16:14:12.791621] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.032 [2024-10-30 16:14:12.791636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.032 [2024-10-30 16:14:12.791648] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.032 [2024-10-30 16:14:12.791677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.032 qpair failed and we were unable to recover it. 00:30:23.032 [2024-10-30 16:14:12.801493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.032 [2024-10-30 16:14:12.801624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.032 [2024-10-30 16:14:12.801651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.032 [2024-10-30 16:14:12.801665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.032 [2024-10-30 16:14:12.801679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.032 [2024-10-30 16:14:12.801707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.032 qpair failed and we were unable to recover it. 00:30:23.032 [2024-10-30 16:14:12.811520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.032 [2024-10-30 16:14:12.811612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.032 [2024-10-30 16:14:12.811636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.032 [2024-10-30 16:14:12.811651] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.032 [2024-10-30 16:14:12.811663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.032 [2024-10-30 16:14:12.811691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.032 qpair failed and we were unable to recover it. 00:30:23.032 [2024-10-30 16:14:12.821581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.032 [2024-10-30 16:14:12.821664] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.032 [2024-10-30 16:14:12.821692] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.032 [2024-10-30 16:14:12.821708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.032 [2024-10-30 16:14:12.821720] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.032 [2024-10-30 16:14:12.821748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.032 qpair failed and we were unable to recover it. 00:30:23.032 [2024-10-30 16:14:12.831651] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.032 [2024-10-30 16:14:12.831785] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.032 [2024-10-30 16:14:12.831811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.032 [2024-10-30 16:14:12.831827] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.032 [2024-10-30 16:14:12.831840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.032 [2024-10-30 16:14:12.831870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.032 qpair failed and we were unable to recover it. 00:30:23.032 [2024-10-30 16:14:12.841632] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.032 [2024-10-30 16:14:12.841763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.032 [2024-10-30 16:14:12.841793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.032 [2024-10-30 16:14:12.841809] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.032 [2024-10-30 16:14:12.841823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.032 [2024-10-30 16:14:12.841852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.032 qpair failed and we were unable to recover it. 00:30:23.032 [2024-10-30 16:14:12.851682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.032 [2024-10-30 16:14:12.851790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.032 [2024-10-30 16:14:12.851819] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.032 [2024-10-30 16:14:12.851835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.032 [2024-10-30 16:14:12.851848] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.032 [2024-10-30 16:14:12.851878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.032 qpair failed and we were unable to recover it. 00:30:23.032 [2024-10-30 16:14:12.861685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.032 [2024-10-30 16:14:12.861772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.032 [2024-10-30 16:14:12.861798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.032 [2024-10-30 16:14:12.861813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.032 [2024-10-30 16:14:12.861825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.032 [2024-10-30 16:14:12.861854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.032 qpair failed and we were unable to recover it. 00:30:23.032 [2024-10-30 16:14:12.871741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.032 [2024-10-30 16:14:12.871831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.032 [2024-10-30 16:14:12.871856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.032 [2024-10-30 16:14:12.871877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.032 [2024-10-30 16:14:12.871890] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.032 [2024-10-30 16:14:12.871919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.032 qpair failed and we were unable to recover it. 00:30:23.032 [2024-10-30 16:14:12.881782] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.032 [2024-10-30 16:14:12.881880] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.032 [2024-10-30 16:14:12.881906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.032 [2024-10-30 16:14:12.881920] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.032 [2024-10-30 16:14:12.881933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.032 [2024-10-30 16:14:12.881961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.032 qpair failed and we were unable to recover it. 00:30:23.032 [2024-10-30 16:14:12.891770] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.033 [2024-10-30 16:14:12.891875] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.033 [2024-10-30 16:14:12.891900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.033 [2024-10-30 16:14:12.891915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.033 [2024-10-30 16:14:12.891928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.033 [2024-10-30 16:14:12.891957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.033 qpair failed and we were unable to recover it. 00:30:23.033 [2024-10-30 16:14:12.901804] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.033 [2024-10-30 16:14:12.901889] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.033 [2024-10-30 16:14:12.901914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.033 [2024-10-30 16:14:12.901929] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.033 [2024-10-30 16:14:12.901941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.033 [2024-10-30 16:14:12.901969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.033 qpair failed and we were unable to recover it. 00:30:23.292 [2024-10-30 16:14:12.911898] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.292 [2024-10-30 16:14:12.911990] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.292 [2024-10-30 16:14:12.912016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.292 [2024-10-30 16:14:12.912031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.292 [2024-10-30 16:14:12.912044] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.292 [2024-10-30 16:14:12.912073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.292 qpair failed and we were unable to recover it. 00:30:23.292 [2024-10-30 16:14:12.921887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.292 [2024-10-30 16:14:12.921979] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.292 [2024-10-30 16:14:12.922005] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.292 [2024-10-30 16:14:12.922020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.292 [2024-10-30 16:14:12.922033] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.292 [2024-10-30 16:14:12.922061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.292 qpair failed and we were unable to recover it. 00:30:23.292 [2024-10-30 16:14:12.931899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.292 [2024-10-30 16:14:12.931991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.292 [2024-10-30 16:14:12.932016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.292 [2024-10-30 16:14:12.932030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.292 [2024-10-30 16:14:12.932043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.292 [2024-10-30 16:14:12.932071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.292 qpair failed and we were unable to recover it. 00:30:23.292 [2024-10-30 16:14:12.941910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.292 [2024-10-30 16:14:12.942000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.292 [2024-10-30 16:14:12.942025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.292 [2024-10-30 16:14:12.942039] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.292 [2024-10-30 16:14:12.942051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.292 [2024-10-30 16:14:12.942080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.292 qpair failed and we were unable to recover it. 00:30:23.292 [2024-10-30 16:14:12.951964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.292 [2024-10-30 16:14:12.952089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.292 [2024-10-30 16:14:12.952113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.292 [2024-10-30 16:14:12.952128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.292 [2024-10-30 16:14:12.952141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.292 [2024-10-30 16:14:12.952170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.292 qpair failed and we were unable to recover it. 00:30:23.292 [2024-10-30 16:14:12.961983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.292 [2024-10-30 16:14:12.962066] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.292 [2024-10-30 16:14:12.962091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.292 [2024-10-30 16:14:12.962110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.292 [2024-10-30 16:14:12.962123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.292 [2024-10-30 16:14:12.962153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.292 qpair failed and we were unable to recover it. 00:30:23.292 [2024-10-30 16:14:12.972007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.292 [2024-10-30 16:14:12.972092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.292 [2024-10-30 16:14:12.972117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.292 [2024-10-30 16:14:12.972131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.292 [2024-10-30 16:14:12.972144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.292 [2024-10-30 16:14:12.972174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.292 qpair failed and we were unable to recover it. 00:30:23.292 [2024-10-30 16:14:12.982037] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.292 [2024-10-30 16:14:12.982124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.292 [2024-10-30 16:14:12.982149] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.292 [2024-10-30 16:14:12.982164] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.292 [2024-10-30 16:14:12.982177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.292 [2024-10-30 16:14:12.982205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.292 qpair failed and we were unable to recover it. 00:30:23.292 [2024-10-30 16:14:12.992053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.292 [2024-10-30 16:14:12.992148] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.292 [2024-10-30 16:14:12.992172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.292 [2024-10-30 16:14:12.992187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.292 [2024-10-30 16:14:12.992199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.292 [2024-10-30 16:14:12.992228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.292 qpair failed and we were unable to recover it. 00:30:23.292 [2024-10-30 16:14:13.002119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.292 [2024-10-30 16:14:13.002252] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.292 [2024-10-30 16:14:13.002289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.292 [2024-10-30 16:14:13.002305] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.292 [2024-10-30 16:14:13.002319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.292 [2024-10-30 16:14:13.002349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.292 qpair failed and we were unable to recover it. 00:30:23.292 [2024-10-30 16:14:13.012114] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.292 [2024-10-30 16:14:13.012200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.292 [2024-10-30 16:14:13.012226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.292 [2024-10-30 16:14:13.012240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.292 [2024-10-30 16:14:13.012252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.292 [2024-10-30 16:14:13.012290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.292 qpair failed and we were unable to recover it. 00:30:23.292 [2024-10-30 16:14:13.022210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.292 [2024-10-30 16:14:13.022305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.292 [2024-10-30 16:14:13.022330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.292 [2024-10-30 16:14:13.022344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.292 [2024-10-30 16:14:13.022357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.292 [2024-10-30 16:14:13.022385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.292 qpair failed and we were unable to recover it. 00:30:23.292 [2024-10-30 16:14:13.032204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.292 [2024-10-30 16:14:13.032309] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.292 [2024-10-30 16:14:13.032334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.292 [2024-10-30 16:14:13.032349] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.292 [2024-10-30 16:14:13.032362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.292 [2024-10-30 16:14:13.032391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.292 qpair failed and we were unable to recover it. 00:30:23.292 [2024-10-30 16:14:13.042228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.293 [2024-10-30 16:14:13.042331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.293 [2024-10-30 16:14:13.042355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.293 [2024-10-30 16:14:13.042369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.293 [2024-10-30 16:14:13.042382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.293 [2024-10-30 16:14:13.042411] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.293 qpair failed and we were unable to recover it. 00:30:23.293 [2024-10-30 16:14:13.052234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.293 [2024-10-30 16:14:13.052330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.293 [2024-10-30 16:14:13.052355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.293 [2024-10-30 16:14:13.052376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.293 [2024-10-30 16:14:13.052390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.293 [2024-10-30 16:14:13.052420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.293 qpair failed and we were unable to recover it. 00:30:23.293 [2024-10-30 16:14:13.062288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.293 [2024-10-30 16:14:13.062379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.293 [2024-10-30 16:14:13.062406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.293 [2024-10-30 16:14:13.062421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.293 [2024-10-30 16:14:13.062434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.293 [2024-10-30 16:14:13.062463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.293 qpair failed and we were unable to recover it. 00:30:23.293 [2024-10-30 16:14:13.072351] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.293 [2024-10-30 16:14:13.072452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.293 [2024-10-30 16:14:13.072481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.293 [2024-10-30 16:14:13.072498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.293 [2024-10-30 16:14:13.072512] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.293 [2024-10-30 16:14:13.072542] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.293 qpair failed and we were unable to recover it. 00:30:23.293 [2024-10-30 16:14:13.082307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.293 [2024-10-30 16:14:13.082427] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.293 [2024-10-30 16:14:13.082453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.293 [2024-10-30 16:14:13.082468] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.293 [2024-10-30 16:14:13.082482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.293 [2024-10-30 16:14:13.082512] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.293 qpair failed and we were unable to recover it. 00:30:23.293 [2024-10-30 16:14:13.092348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.293 [2024-10-30 16:14:13.092438] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.293 [2024-10-30 16:14:13.092465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.293 [2024-10-30 16:14:13.092480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.293 [2024-10-30 16:14:13.092492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.293 [2024-10-30 16:14:13.092522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.293 qpair failed and we were unable to recover it. 00:30:23.293 [2024-10-30 16:14:13.102376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.293 [2024-10-30 16:14:13.102474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.293 [2024-10-30 16:14:13.102498] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.293 [2024-10-30 16:14:13.102512] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.293 [2024-10-30 16:14:13.102525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.293 [2024-10-30 16:14:13.102553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.293 qpair failed and we were unable to recover it. 00:30:23.293 [2024-10-30 16:14:13.112460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.293 [2024-10-30 16:14:13.112558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.293 [2024-10-30 16:14:13.112583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.293 [2024-10-30 16:14:13.112598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.293 [2024-10-30 16:14:13.112610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.293 [2024-10-30 16:14:13.112639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.293 qpair failed and we were unable to recover it. 00:30:23.293 [2024-10-30 16:14:13.122421] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.293 [2024-10-30 16:14:13.122514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.293 [2024-10-30 16:14:13.122538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.293 [2024-10-30 16:14:13.122552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.293 [2024-10-30 16:14:13.122564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.293 [2024-10-30 16:14:13.122593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.293 qpair failed and we were unable to recover it. 00:30:23.293 [2024-10-30 16:14:13.132468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.293 [2024-10-30 16:14:13.132557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.293 [2024-10-30 16:14:13.132584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.293 [2024-10-30 16:14:13.132598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.293 [2024-10-30 16:14:13.132611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.293 [2024-10-30 16:14:13.132641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.293 qpair failed and we were unable to recover it. 00:30:23.293 [2024-10-30 16:14:13.142495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.293 [2024-10-30 16:14:13.142576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.293 [2024-10-30 16:14:13.142607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.293 [2024-10-30 16:14:13.142622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.293 [2024-10-30 16:14:13.142638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.293 [2024-10-30 16:14:13.142667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.293 qpair failed and we were unable to recover it. 00:30:23.293 [2024-10-30 16:14:13.152570] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.293 [2024-10-30 16:14:13.152674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.293 [2024-10-30 16:14:13.152700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.293 [2024-10-30 16:14:13.152715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.293 [2024-10-30 16:14:13.152728] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.293 [2024-10-30 16:14:13.152758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.293 qpair failed and we were unable to recover it. 00:30:23.293 [2024-10-30 16:14:13.162552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.293 [2024-10-30 16:14:13.162637] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.293 [2024-10-30 16:14:13.162662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.293 [2024-10-30 16:14:13.162677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.293 [2024-10-30 16:14:13.162690] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.293 [2024-10-30 16:14:13.162721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.293 qpair failed and we were unable to recover it. 00:30:23.552 [2024-10-30 16:14:13.172575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.552 [2024-10-30 16:14:13.172661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.552 [2024-10-30 16:14:13.172688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.552 [2024-10-30 16:14:13.172703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.552 [2024-10-30 16:14:13.172716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.552 [2024-10-30 16:14:13.172746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.552 qpair failed and we were unable to recover it. 00:30:23.552 [2024-10-30 16:14:13.182621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.552 [2024-10-30 16:14:13.182706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.552 [2024-10-30 16:14:13.182734] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.552 [2024-10-30 16:14:13.182749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.552 [2024-10-30 16:14:13.182762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.552 [2024-10-30 16:14:13.182792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.552 qpair failed and we were unable to recover it. 00:30:23.552 [2024-10-30 16:14:13.192662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.552 [2024-10-30 16:14:13.192780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.552 [2024-10-30 16:14:13.192809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.552 [2024-10-30 16:14:13.192824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.552 [2024-10-30 16:14:13.192838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.552 [2024-10-30 16:14:13.192866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.552 qpair failed and we were unable to recover it. 00:30:23.552 [2024-10-30 16:14:13.202703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.552 [2024-10-30 16:14:13.202824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.552 [2024-10-30 16:14:13.202849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.202863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.553 [2024-10-30 16:14:13.202876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.553 [2024-10-30 16:14:13.202906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.553 qpair failed and we were unable to recover it. 00:30:23.553 [2024-10-30 16:14:13.212717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.553 [2024-10-30 16:14:13.212805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.553 [2024-10-30 16:14:13.212832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.212847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.553 [2024-10-30 16:14:13.212859] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.553 [2024-10-30 16:14:13.212888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.553 qpair failed and we were unable to recover it. 00:30:23.553 [2024-10-30 16:14:13.222714] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.553 [2024-10-30 16:14:13.222807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.553 [2024-10-30 16:14:13.222833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.222848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.553 [2024-10-30 16:14:13.222861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.553 [2024-10-30 16:14:13.222891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.553 qpair failed and we were unable to recover it. 00:30:23.553 [2024-10-30 16:14:13.232810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.553 [2024-10-30 16:14:13.232901] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.553 [2024-10-30 16:14:13.232933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.232948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.553 [2024-10-30 16:14:13.232962] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.553 [2024-10-30 16:14:13.232992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.553 qpair failed and we were unable to recover it. 00:30:23.553 [2024-10-30 16:14:13.242779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.553 [2024-10-30 16:14:13.242865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.553 [2024-10-30 16:14:13.242891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.242906] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.553 [2024-10-30 16:14:13.242919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.553 [2024-10-30 16:14:13.242948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.553 qpair failed and we were unable to recover it. 00:30:23.553 [2024-10-30 16:14:13.252878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.553 [2024-10-30 16:14:13.252998] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.553 [2024-10-30 16:14:13.253025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.253040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.553 [2024-10-30 16:14:13.253052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.553 [2024-10-30 16:14:13.253082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.553 qpair failed and we were unable to recover it. 00:30:23.553 [2024-10-30 16:14:13.262859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.553 [2024-10-30 16:14:13.262948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.553 [2024-10-30 16:14:13.262974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.262988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.553 [2024-10-30 16:14:13.263001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.553 [2024-10-30 16:14:13.263031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.553 qpair failed and we were unable to recover it. 00:30:23.553 [2024-10-30 16:14:13.272886] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.553 [2024-10-30 16:14:13.272980] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.553 [2024-10-30 16:14:13.273006] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.273021] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.553 [2024-10-30 16:14:13.273034] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.553 [2024-10-30 16:14:13.273069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.553 qpair failed and we were unable to recover it. 00:30:23.553 [2024-10-30 16:14:13.282896] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.553 [2024-10-30 16:14:13.283027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.553 [2024-10-30 16:14:13.283053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.283067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.553 [2024-10-30 16:14:13.283080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.553 [2024-10-30 16:14:13.283110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.553 qpair failed and we were unable to recover it. 00:30:23.553 [2024-10-30 16:14:13.292955] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.553 [2024-10-30 16:14:13.293050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.553 [2024-10-30 16:14:13.293076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.293090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.553 [2024-10-30 16:14:13.293103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.553 [2024-10-30 16:14:13.293132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.553 qpair failed and we were unable to recover it. 00:30:23.553 [2024-10-30 16:14:13.302999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.553 [2024-10-30 16:14:13.303086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.553 [2024-10-30 16:14:13.303113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.303128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.553 [2024-10-30 16:14:13.303141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.553 [2024-10-30 16:14:13.303170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.553 qpair failed and we were unable to recover it. 00:30:23.553 [2024-10-30 16:14:13.313013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.553 [2024-10-30 16:14:13.313101] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.553 [2024-10-30 16:14:13.313127] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.313141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.553 [2024-10-30 16:14:13.313154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.553 [2024-10-30 16:14:13.313183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.553 qpair failed and we were unable to recover it. 00:30:23.553 [2024-10-30 16:14:13.323025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.553 [2024-10-30 16:14:13.323116] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.553 [2024-10-30 16:14:13.323147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.323162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.553 [2024-10-30 16:14:13.323175] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.553 [2024-10-30 16:14:13.323205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.553 qpair failed and we were unable to recover it. 00:30:23.553 [2024-10-30 16:14:13.333060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.553 [2024-10-30 16:14:13.333194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.553 [2024-10-30 16:14:13.333223] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.333241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.553 [2024-10-30 16:14:13.333262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.553 [2024-10-30 16:14:13.333295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.553 qpair failed and we were unable to recover it. 00:30:23.553 [2024-10-30 16:14:13.343119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.553 [2024-10-30 16:14:13.343204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.553 [2024-10-30 16:14:13.343231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.553 [2024-10-30 16:14:13.343245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.554 [2024-10-30 16:14:13.343265] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.554 [2024-10-30 16:14:13.343296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.554 qpair failed and we were unable to recover it. 00:30:23.554 [2024-10-30 16:14:13.353126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.554 [2024-10-30 16:14:13.353218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.554 [2024-10-30 16:14:13.353244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.554 [2024-10-30 16:14:13.353266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.554 [2024-10-30 16:14:13.353280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.554 [2024-10-30 16:14:13.353310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.554 qpair failed and we were unable to recover it. 00:30:23.554 [2024-10-30 16:14:13.363173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.554 [2024-10-30 16:14:13.363282] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.554 [2024-10-30 16:14:13.363308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.554 [2024-10-30 16:14:13.363323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.554 [2024-10-30 16:14:13.363336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.554 [2024-10-30 16:14:13.363371] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.554 qpair failed and we were unable to recover it. 00:30:23.554 [2024-10-30 16:14:13.373166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.554 [2024-10-30 16:14:13.373294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.554 [2024-10-30 16:14:13.373320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.554 [2024-10-30 16:14:13.373335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.554 [2024-10-30 16:14:13.373349] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.554 [2024-10-30 16:14:13.373378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.554 qpair failed and we were unable to recover it. 00:30:23.554 [2024-10-30 16:14:13.383261] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.554 [2024-10-30 16:14:13.383357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.554 [2024-10-30 16:14:13.383383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.554 [2024-10-30 16:14:13.383397] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.554 [2024-10-30 16:14:13.383410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.554 [2024-10-30 16:14:13.383440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.554 qpair failed and we were unable to recover it. 00:30:23.554 [2024-10-30 16:14:13.393231] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.554 [2024-10-30 16:14:13.393331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.554 [2024-10-30 16:14:13.393357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.554 [2024-10-30 16:14:13.393373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.554 [2024-10-30 16:14:13.393385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.554 [2024-10-30 16:14:13.393416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.554 qpair failed and we were unable to recover it. 00:30:23.554 [2024-10-30 16:14:13.403251] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.554 [2024-10-30 16:14:13.403353] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.554 [2024-10-30 16:14:13.403378] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.554 [2024-10-30 16:14:13.403392] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.554 [2024-10-30 16:14:13.403405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.554 [2024-10-30 16:14:13.403436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.554 qpair failed and we were unable to recover it. 00:30:23.554 [2024-10-30 16:14:13.413281] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.554 [2024-10-30 16:14:13.413371] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.554 [2024-10-30 16:14:13.413402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.554 [2024-10-30 16:14:13.413417] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.554 [2024-10-30 16:14:13.413430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.554 [2024-10-30 16:14:13.413460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.554 qpair failed and we were unable to recover it. 00:30:23.554 [2024-10-30 16:14:13.423325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.554 [2024-10-30 16:14:13.423447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.554 [2024-10-30 16:14:13.423473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.554 [2024-10-30 16:14:13.423487] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.554 [2024-10-30 16:14:13.423500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.554 [2024-10-30 16:14:13.423530] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.554 qpair failed and we were unable to recover it. 00:30:23.815 [2024-10-30 16:14:13.433430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.815 [2024-10-30 16:14:13.433558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.815 [2024-10-30 16:14:13.433586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.815 [2024-10-30 16:14:13.433602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.815 [2024-10-30 16:14:13.433615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.815 [2024-10-30 16:14:13.433645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.815 qpair failed and we were unable to recover it. 00:30:23.815 [2024-10-30 16:14:13.443379] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.815 [2024-10-30 16:14:13.443463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.815 [2024-10-30 16:14:13.443491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.815 [2024-10-30 16:14:13.443506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.815 [2024-10-30 16:14:13.443518] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.815 [2024-10-30 16:14:13.443548] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.815 qpair failed and we were unable to recover it. 00:30:23.815 [2024-10-30 16:14:13.453437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.815 [2024-10-30 16:14:13.453566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.815 [2024-10-30 16:14:13.453593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.815 [2024-10-30 16:14:13.453608] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.815 [2024-10-30 16:14:13.453622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.815 [2024-10-30 16:14:13.453658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.815 qpair failed and we were unable to recover it. 00:30:23.815 [2024-10-30 16:14:13.463520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.815 [2024-10-30 16:14:13.463617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.815 [2024-10-30 16:14:13.463642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.815 [2024-10-30 16:14:13.463657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.815 [2024-10-30 16:14:13.463670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.815 [2024-10-30 16:14:13.463700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.815 qpair failed and we were unable to recover it. 00:30:23.815 [2024-10-30 16:14:13.473470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.815 [2024-10-30 16:14:13.473553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.815 [2024-10-30 16:14:13.473579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.815 [2024-10-30 16:14:13.473593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.815 [2024-10-30 16:14:13.473606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.815 [2024-10-30 16:14:13.473636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.815 qpair failed and we were unable to recover it. 00:30:23.815 [2024-10-30 16:14:13.483515] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.815 [2024-10-30 16:14:13.483643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.815 [2024-10-30 16:14:13.483669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.815 [2024-10-30 16:14:13.483684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.815 [2024-10-30 16:14:13.483697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.815 [2024-10-30 16:14:13.483727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.815 qpair failed and we were unable to recover it. 00:30:23.815 [2024-10-30 16:14:13.493536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.815 [2024-10-30 16:14:13.493614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.815 [2024-10-30 16:14:13.493640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.815 [2024-10-30 16:14:13.493654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.815 [2024-10-30 16:14:13.493666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.815 [2024-10-30 16:14:13.493696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.815 qpair failed and we were unable to recover it. 00:30:23.815 [2024-10-30 16:14:13.503552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.815 [2024-10-30 16:14:13.503641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.815 [2024-10-30 16:14:13.503672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.815 [2024-10-30 16:14:13.503688] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.815 [2024-10-30 16:14:13.503704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.815 [2024-10-30 16:14:13.503734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.815 qpair failed and we were unable to recover it. 00:30:23.815 [2024-10-30 16:14:13.513595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.815 [2024-10-30 16:14:13.513686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.815 [2024-10-30 16:14:13.513711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.815 [2024-10-30 16:14:13.513725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.815 [2024-10-30 16:14:13.513738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.815 [2024-10-30 16:14:13.513768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.815 qpair failed and we were unable to recover it. 00:30:23.815 [2024-10-30 16:14:13.523629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.815 [2024-10-30 16:14:13.523714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.815 [2024-10-30 16:14:13.523741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.815 [2024-10-30 16:14:13.523755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.815 [2024-10-30 16:14:13.523768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.815 [2024-10-30 16:14:13.523797] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.815 qpair failed and we were unable to recover it. 00:30:23.816 [2024-10-30 16:14:13.533615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.816 [2024-10-30 16:14:13.533704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.816 [2024-10-30 16:14:13.533730] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.816 [2024-10-30 16:14:13.533745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.816 [2024-10-30 16:14:13.533757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.816 [2024-10-30 16:14:13.533788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.816 qpair failed and we were unable to recover it. 00:30:23.816 [2024-10-30 16:14:13.543700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.816 [2024-10-30 16:14:13.543786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.816 [2024-10-30 16:14:13.543813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.816 [2024-10-30 16:14:13.543828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.816 [2024-10-30 16:14:13.543841] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.816 [2024-10-30 16:14:13.543878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.816 qpair failed and we were unable to recover it. 00:30:23.816 [2024-10-30 16:14:13.553705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.816 [2024-10-30 16:14:13.553794] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.816 [2024-10-30 16:14:13.553820] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.816 [2024-10-30 16:14:13.553835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.816 [2024-10-30 16:14:13.553849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.816 [2024-10-30 16:14:13.553879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.816 qpair failed and we were unable to recover it. 00:30:23.816 [2024-10-30 16:14:13.563714] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.816 [2024-10-30 16:14:13.563799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.816 [2024-10-30 16:14:13.563824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.816 [2024-10-30 16:14:13.563839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.816 [2024-10-30 16:14:13.563853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.816 [2024-10-30 16:14:13.563881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.816 qpair failed and we were unable to recover it. 00:30:23.816 [2024-10-30 16:14:13.573843] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.816 [2024-10-30 16:14:13.573934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.816 [2024-10-30 16:14:13.573960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.816 [2024-10-30 16:14:13.573975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.816 [2024-10-30 16:14:13.573988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.816 [2024-10-30 16:14:13.574018] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.816 qpair failed and we were unable to recover it. 00:30:23.816 [2024-10-30 16:14:13.583845] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.816 [2024-10-30 16:14:13.583953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.816 [2024-10-30 16:14:13.583979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.816 [2024-10-30 16:14:13.583993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.816 [2024-10-30 16:14:13.584006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.816 [2024-10-30 16:14:13.584035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.816 qpair failed and we were unable to recover it. 00:30:23.816 [2024-10-30 16:14:13.593876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.816 [2024-10-30 16:14:13.593999] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.816 [2024-10-30 16:14:13.594029] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.816 [2024-10-30 16:14:13.594045] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.816 [2024-10-30 16:14:13.594058] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.816 [2024-10-30 16:14:13.594088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.816 qpair failed and we were unable to recover it. 00:30:23.816 [2024-10-30 16:14:13.603906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.816 [2024-10-30 16:14:13.604000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.816 [2024-10-30 16:14:13.604026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.816 [2024-10-30 16:14:13.604041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.816 [2024-10-30 16:14:13.604054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.816 [2024-10-30 16:14:13.604083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.816 qpair failed and we were unable to recover it. 00:30:23.816 [2024-10-30 16:14:13.613891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.816 [2024-10-30 16:14:13.613979] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.816 [2024-10-30 16:14:13.614003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.816 [2024-10-30 16:14:13.614016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.816 [2024-10-30 16:14:13.614029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.816 [2024-10-30 16:14:13.614057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.816 qpair failed and we were unable to recover it. 00:30:23.816 [2024-10-30 16:14:13.623897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.816 [2024-10-30 16:14:13.623978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.816 [2024-10-30 16:14:13.624004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.816 [2024-10-30 16:14:13.624019] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.816 [2024-10-30 16:14:13.624031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.816 [2024-10-30 16:14:13.624061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.816 qpair failed and we were unable to recover it. 00:30:23.816 [2024-10-30 16:14:13.633949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.816 [2024-10-30 16:14:13.634041] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.816 [2024-10-30 16:14:13.634067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.816 [2024-10-30 16:14:13.634082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.816 [2024-10-30 16:14:13.634102] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.816 [2024-10-30 16:14:13.634131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.816 qpair failed and we were unable to recover it. 00:30:23.816 [2024-10-30 16:14:13.644020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.816 [2024-10-30 16:14:13.644114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.816 [2024-10-30 16:14:13.644140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.816 [2024-10-30 16:14:13.644155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.816 [2024-10-30 16:14:13.644167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.816 [2024-10-30 16:14:13.644196] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.816 qpair failed and we were unable to recover it. 00:30:23.816 [2024-10-30 16:14:13.653995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.816 [2024-10-30 16:14:13.654082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.816 [2024-10-30 16:14:13.654109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.816 [2024-10-30 16:14:13.654124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.816 [2024-10-30 16:14:13.654137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.817 [2024-10-30 16:14:13.654168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.817 qpair failed and we were unable to recover it. 00:30:23.817 [2024-10-30 16:14:13.664009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.817 [2024-10-30 16:14:13.664100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.817 [2024-10-30 16:14:13.664126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.817 [2024-10-30 16:14:13.664140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.817 [2024-10-30 16:14:13.664152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.817 [2024-10-30 16:14:13.664180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.817 qpair failed and we were unable to recover it. 00:30:23.817 [2024-10-30 16:14:13.674095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.817 [2024-10-30 16:14:13.674207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.817 [2024-10-30 16:14:13.674233] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.817 [2024-10-30 16:14:13.674247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.817 [2024-10-30 16:14:13.674266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.817 [2024-10-30 16:14:13.674297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.817 qpair failed and we were unable to recover it. 00:30:23.817 [2024-10-30 16:14:13.684098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.817 [2024-10-30 16:14:13.684191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.817 [2024-10-30 16:14:13.684217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.817 [2024-10-30 16:14:13.684231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.817 [2024-10-30 16:14:13.684244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:23.817 [2024-10-30 16:14:13.684280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.817 qpair failed and we were unable to recover it. 00:30:24.076 [2024-10-30 16:14:13.694092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.076 [2024-10-30 16:14:13.694177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.076 [2024-10-30 16:14:13.694205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.076 [2024-10-30 16:14:13.694220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.076 [2024-10-30 16:14:13.694233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.076 [2024-10-30 16:14:13.694271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.076 qpair failed and we were unable to recover it. 00:30:24.076 [2024-10-30 16:14:13.704155] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.076 [2024-10-30 16:14:13.704237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.076 [2024-10-30 16:14:13.704273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.076 [2024-10-30 16:14:13.704290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.076 [2024-10-30 16:14:13.704303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.076 [2024-10-30 16:14:13.704334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.076 qpair failed and we were unable to recover it. 00:30:24.076 [2024-10-30 16:14:13.714198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.076 [2024-10-30 16:14:13.714294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.076 [2024-10-30 16:14:13.714324] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.076 [2024-10-30 16:14:13.714340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.076 [2024-10-30 16:14:13.714353] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.076 [2024-10-30 16:14:13.714384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.076 qpair failed and we were unable to recover it. 00:30:24.076 [2024-10-30 16:14:13.724247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.076 [2024-10-30 16:14:13.724381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.076 [2024-10-30 16:14:13.724407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.076 [2024-10-30 16:14:13.724422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.076 [2024-10-30 16:14:13.724441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.076 [2024-10-30 16:14:13.724470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.076 qpair failed and we were unable to recover it. 00:30:24.076 [2024-10-30 16:14:13.734233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.076 [2024-10-30 16:14:13.734329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.076 [2024-10-30 16:14:13.734355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.076 [2024-10-30 16:14:13.734370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.076 [2024-10-30 16:14:13.734382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.076 [2024-10-30 16:14:13.734412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.076 qpair failed and we were unable to recover it. 00:30:24.076 [2024-10-30 16:14:13.744253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.076 [2024-10-30 16:14:13.744387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.076 [2024-10-30 16:14:13.744414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.076 [2024-10-30 16:14:13.744428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.076 [2024-10-30 16:14:13.744441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.076 [2024-10-30 16:14:13.744471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.076 qpair failed and we were unable to recover it. 00:30:24.076 [2024-10-30 16:14:13.754339] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.076 [2024-10-30 16:14:13.754430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.076 [2024-10-30 16:14:13.754458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.076 [2024-10-30 16:14:13.754473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.076 [2024-10-30 16:14:13.754486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.076 [2024-10-30 16:14:13.754517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.076 qpair failed and we were unable to recover it. 00:30:24.076 [2024-10-30 16:14:13.764323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.076 [2024-10-30 16:14:13.764433] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.076 [2024-10-30 16:14:13.764459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.076 [2024-10-30 16:14:13.764474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.076 [2024-10-30 16:14:13.764487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.076 [2024-10-30 16:14:13.764517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.076 qpair failed and we were unable to recover it. 00:30:24.076 [2024-10-30 16:14:13.774391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.076 [2024-10-30 16:14:13.774484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.076 [2024-10-30 16:14:13.774510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.076 [2024-10-30 16:14:13.774525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.076 [2024-10-30 16:14:13.774537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.076 [2024-10-30 16:14:13.774567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.076 qpair failed and we were unable to recover it. 00:30:24.076 [2024-10-30 16:14:13.784382] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.076 [2024-10-30 16:14:13.784494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.076 [2024-10-30 16:14:13.784520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.077 [2024-10-30 16:14:13.784534] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.077 [2024-10-30 16:14:13.784548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.077 [2024-10-30 16:14:13.784577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.077 qpair failed and we were unable to recover it. 00:30:24.077 [2024-10-30 16:14:13.794429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.077 [2024-10-30 16:14:13.794521] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.077 [2024-10-30 16:14:13.794547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.077 [2024-10-30 16:14:13.794561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.077 [2024-10-30 16:14:13.794574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.077 [2024-10-30 16:14:13.794603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.077 qpair failed and we were unable to recover it. 00:30:24.077 [2024-10-30 16:14:13.804479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.077 [2024-10-30 16:14:13.804568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.077 [2024-10-30 16:14:13.804594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.077 [2024-10-30 16:14:13.804610] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.077 [2024-10-30 16:14:13.804622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.077 [2024-10-30 16:14:13.804652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.077 qpair failed and we were unable to recover it. 00:30:24.077 [2024-10-30 16:14:13.814467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.077 [2024-10-30 16:14:13.814555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.077 [2024-10-30 16:14:13.814581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.077 [2024-10-30 16:14:13.814596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.077 [2024-10-30 16:14:13.814615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.077 [2024-10-30 16:14:13.814645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.077 qpair failed and we were unable to recover it. 00:30:24.077 [2024-10-30 16:14:13.824470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.077 [2024-10-30 16:14:13.824552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.077 [2024-10-30 16:14:13.824578] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.077 [2024-10-30 16:14:13.824593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.077 [2024-10-30 16:14:13.824605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.077 [2024-10-30 16:14:13.824635] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.077 qpair failed and we were unable to recover it. 00:30:24.077 [2024-10-30 16:14:13.834543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.077 [2024-10-30 16:14:13.834642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.077 [2024-10-30 16:14:13.834671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.077 [2024-10-30 16:14:13.834686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.077 [2024-10-30 16:14:13.834698] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.077 [2024-10-30 16:14:13.834728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.077 qpair failed and we were unable to recover it. 00:30:24.077 [2024-10-30 16:14:13.844538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.077 [2024-10-30 16:14:13.844632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.077 [2024-10-30 16:14:13.844658] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.077 [2024-10-30 16:14:13.844673] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.077 [2024-10-30 16:14:13.844685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.077 [2024-10-30 16:14:13.844715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.077 qpair failed and we were unable to recover it. 00:30:24.077 [2024-10-30 16:14:13.854600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.077 [2024-10-30 16:14:13.854731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.077 [2024-10-30 16:14:13.854760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.077 [2024-10-30 16:14:13.854777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.077 [2024-10-30 16:14:13.854790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.077 [2024-10-30 16:14:13.854821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.077 qpair failed and we were unable to recover it. 00:30:24.077 [2024-10-30 16:14:13.864580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.077 [2024-10-30 16:14:13.864681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.077 [2024-10-30 16:14:13.864708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.077 [2024-10-30 16:14:13.864723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.077 [2024-10-30 16:14:13.864736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.077 [2024-10-30 16:14:13.864766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.077 qpair failed and we were unable to recover it. 00:30:24.077 [2024-10-30 16:14:13.874634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.077 [2024-10-30 16:14:13.874765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.077 [2024-10-30 16:14:13.874791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.077 [2024-10-30 16:14:13.874806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.077 [2024-10-30 16:14:13.874819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.077 [2024-10-30 16:14:13.874849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.077 qpair failed and we were unable to recover it. 00:30:24.077 [2024-10-30 16:14:13.884703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.077 [2024-10-30 16:14:13.884786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.077 [2024-10-30 16:14:13.884812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.077 [2024-10-30 16:14:13.884826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.077 [2024-10-30 16:14:13.884839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.077 [2024-10-30 16:14:13.884869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.077 qpair failed and we were unable to recover it. 00:30:24.077 [2024-10-30 16:14:13.894760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.077 [2024-10-30 16:14:13.894849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.077 [2024-10-30 16:14:13.894875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.077 [2024-10-30 16:14:13.894889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.077 [2024-10-30 16:14:13.894902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.077 [2024-10-30 16:14:13.894930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.077 qpair failed and we were unable to recover it. 00:30:24.077 [2024-10-30 16:14:13.904707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.077 [2024-10-30 16:14:13.904788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.077 [2024-10-30 16:14:13.904813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.077 [2024-10-30 16:14:13.904828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.077 [2024-10-30 16:14:13.904847] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.077 [2024-10-30 16:14:13.904877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.077 qpair failed and we were unable to recover it. 00:30:24.077 [2024-10-30 16:14:13.914775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.077 [2024-10-30 16:14:13.914869] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.077 [2024-10-30 16:14:13.914894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.077 [2024-10-30 16:14:13.914909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.077 [2024-10-30 16:14:13.914922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.077 [2024-10-30 16:14:13.914951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.077 qpair failed and we were unable to recover it. 00:30:24.077 [2024-10-30 16:14:13.924783] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.077 [2024-10-30 16:14:13.924874] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.077 [2024-10-30 16:14:13.924899] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.078 [2024-10-30 16:14:13.924914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.078 [2024-10-30 16:14:13.924928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.078 [2024-10-30 16:14:13.924957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.078 qpair failed and we were unable to recover it. 00:30:24.078 [2024-10-30 16:14:13.934796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.078 [2024-10-30 16:14:13.934906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.078 [2024-10-30 16:14:13.934932] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.078 [2024-10-30 16:14:13.934947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.078 [2024-10-30 16:14:13.934961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.078 [2024-10-30 16:14:13.934989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.078 qpair failed and we were unable to recover it. 00:30:24.078 [2024-10-30 16:14:13.944880] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.078 [2024-10-30 16:14:13.944971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.078 [2024-10-30 16:14:13.944996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.078 [2024-10-30 16:14:13.945011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.078 [2024-10-30 16:14:13.945025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.078 [2024-10-30 16:14:13.945053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.078 qpair failed and we were unable to recover it. 00:30:24.337 [2024-10-30 16:14:13.954883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.337 [2024-10-30 16:14:13.954984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.337 [2024-10-30 16:14:13.955012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.337 [2024-10-30 16:14:13.955028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.337 [2024-10-30 16:14:13.955042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.337 [2024-10-30 16:14:13.955072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.337 qpair failed and we were unable to recover it. 00:30:24.337 [2024-10-30 16:14:13.964902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.337 [2024-10-30 16:14:13.965018] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.337 [2024-10-30 16:14:13.965046] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.337 [2024-10-30 16:14:13.965062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.337 [2024-10-30 16:14:13.965075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.337 [2024-10-30 16:14:13.965105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.337 qpair failed and we were unable to recover it. 00:30:24.337 [2024-10-30 16:14:13.974970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.337 [2024-10-30 16:14:13.975073] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.337 [2024-10-30 16:14:13.975100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.337 [2024-10-30 16:14:13.975115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.337 [2024-10-30 16:14:13.975129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.337 [2024-10-30 16:14:13.975158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.337 qpair failed and we were unable to recover it. 00:30:24.337 [2024-10-30 16:14:13.984992] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.337 [2024-10-30 16:14:13.985096] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.337 [2024-10-30 16:14:13.985126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.337 [2024-10-30 16:14:13.985143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.337 [2024-10-30 16:14:13.985157] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.337 [2024-10-30 16:14:13.985187] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.337 qpair failed and we were unable to recover it. 00:30:24.337 [2024-10-30 16:14:13.994995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.337 [2024-10-30 16:14:13.995088] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.337 [2024-10-30 16:14:13.995115] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.337 [2024-10-30 16:14:13.995136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.337 [2024-10-30 16:14:13.995151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.337 [2024-10-30 16:14:13.995182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.337 qpair failed and we were unable to recover it. 00:30:24.337 [2024-10-30 16:14:14.004998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.337 [2024-10-30 16:14:14.005092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.337 [2024-10-30 16:14:14.005119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.337 [2024-10-30 16:14:14.005134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.337 [2024-10-30 16:14:14.005147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.337 [2024-10-30 16:14:14.005177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.337 qpair failed and we were unable to recover it. 00:30:24.337 [2024-10-30 16:14:14.015053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.337 [2024-10-30 16:14:14.015143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.337 [2024-10-30 16:14:14.015170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.337 [2024-10-30 16:14:14.015185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.337 [2024-10-30 16:14:14.015199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.337 [2024-10-30 16:14:14.015228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.337 qpair failed and we were unable to recover it. 00:30:24.337 [2024-10-30 16:14:14.025077] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.337 [2024-10-30 16:14:14.025212] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.337 [2024-10-30 16:14:14.025239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.337 [2024-10-30 16:14:14.025253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.337 [2024-10-30 16:14:14.025275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.337 [2024-10-30 16:14:14.025305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.337 qpair failed and we were unable to recover it. 00:30:24.337 [2024-10-30 16:14:14.035159] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.337 [2024-10-30 16:14:14.035267] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.337 [2024-10-30 16:14:14.035293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.337 [2024-10-30 16:14:14.035307] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.337 [2024-10-30 16:14:14.035321] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.337 [2024-10-30 16:14:14.035350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.337 qpair failed and we were unable to recover it. 00:30:24.337 [2024-10-30 16:14:14.045123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.337 [2024-10-30 16:14:14.045262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.337 [2024-10-30 16:14:14.045296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.337 [2024-10-30 16:14:14.045313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.337 [2024-10-30 16:14:14.045325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.337 [2024-10-30 16:14:14.045354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.337 qpair failed and we were unable to recover it. 00:30:24.337 [2024-10-30 16:14:14.055166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.337 [2024-10-30 16:14:14.055270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.337 [2024-10-30 16:14:14.055296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.337 [2024-10-30 16:14:14.055310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.337 [2024-10-30 16:14:14.055325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.337 [2024-10-30 16:14:14.055353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.337 qpair failed and we were unable to recover it. 00:30:24.337 [2024-10-30 16:14:14.065197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.337 [2024-10-30 16:14:14.065289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.337 [2024-10-30 16:14:14.065316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.337 [2024-10-30 16:14:14.065330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.337 [2024-10-30 16:14:14.065344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.337 [2024-10-30 16:14:14.065374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.337 qpair failed and we were unable to recover it. 00:30:24.337 [2024-10-30 16:14:14.075245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.337 [2024-10-30 16:14:14.075353] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.338 [2024-10-30 16:14:14.075379] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.338 [2024-10-30 16:14:14.075394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.338 [2024-10-30 16:14:14.075408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.338 [2024-10-30 16:14:14.075436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.338 qpair failed and we were unable to recover it. 00:30:24.338 [2024-10-30 16:14:14.085292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.338 [2024-10-30 16:14:14.085387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.338 [2024-10-30 16:14:14.085414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.338 [2024-10-30 16:14:14.085436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.338 [2024-10-30 16:14:14.085451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.338 [2024-10-30 16:14:14.085480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.338 qpair failed and we were unable to recover it. 00:30:24.338 [2024-10-30 16:14:14.095311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.338 [2024-10-30 16:14:14.095401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.338 [2024-10-30 16:14:14.095428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.338 [2024-10-30 16:14:14.095443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.338 [2024-10-30 16:14:14.095457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.338 [2024-10-30 16:14:14.095486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.338 qpair failed and we were unable to recover it. 00:30:24.338 [2024-10-30 16:14:14.105317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.338 [2024-10-30 16:14:14.105410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.338 [2024-10-30 16:14:14.105437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.338 [2024-10-30 16:14:14.105452] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.338 [2024-10-30 16:14:14.105465] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.338 [2024-10-30 16:14:14.105495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.338 qpair failed and we were unable to recover it. 00:30:24.338 [2024-10-30 16:14:14.115346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.338 [2024-10-30 16:14:14.115442] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.338 [2024-10-30 16:14:14.115468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.338 [2024-10-30 16:14:14.115482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.338 [2024-10-30 16:14:14.115496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.338 [2024-10-30 16:14:14.115525] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.338 qpair failed and we were unable to recover it. 00:30:24.338 [2024-10-30 16:14:14.125404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.338 [2024-10-30 16:14:14.125531] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.338 [2024-10-30 16:14:14.125557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.338 [2024-10-30 16:14:14.125572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.338 [2024-10-30 16:14:14.125586] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.338 [2024-10-30 16:14:14.125614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.338 qpair failed and we were unable to recover it. 00:30:24.338 [2024-10-30 16:14:14.135391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.338 [2024-10-30 16:14:14.135483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.338 [2024-10-30 16:14:14.135508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.338 [2024-10-30 16:14:14.135523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.338 [2024-10-30 16:14:14.135536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.338 [2024-10-30 16:14:14.135565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.338 qpair failed and we were unable to recover it. 00:30:24.338 [2024-10-30 16:14:14.145452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.338 [2024-10-30 16:14:14.145538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.338 [2024-10-30 16:14:14.145564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.338 [2024-10-30 16:14:14.145578] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.338 [2024-10-30 16:14:14.145591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.338 [2024-10-30 16:14:14.145620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.338 qpair failed and we were unable to recover it. 00:30:24.338 [2024-10-30 16:14:14.155483] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.338 [2024-10-30 16:14:14.155572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.338 [2024-10-30 16:14:14.155597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.338 [2024-10-30 16:14:14.155611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.338 [2024-10-30 16:14:14.155624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.338 [2024-10-30 16:14:14.155654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.338 qpair failed and we were unable to recover it. 00:30:24.338 [2024-10-30 16:14:14.165488] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.338 [2024-10-30 16:14:14.165580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.338 [2024-10-30 16:14:14.165604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.338 [2024-10-30 16:14:14.165617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.338 [2024-10-30 16:14:14.165630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.338 [2024-10-30 16:14:14.165658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.338 qpair failed and we were unable to recover it. 00:30:24.338 [2024-10-30 16:14:14.175538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.338 [2024-10-30 16:14:14.175659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.338 [2024-10-30 16:14:14.175683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.338 [2024-10-30 16:14:14.175703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.338 [2024-10-30 16:14:14.175717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.338 [2024-10-30 16:14:14.175746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.338 qpair failed and we were unable to recover it. 00:30:24.338 [2024-10-30 16:14:14.185566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.338 [2024-10-30 16:14:14.185651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.338 [2024-10-30 16:14:14.185678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.338 [2024-10-30 16:14:14.185693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.338 [2024-10-30 16:14:14.185706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.338 [2024-10-30 16:14:14.185736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.338 qpair failed and we were unable to recover it. 00:30:24.338 [2024-10-30 16:14:14.195567] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.338 [2024-10-30 16:14:14.195656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.338 [2024-10-30 16:14:14.195681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.338 [2024-10-30 16:14:14.195696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.338 [2024-10-30 16:14:14.195709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.338 [2024-10-30 16:14:14.195737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.338 qpair failed and we were unable to recover it. 00:30:24.338 [2024-10-30 16:14:14.205586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.338 [2024-10-30 16:14:14.205704] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.338 [2024-10-30 16:14:14.205729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.338 [2024-10-30 16:14:14.205743] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.338 [2024-10-30 16:14:14.205756] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.338 [2024-10-30 16:14:14.205785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.338 qpair failed and we were unable to recover it. 00:30:24.597 [2024-10-30 16:14:14.215667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.597 [2024-10-30 16:14:14.215777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.597 [2024-10-30 16:14:14.215805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.597 [2024-10-30 16:14:14.215822] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.597 [2024-10-30 16:14:14.215835] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.598 [2024-10-30 16:14:14.215866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.598 qpair failed and we were unable to recover it. 00:30:24.598 [2024-10-30 16:14:14.225680] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.598 [2024-10-30 16:14:14.225769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.598 [2024-10-30 16:14:14.225796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.598 [2024-10-30 16:14:14.225811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.598 [2024-10-30 16:14:14.225825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.598 [2024-10-30 16:14:14.225856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.598 qpair failed and we were unable to recover it. 00:30:24.598 [2024-10-30 16:14:14.235735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.598 [2024-10-30 16:14:14.235823] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.598 [2024-10-30 16:14:14.235849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.598 [2024-10-30 16:14:14.235864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.598 [2024-10-30 16:14:14.235877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.598 [2024-10-30 16:14:14.235907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.598 qpair failed and we were unable to recover it. 00:30:24.598 [2024-10-30 16:14:14.245750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.598 [2024-10-30 16:14:14.245841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.598 [2024-10-30 16:14:14.245867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.598 [2024-10-30 16:14:14.245881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.598 [2024-10-30 16:14:14.245894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.598 [2024-10-30 16:14:14.245932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.598 qpair failed and we were unable to recover it. 00:30:24.598 [2024-10-30 16:14:14.255781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.598 [2024-10-30 16:14:14.255867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.598 [2024-10-30 16:14:14.255892] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.598 [2024-10-30 16:14:14.255906] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.598 [2024-10-30 16:14:14.255919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.598 [2024-10-30 16:14:14.255948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.598 qpair failed and we were unable to recover it. 00:30:24.598 [2024-10-30 16:14:14.265765] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.598 [2024-10-30 16:14:14.265881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.598 [2024-10-30 16:14:14.265906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.598 [2024-10-30 16:14:14.265926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.598 [2024-10-30 16:14:14.265940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.598 [2024-10-30 16:14:14.265969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.598 qpair failed and we were unable to recover it. 00:30:24.598 [2024-10-30 16:14:14.275827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.598 [2024-10-30 16:14:14.275946] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.598 [2024-10-30 16:14:14.275973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.598 [2024-10-30 16:14:14.275987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.598 [2024-10-30 16:14:14.276000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.598 [2024-10-30 16:14:14.276028] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.598 qpair failed and we were unable to recover it. 00:30:24.598 [2024-10-30 16:14:14.285874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.598 [2024-10-30 16:14:14.285976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.598 [2024-10-30 16:14:14.286002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.598 [2024-10-30 16:14:14.286017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.598 [2024-10-30 16:14:14.286030] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.598 [2024-10-30 16:14:14.286059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.598 qpair failed and we were unable to recover it. 00:30:24.598 [2024-10-30 16:14:14.295905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.598 [2024-10-30 16:14:14.296016] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.598 [2024-10-30 16:14:14.296043] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.598 [2024-10-30 16:14:14.296058] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.598 [2024-10-30 16:14:14.296071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.598 [2024-10-30 16:14:14.296101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.598 qpair failed and we were unable to recover it. 00:30:24.598 [2024-10-30 16:14:14.305883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.598 [2024-10-30 16:14:14.305966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.598 [2024-10-30 16:14:14.305992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.598 [2024-10-30 16:14:14.306007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.598 [2024-10-30 16:14:14.306020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.598 [2024-10-30 16:14:14.306050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.598 qpair failed and we were unable to recover it. 00:30:24.598 [2024-10-30 16:14:14.315922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.598 [2024-10-30 16:14:14.316029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.598 [2024-10-30 16:14:14.316053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.598 [2024-10-30 16:14:14.316068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.598 [2024-10-30 16:14:14.316081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.598 [2024-10-30 16:14:14.316109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.598 qpair failed and we were unable to recover it. 00:30:24.598 [2024-10-30 16:14:14.325956] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.598 [2024-10-30 16:14:14.326044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.598 [2024-10-30 16:14:14.326068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.598 [2024-10-30 16:14:14.326082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.598 [2024-10-30 16:14:14.326094] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.598 [2024-10-30 16:14:14.326123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.598 qpair failed and we were unable to recover it. 00:30:24.598 [2024-10-30 16:14:14.335986] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.598 [2024-10-30 16:14:14.336068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.598 [2024-10-30 16:14:14.336092] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.598 [2024-10-30 16:14:14.336106] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.598 [2024-10-30 16:14:14.336118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.598 [2024-10-30 16:14:14.336146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.598 qpair failed and we were unable to recover it. 00:30:24.598 [2024-10-30 16:14:14.346015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.598 [2024-10-30 16:14:14.346106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.598 [2024-10-30 16:14:14.346130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.598 [2024-10-30 16:14:14.346144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.598 [2024-10-30 16:14:14.346157] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.598 [2024-10-30 16:14:14.346186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.598 qpair failed and we were unable to recover it. 00:30:24.598 [2024-10-30 16:14:14.356042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.598 [2024-10-30 16:14:14.356135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.598 [2024-10-30 16:14:14.356181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.599 [2024-10-30 16:14:14.356197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.599 [2024-10-30 16:14:14.356210] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.599 [2024-10-30 16:14:14.356239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.599 qpair failed and we were unable to recover it. 00:30:24.599 [2024-10-30 16:14:14.366064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.599 [2024-10-30 16:14:14.366148] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.599 [2024-10-30 16:14:14.366173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.599 [2024-10-30 16:14:14.366187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.599 [2024-10-30 16:14:14.366200] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.599 [2024-10-30 16:14:14.366228] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.599 qpair failed and we were unable to recover it. 00:30:24.599 [2024-10-30 16:14:14.376107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.599 [2024-10-30 16:14:14.376240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.599 [2024-10-30 16:14:14.376272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.599 [2024-10-30 16:14:14.376287] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.599 [2024-10-30 16:14:14.376303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.599 [2024-10-30 16:14:14.376332] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.599 qpair failed and we were unable to recover it. 00:30:24.599 [2024-10-30 16:14:14.386137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.599 [2024-10-30 16:14:14.386223] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.599 [2024-10-30 16:14:14.386248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.599 [2024-10-30 16:14:14.386272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.599 [2024-10-30 16:14:14.386286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.599 [2024-10-30 16:14:14.386314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.599 qpair failed and we were unable to recover it. 00:30:24.599 [2024-10-30 16:14:14.396193] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.599 [2024-10-30 16:14:14.396290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.599 [2024-10-30 16:14:14.396315] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.599 [2024-10-30 16:14:14.396330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.599 [2024-10-30 16:14:14.396342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.599 [2024-10-30 16:14:14.396371] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.599 qpair failed and we were unable to recover it. 00:30:24.599 [2024-10-30 16:14:14.406212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.599 [2024-10-30 16:14:14.406304] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.599 [2024-10-30 16:14:14.406329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.599 [2024-10-30 16:14:14.406343] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.599 [2024-10-30 16:14:14.406356] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.599 [2024-10-30 16:14:14.406384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.599 qpair failed and we were unable to recover it. 00:30:24.599 [2024-10-30 16:14:14.416228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.599 [2024-10-30 16:14:14.416337] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.599 [2024-10-30 16:14:14.416362] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.599 [2024-10-30 16:14:14.416377] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.599 [2024-10-30 16:14:14.416389] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.599 [2024-10-30 16:14:14.416418] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.599 qpair failed and we were unable to recover it. 00:30:24.599 [2024-10-30 16:14:14.426275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.599 [2024-10-30 16:14:14.426401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.599 [2024-10-30 16:14:14.426428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.599 [2024-10-30 16:14:14.426444] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.599 [2024-10-30 16:14:14.426457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.599 [2024-10-30 16:14:14.426486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.599 qpair failed and we were unable to recover it. 00:30:24.599 [2024-10-30 16:14:14.436326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.599 [2024-10-30 16:14:14.436435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.599 [2024-10-30 16:14:14.436459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.599 [2024-10-30 16:14:14.436473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.599 [2024-10-30 16:14:14.436487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.599 [2024-10-30 16:14:14.436517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.599 qpair failed and we were unable to recover it. 00:30:24.599 [2024-10-30 16:14:14.446341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.599 [2024-10-30 16:14:14.446477] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.599 [2024-10-30 16:14:14.446513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.599 [2024-10-30 16:14:14.446530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.599 [2024-10-30 16:14:14.446543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.599 [2024-10-30 16:14:14.446572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.599 qpair failed and we were unable to recover it. 00:30:24.599 [2024-10-30 16:14:14.456334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.599 [2024-10-30 16:14:14.456427] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.599 [2024-10-30 16:14:14.456452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.599 [2024-10-30 16:14:14.456466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.599 [2024-10-30 16:14:14.456479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.599 [2024-10-30 16:14:14.456510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.599 qpair failed and we were unable to recover it. 00:30:24.599 [2024-10-30 16:14:14.466350] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.599 [2024-10-30 16:14:14.466435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.599 [2024-10-30 16:14:14.466461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.599 [2024-10-30 16:14:14.466476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.599 [2024-10-30 16:14:14.466489] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.599 [2024-10-30 16:14:14.466518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.599 qpair failed and we were unable to recover it. 00:30:24.858 [2024-10-30 16:14:14.476408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.858 [2024-10-30 16:14:14.476538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.858 [2024-10-30 16:14:14.476570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.858 [2024-10-30 16:14:14.476587] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.858 [2024-10-30 16:14:14.476601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.858 [2024-10-30 16:14:14.476631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.858 qpair failed and we were unable to recover it. 00:30:24.858 [2024-10-30 16:14:14.486417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.858 [2024-10-30 16:14:14.486511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.859 [2024-10-30 16:14:14.486537] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.859 [2024-10-30 16:14:14.486552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.859 [2024-10-30 16:14:14.486564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.859 [2024-10-30 16:14:14.486599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.859 qpair failed and we were unable to recover it. 00:30:24.859 [2024-10-30 16:14:14.496439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.859 [2024-10-30 16:14:14.496523] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.859 [2024-10-30 16:14:14.496549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.859 [2024-10-30 16:14:14.496564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.859 [2024-10-30 16:14:14.496576] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.859 [2024-10-30 16:14:14.496605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.859 qpair failed and we were unable to recover it. 00:30:24.859 [2024-10-30 16:14:14.506474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.859 [2024-10-30 16:14:14.506561] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.859 [2024-10-30 16:14:14.506586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.859 [2024-10-30 16:14:14.506600] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.859 [2024-10-30 16:14:14.506613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.859 [2024-10-30 16:14:14.506642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.859 qpair failed and we were unable to recover it. 00:30:24.859 [2024-10-30 16:14:14.516508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.859 [2024-10-30 16:14:14.516596] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.859 [2024-10-30 16:14:14.516624] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.859 [2024-10-30 16:14:14.516639] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.859 [2024-10-30 16:14:14.516652] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.859 [2024-10-30 16:14:14.516681] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.859 qpair failed and we were unable to recover it. 00:30:24.859 [2024-10-30 16:14:14.526552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.859 [2024-10-30 16:14:14.526642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.859 [2024-10-30 16:14:14.526668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.859 [2024-10-30 16:14:14.526683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.859 [2024-10-30 16:14:14.526695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.859 [2024-10-30 16:14:14.526726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.859 qpair failed and we were unable to recover it. 00:30:24.859 [2024-10-30 16:14:14.536571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.859 [2024-10-30 16:14:14.536681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.859 [2024-10-30 16:14:14.536712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.859 [2024-10-30 16:14:14.536728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.859 [2024-10-30 16:14:14.536741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.859 [2024-10-30 16:14:14.536770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.859 qpair failed and we were unable to recover it. 00:30:24.859 [2024-10-30 16:14:14.546600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.859 [2024-10-30 16:14:14.546687] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.859 [2024-10-30 16:14:14.546711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.859 [2024-10-30 16:14:14.546725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.859 [2024-10-30 16:14:14.546738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.859 [2024-10-30 16:14:14.546766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.859 qpair failed and we were unable to recover it. 00:30:24.859 [2024-10-30 16:14:14.556693] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.859 [2024-10-30 16:14:14.556825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.859 [2024-10-30 16:14:14.556850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.859 [2024-10-30 16:14:14.556864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.859 [2024-10-30 16:14:14.556878] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.859 [2024-10-30 16:14:14.556907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.859 qpair failed and we were unable to recover it. 00:30:24.859 [2024-10-30 16:14:14.566659] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.859 [2024-10-30 16:14:14.566776] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.859 [2024-10-30 16:14:14.566801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.859 [2024-10-30 16:14:14.566815] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.859 [2024-10-30 16:14:14.566828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.859 [2024-10-30 16:14:14.566857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.859 qpair failed and we were unable to recover it. 00:30:24.859 [2024-10-30 16:14:14.576648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.859 [2024-10-30 16:14:14.576773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.859 [2024-10-30 16:14:14.576798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.859 [2024-10-30 16:14:14.576813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.859 [2024-10-30 16:14:14.576826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.859 [2024-10-30 16:14:14.576860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.859 qpair failed and we were unable to recover it. 00:30:24.859 [2024-10-30 16:14:14.586747] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.859 [2024-10-30 16:14:14.586834] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.859 [2024-10-30 16:14:14.586859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.859 [2024-10-30 16:14:14.586874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.859 [2024-10-30 16:14:14.586886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.859 [2024-10-30 16:14:14.586915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.859 qpair failed and we were unable to recover it. 00:30:24.859 [2024-10-30 16:14:14.596718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.859 [2024-10-30 16:14:14.596806] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.859 [2024-10-30 16:14:14.596831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.859 [2024-10-30 16:14:14.596845] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.859 [2024-10-30 16:14:14.596858] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.859 [2024-10-30 16:14:14.596886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.859 qpair failed and we were unable to recover it. 00:30:24.859 [2024-10-30 16:14:14.606823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.859 [2024-10-30 16:14:14.606918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.859 [2024-10-30 16:14:14.606943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.859 [2024-10-30 16:14:14.606957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.859 [2024-10-30 16:14:14.606969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.859 [2024-10-30 16:14:14.606997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.859 qpair failed and we were unable to recover it. 00:30:24.859 [2024-10-30 16:14:14.616787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.859 [2024-10-30 16:14:14.616898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.859 [2024-10-30 16:14:14.616923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.859 [2024-10-30 16:14:14.616937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.859 [2024-10-30 16:14:14.616950] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.859 [2024-10-30 16:14:14.616978] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.859 qpair failed and we were unable to recover it. 00:30:24.859 [2024-10-30 16:14:14.626775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.860 [2024-10-30 16:14:14.626863] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.860 [2024-10-30 16:14:14.626893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.860 [2024-10-30 16:14:14.626908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.860 [2024-10-30 16:14:14.626921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.860 [2024-10-30 16:14:14.626950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.860 qpair failed and we were unable to recover it. 00:30:24.860 [2024-10-30 16:14:14.636847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.860 [2024-10-30 16:14:14.636936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.860 [2024-10-30 16:14:14.636961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.860 [2024-10-30 16:14:14.636975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.860 [2024-10-30 16:14:14.636988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.860 [2024-10-30 16:14:14.637016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.860 qpair failed and we were unable to recover it. 00:30:24.860 [2024-10-30 16:14:14.646889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.860 [2024-10-30 16:14:14.646979] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.860 [2024-10-30 16:14:14.647003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.860 [2024-10-30 16:14:14.647017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.860 [2024-10-30 16:14:14.647030] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x2303f20 00:30:24.860 [2024-10-30 16:14:14.647057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.860 qpair failed and we were unable to recover it. 00:30:24.860 [2024-10-30 16:14:14.647198] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:24.860 A controller has encountered a failure and is being reset. 00:30:24.860 [2024-10-30 16:14:14.656897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.860 [2024-10-30 16:14:14.657005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.860 [2024-10-30 16:14:14.657047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.860 [2024-10-30 16:14:14.657063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.860 [2024-10-30 16:14:14.657076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc54c000b90 00:30:24.860 [2024-10-30 16:14:14.657120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:24.860 qpair failed and we were unable to recover it. 00:30:24.860 [2024-10-30 16:14:14.666922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.860 [2024-10-30 16:14:14.667013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.860 [2024-10-30 16:14:14.667045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.860 [2024-10-30 16:14:14.667072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.860 [2024-10-30 16:14:14.667088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc54c000b90 00:30:24.860 [2024-10-30 16:14:14.667120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:24.860 qpair failed and we were unable to recover it. 00:30:24.860 Controller properly reset. 00:30:24.860 Initializing NVMe Controllers 00:30:24.860 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:24.860 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:24.860 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:24.860 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:24.860 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:24.860 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:24.860 Initialization complete. Launching workers. 00:30:24.860 Starting thread on core 1 00:30:24.860 Starting thread on core 2 00:30:24.860 Starting thread on core 3 00:30:24.860 Starting thread on core 0 00:30:24.860 16:14:14 -- host/target_disconnect.sh@59 -- # sync 00:30:24.860 00:30:24.860 real 0m11.427s 00:30:24.860 user 0m21.764s 00:30:24.860 sys 0m5.355s 00:30:24.860 16:14:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:24.860 16:14:14 -- common/autotest_common.sh@10 -- # set +x 00:30:24.860 ************************************ 00:30:24.860 END TEST nvmf_target_disconnect_tc2 00:30:24.860 ************************************ 00:30:24.860 16:14:14 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:24.860 16:14:14 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:24.860 16:14:14 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:24.860 16:14:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:24.860 16:14:14 -- nvmf/common.sh@116 -- # sync 00:30:24.860 16:14:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:24.860 16:14:14 -- nvmf/common.sh@119 -- # set +e 00:30:24.860 16:14:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:24.860 16:14:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:25.118 rmmod nvme_tcp 00:30:25.118 rmmod nvme_fabrics 00:30:25.118 rmmod nvme_keyring 00:30:25.118 16:14:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:25.118 16:14:14 -- nvmf/common.sh@123 -- # set -e 00:30:25.118 16:14:14 -- nvmf/common.sh@124 -- # return 0 00:30:25.118 16:14:14 -- nvmf/common.sh@477 -- # '[' -n 2550009 ']' 00:30:25.118 16:14:14 -- nvmf/common.sh@478 -- # killprocess 2550009 00:30:25.118 16:14:14 -- common/autotest_common.sh@926 -- # '[' -z 2550009 ']' 00:30:25.118 16:14:14 -- common/autotest_common.sh@930 -- # kill -0 2550009 00:30:25.118 16:14:14 -- common/autotest_common.sh@931 -- # uname 00:30:25.118 16:14:14 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:25.118 16:14:14 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2550009 00:30:25.118 16:14:14 -- common/autotest_common.sh@932 -- # process_name=reactor_4 00:30:25.118 16:14:14 -- common/autotest_common.sh@936 -- # '[' reactor_4 = sudo ']' 00:30:25.118 16:14:14 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2550009' 00:30:25.118 killing process with pid 2550009 00:30:25.118 16:14:14 -- common/autotest_common.sh@945 -- # kill 2550009 00:30:25.118 16:14:14 -- common/autotest_common.sh@950 -- # wait 2550009 00:30:25.376 16:14:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:25.376 16:14:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:25.376 16:14:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:25.376 16:14:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:25.376 16:14:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:25.376 16:14:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:25.376 16:14:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:25.376 16:14:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:27.279 16:14:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:27.279 00:30:27.279 real 0m16.193s 00:30:27.279 user 0m47.730s 00:30:27.279 sys 0m7.349s 00:30:27.279 16:14:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:27.279 16:14:17 -- common/autotest_common.sh@10 -- # set +x 00:30:27.279 ************************************ 00:30:27.279 END TEST nvmf_target_disconnect 00:30:27.279 ************************************ 00:30:27.279 16:14:17 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:27.279 16:14:17 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:27.279 16:14:17 -- common/autotest_common.sh@10 -- # set +x 00:30:27.538 16:14:17 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:27.538 00:30:27.538 real 22m47.914s 00:30:27.538 user 66m13.195s 00:30:27.538 sys 5m28.034s 00:30:27.538 16:14:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:27.538 16:14:17 -- common/autotest_common.sh@10 -- # set +x 00:30:27.538 ************************************ 00:30:27.538 END TEST nvmf_tcp 00:30:27.538 ************************************ 00:30:27.538 16:14:17 -- spdk/autotest.sh@296 -- # [[ 0 -eq 0 ]] 00:30:27.538 16:14:17 -- spdk/autotest.sh@297 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:27.538 16:14:17 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:30:27.538 16:14:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:27.538 16:14:17 -- common/autotest_common.sh@10 -- # set +x 00:30:27.538 ************************************ 00:30:27.538 START TEST spdkcli_nvmf_tcp 00:30:27.538 ************************************ 00:30:27.538 16:14:17 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:27.538 * Looking for test storage... 00:30:27.538 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:27.538 16:14:17 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:27.538 16:14:17 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:27.538 16:14:17 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:27.538 16:14:17 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:27.538 16:14:17 -- nvmf/common.sh@7 -- # uname -s 00:30:27.538 16:14:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:27.538 16:14:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:27.538 16:14:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:27.538 16:14:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:27.538 16:14:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:27.538 16:14:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:27.538 16:14:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:27.538 16:14:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:27.538 16:14:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:27.538 16:14:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:27.538 16:14:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:27.538 16:14:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:27.538 16:14:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:27.538 16:14:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:27.538 16:14:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:27.538 16:14:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:27.538 16:14:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:27.538 16:14:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:27.538 16:14:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:27.538 16:14:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:27.538 16:14:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:27.538 16:14:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:27.538 16:14:17 -- paths/export.sh@5 -- # export PATH 00:30:27.538 16:14:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:27.538 16:14:17 -- nvmf/common.sh@46 -- # : 0 00:30:27.538 16:14:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:27.538 16:14:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:27.538 16:14:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:27.538 16:14:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:27.538 16:14:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:27.538 16:14:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:27.538 16:14:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:27.538 16:14:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:27.538 16:14:17 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:27.538 16:14:17 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:27.538 16:14:17 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:27.538 16:14:17 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:27.538 16:14:17 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:27.538 16:14:17 -- common/autotest_common.sh@10 -- # set +x 00:30:27.538 16:14:17 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:27.538 16:14:17 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=2551230 00:30:27.538 16:14:17 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:27.538 16:14:17 -- spdkcli/common.sh@34 -- # waitforlisten 2551230 00:30:27.538 16:14:17 -- common/autotest_common.sh@819 -- # '[' -z 2551230 ']' 00:30:27.538 16:14:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:27.538 16:14:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:27.538 16:14:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:27.538 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:27.538 16:14:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:27.538 16:14:17 -- common/autotest_common.sh@10 -- # set +x 00:30:27.538 [2024-10-30 16:14:17.314735] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:30:27.538 [2024-10-30 16:14:17.314834] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2551230 ] 00:30:27.538 EAL: No free 2048 kB hugepages reported on node 1 00:30:27.538 [2024-10-30 16:14:17.374730] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:27.797 [2024-10-30 16:14:17.461810] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:27.797 [2024-10-30 16:14:17.463279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:27.797 [2024-10-30 16:14:17.463285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:28.731 16:14:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:28.731 16:14:18 -- common/autotest_common.sh@852 -- # return 0 00:30:28.731 16:14:18 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:28.731 16:14:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:28.731 16:14:18 -- common/autotest_common.sh@10 -- # set +x 00:30:28.731 16:14:18 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:28.731 16:14:18 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:28.731 16:14:18 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:28.731 16:14:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:28.731 16:14:18 -- common/autotest_common.sh@10 -- # set +x 00:30:28.731 16:14:18 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:28.731 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:28.731 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:28.731 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:28.731 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:28.731 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:28.731 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:28.731 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:28.731 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:28.731 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:28.731 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:28.731 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:28.731 ' 00:30:28.989 [2024-10-30 16:14:18.782124] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:31.516 [2024-10-30 16:14:20.972117] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:32.450 [2024-10-30 16:14:22.224671] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:34.979 [2024-10-30 16:14:24.543977] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:30:36.879 [2024-10-30 16:14:26.542698] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:30:38.252 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:30:38.252 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:30:38.252 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:30:38.252 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:30:38.252 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:30:38.252 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:30:38.252 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:30:38.252 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:38.252 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:38.252 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:30:38.252 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:30:38.252 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:30:38.509 16:14:28 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:30:38.509 16:14:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:38.509 16:14:28 -- common/autotest_common.sh@10 -- # set +x 00:30:38.509 16:14:28 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:30:38.509 16:14:28 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:38.509 16:14:28 -- common/autotest_common.sh@10 -- # set +x 00:30:38.509 16:14:28 -- spdkcli/nvmf.sh@69 -- # check_match 00:30:38.509 16:14:28 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:30:38.767 16:14:28 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:30:39.024 16:14:28 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:30:39.024 16:14:28 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:30:39.024 16:14:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:39.024 16:14:28 -- common/autotest_common.sh@10 -- # set +x 00:30:39.024 16:14:28 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:30:39.024 16:14:28 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:39.024 16:14:28 -- common/autotest_common.sh@10 -- # set +x 00:30:39.024 16:14:28 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:30:39.025 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:30:39.025 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:39.025 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:30:39.025 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:30:39.025 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:30:39.025 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:30:39.025 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:39.025 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:30:39.025 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:30:39.025 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:30:39.025 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:30:39.025 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:30:39.025 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:30:39.025 ' 00:30:44.292 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:30:44.292 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:30:44.292 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:44.292 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:30:44.292 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:30:44.292 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:30:44.292 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:30:44.292 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:44.292 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:30:44.292 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:30:44.292 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:30:44.292 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:30:44.292 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:30:44.292 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:30:44.292 16:14:33 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:30:44.292 16:14:33 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:44.292 16:14:33 -- common/autotest_common.sh@10 -- # set +x 00:30:44.292 16:14:34 -- spdkcli/nvmf.sh@90 -- # killprocess 2551230 00:30:44.292 16:14:34 -- common/autotest_common.sh@926 -- # '[' -z 2551230 ']' 00:30:44.292 16:14:34 -- common/autotest_common.sh@930 -- # kill -0 2551230 00:30:44.292 16:14:34 -- common/autotest_common.sh@931 -- # uname 00:30:44.292 16:14:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:44.292 16:14:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2551230 00:30:44.292 16:14:34 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:30:44.292 16:14:34 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:30:44.292 16:14:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2551230' 00:30:44.292 killing process with pid 2551230 00:30:44.292 16:14:34 -- common/autotest_common.sh@945 -- # kill 2551230 00:30:44.292 [2024-10-30 16:14:34.055801] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:44.292 16:14:34 -- common/autotest_common.sh@950 -- # wait 2551230 00:30:44.549 16:14:34 -- spdkcli/nvmf.sh@1 -- # cleanup 00:30:44.549 16:14:34 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:30:44.549 16:14:34 -- spdkcli/common.sh@13 -- # '[' -n 2551230 ']' 00:30:44.549 16:14:34 -- spdkcli/common.sh@14 -- # killprocess 2551230 00:30:44.549 16:14:34 -- common/autotest_common.sh@926 -- # '[' -z 2551230 ']' 00:30:44.549 16:14:34 -- common/autotest_common.sh@930 -- # kill -0 2551230 00:30:44.549 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2551230) - No such process 00:30:44.549 16:14:34 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2551230 is not found' 00:30:44.549 Process with pid 2551230 is not found 00:30:44.549 16:14:34 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:30:44.549 16:14:34 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:30:44.549 16:14:34 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:30:44.549 00:30:44.549 real 0m17.083s 00:30:44.549 user 0m36.667s 00:30:44.549 sys 0m0.829s 00:30:44.549 16:14:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:30:44.549 16:14:34 -- common/autotest_common.sh@10 -- # set +x 00:30:44.549 ************************************ 00:30:44.549 END TEST spdkcli_nvmf_tcp 00:30:44.549 ************************************ 00:30:44.549 16:14:34 -- spdk/autotest.sh@298 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:44.549 16:14:34 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:30:44.549 16:14:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:30:44.549 16:14:34 -- common/autotest_common.sh@10 -- # set +x 00:30:44.549 ************************************ 00:30:44.549 START TEST nvmf_identify_passthru 00:30:44.549 ************************************ 00:30:44.549 16:14:34 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:44.549 * Looking for test storage... 00:30:44.549 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:44.549 16:14:34 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:44.549 16:14:34 -- nvmf/common.sh@7 -- # uname -s 00:30:44.549 16:14:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:44.549 16:14:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:44.549 16:14:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:44.549 16:14:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:44.549 16:14:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:44.549 16:14:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:44.549 16:14:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:44.549 16:14:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:44.549 16:14:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:44.549 16:14:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:44.549 16:14:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:44.549 16:14:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:44.549 16:14:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:44.549 16:14:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:44.549 16:14:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:44.549 16:14:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:44.549 16:14:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:44.549 16:14:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:44.549 16:14:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:44.549 16:14:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.549 16:14:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.549 16:14:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.549 16:14:34 -- paths/export.sh@5 -- # export PATH 00:30:44.549 16:14:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.549 16:14:34 -- nvmf/common.sh@46 -- # : 0 00:30:44.549 16:14:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:44.549 16:14:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:44.549 16:14:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:44.549 16:14:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:44.549 16:14:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:44.549 16:14:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:44.549 16:14:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:44.549 16:14:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:44.549 16:14:34 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:44.549 16:14:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:44.549 16:14:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:44.549 16:14:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:44.549 16:14:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.549 16:14:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.549 16:14:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.549 16:14:34 -- paths/export.sh@5 -- # export PATH 00:30:44.549 16:14:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:44.549 16:14:34 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:30:44.550 16:14:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:44.550 16:14:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:44.550 16:14:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:44.550 16:14:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:44.550 16:14:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:44.550 16:14:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:44.550 16:14:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:44.550 16:14:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:44.550 16:14:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:44.550 16:14:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:44.550 16:14:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:44.550 16:14:34 -- common/autotest_common.sh@10 -- # set +x 00:30:46.447 16:14:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:46.447 16:14:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:46.447 16:14:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:46.447 16:14:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:46.447 16:14:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:46.447 16:14:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:46.447 16:14:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:46.447 16:14:36 -- nvmf/common.sh@294 -- # net_devs=() 00:30:46.447 16:14:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:46.447 16:14:36 -- nvmf/common.sh@295 -- # e810=() 00:30:46.447 16:14:36 -- nvmf/common.sh@295 -- # local -ga e810 00:30:46.447 16:14:36 -- nvmf/common.sh@296 -- # x722=() 00:30:46.447 16:14:36 -- nvmf/common.sh@296 -- # local -ga x722 00:30:46.447 16:14:36 -- nvmf/common.sh@297 -- # mlx=() 00:30:46.447 16:14:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:46.448 16:14:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:46.448 16:14:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:46.448 16:14:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:46.448 16:14:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:46.448 16:14:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:46.448 16:14:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:46.448 16:14:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:46.448 16:14:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:46.448 16:14:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:46.448 16:14:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:46.448 16:14:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:46.448 16:14:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:46.448 16:14:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:46.448 16:14:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:46.448 16:14:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:46.448 16:14:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:46.448 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:46.448 16:14:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:46.448 16:14:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:46.448 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:46.448 16:14:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:46.448 16:14:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:46.448 16:14:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:46.448 16:14:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:46.448 16:14:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:46.448 16:14:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:46.448 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:46.448 16:14:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:46.448 16:14:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:46.448 16:14:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:46.448 16:14:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:46.448 16:14:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:46.448 16:14:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:46.448 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:46.448 16:14:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:46.448 16:14:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:46.448 16:14:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:46.448 16:14:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:46.448 16:14:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:46.448 16:14:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:46.448 16:14:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:46.448 16:14:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:46.448 16:14:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:46.448 16:14:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:46.448 16:14:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:46.448 16:14:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:46.448 16:14:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:46.448 16:14:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:46.448 16:14:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:46.448 16:14:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:46.448 16:14:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:46.705 16:14:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:46.705 16:14:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:46.705 16:14:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:46.705 16:14:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:46.705 16:14:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:46.705 16:14:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:46.705 16:14:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:46.705 16:14:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:46.705 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:46.705 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.304 ms 00:30:46.705 00:30:46.705 --- 10.0.0.2 ping statistics --- 00:30:46.705 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:46.705 rtt min/avg/max/mdev = 0.304/0.304/0.304/0.000 ms 00:30:46.705 16:14:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:46.705 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:46.705 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:30:46.705 00:30:46.705 --- 10.0.0.1 ping statistics --- 00:30:46.706 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:46.706 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:30:46.706 16:14:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:46.706 16:14:36 -- nvmf/common.sh@410 -- # return 0 00:30:46.706 16:14:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:46.706 16:14:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:46.706 16:14:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:46.706 16:14:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:46.706 16:14:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:46.706 16:14:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:46.706 16:14:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:46.706 16:14:36 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:30:46.706 16:14:36 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:46.706 16:14:36 -- common/autotest_common.sh@10 -- # set +x 00:30:46.706 16:14:36 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:30:46.706 16:14:36 -- common/autotest_common.sh@1509 -- # bdfs=() 00:30:46.706 16:14:36 -- common/autotest_common.sh@1509 -- # local bdfs 00:30:46.706 16:14:36 -- common/autotest_common.sh@1510 -- # bdfs=($(get_nvme_bdfs)) 00:30:46.706 16:14:36 -- common/autotest_common.sh@1510 -- # get_nvme_bdfs 00:30:46.706 16:14:36 -- common/autotest_common.sh@1498 -- # bdfs=() 00:30:46.706 16:14:36 -- common/autotest_common.sh@1498 -- # local bdfs 00:30:46.706 16:14:36 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:30:46.706 16:14:36 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:30:46.706 16:14:36 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:30:46.706 16:14:36 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:30:46.706 16:14:36 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:30:46.706 16:14:36 -- common/autotest_common.sh@1512 -- # echo 0000:88:00.0 00:30:46.706 16:14:36 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:30:46.706 16:14:36 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:30:46.706 16:14:36 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:46.706 16:14:36 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:30:46.706 16:14:36 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:30:46.706 EAL: No free 2048 kB hugepages reported on node 1 00:30:50.892 16:14:40 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:30:50.892 16:14:40 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:50.892 16:14:40 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:30:50.892 16:14:40 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:30:50.892 EAL: No free 2048 kB hugepages reported on node 1 00:30:55.080 16:14:44 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:30:55.080 16:14:44 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:30:55.080 16:14:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:55.080 16:14:44 -- common/autotest_common.sh@10 -- # set +x 00:30:55.080 16:14:44 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:30:55.080 16:14:44 -- common/autotest_common.sh@712 -- # xtrace_disable 00:30:55.080 16:14:44 -- common/autotest_common.sh@10 -- # set +x 00:30:55.080 16:14:44 -- target/identify_passthru.sh@31 -- # nvmfpid=2555964 00:30:55.080 16:14:44 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:30:55.080 16:14:44 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:30:55.080 16:14:44 -- target/identify_passthru.sh@35 -- # waitforlisten 2555964 00:30:55.080 16:14:44 -- common/autotest_common.sh@819 -- # '[' -z 2555964 ']' 00:30:55.080 16:14:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:55.080 16:14:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:30:55.080 16:14:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:55.080 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:55.080 16:14:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:30:55.080 16:14:44 -- common/autotest_common.sh@10 -- # set +x 00:30:55.339 [2024-10-30 16:14:44.987548] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:30:55.339 [2024-10-30 16:14:44.987660] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:55.339 EAL: No free 2048 kB hugepages reported on node 1 00:30:55.339 [2024-10-30 16:14:45.055989] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:55.339 [2024-10-30 16:14:45.144731] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:55.339 [2024-10-30 16:14:45.144911] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:55.339 [2024-10-30 16:14:45.144932] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:55.339 [2024-10-30 16:14:45.144946] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:55.339 [2024-10-30 16:14:45.145003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:55.339 [2024-10-30 16:14:45.145058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:55.339 [2024-10-30 16:14:45.145170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:55.339 [2024-10-30 16:14:45.145172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:55.339 16:14:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:30:55.339 16:14:45 -- common/autotest_common.sh@852 -- # return 0 00:30:55.339 16:14:45 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:30:55.339 16:14:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:55.340 16:14:45 -- common/autotest_common.sh@10 -- # set +x 00:30:55.340 INFO: Log level set to 20 00:30:55.340 INFO: Requests: 00:30:55.340 { 00:30:55.340 "jsonrpc": "2.0", 00:30:55.340 "method": "nvmf_set_config", 00:30:55.340 "id": 1, 00:30:55.340 "params": { 00:30:55.340 "admin_cmd_passthru": { 00:30:55.340 "identify_ctrlr": true 00:30:55.340 } 00:30:55.340 } 00:30:55.340 } 00:30:55.340 00:30:55.340 INFO: response: 00:30:55.340 { 00:30:55.340 "jsonrpc": "2.0", 00:30:55.340 "id": 1, 00:30:55.340 "result": true 00:30:55.340 } 00:30:55.340 00:30:55.340 16:14:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:55.340 16:14:45 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:30:55.340 16:14:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:55.340 16:14:45 -- common/autotest_common.sh@10 -- # set +x 00:30:55.340 INFO: Setting log level to 20 00:30:55.340 INFO: Setting log level to 20 00:30:55.340 INFO: Log level set to 20 00:30:55.340 INFO: Log level set to 20 00:30:55.340 INFO: Requests: 00:30:55.340 { 00:30:55.340 "jsonrpc": "2.0", 00:30:55.340 "method": "framework_start_init", 00:30:55.340 "id": 1 00:30:55.340 } 00:30:55.340 00:30:55.340 INFO: Requests: 00:30:55.340 { 00:30:55.340 "jsonrpc": "2.0", 00:30:55.340 "method": "framework_start_init", 00:30:55.340 "id": 1 00:30:55.340 } 00:30:55.340 00:30:55.599 [2024-10-30 16:14:45.307657] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:30:55.599 INFO: response: 00:30:55.599 { 00:30:55.599 "jsonrpc": "2.0", 00:30:55.599 "id": 1, 00:30:55.599 "result": true 00:30:55.599 } 00:30:55.599 00:30:55.599 INFO: response: 00:30:55.599 { 00:30:55.599 "jsonrpc": "2.0", 00:30:55.599 "id": 1, 00:30:55.599 "result": true 00:30:55.599 } 00:30:55.599 00:30:55.599 16:14:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:55.599 16:14:45 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:55.599 16:14:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:55.599 16:14:45 -- common/autotest_common.sh@10 -- # set +x 00:30:55.599 INFO: Setting log level to 40 00:30:55.599 INFO: Setting log level to 40 00:30:55.599 INFO: Setting log level to 40 00:30:55.599 [2024-10-30 16:14:45.317731] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:55.599 16:14:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:55.599 16:14:45 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:30:55.599 16:14:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:30:55.599 16:14:45 -- common/autotest_common.sh@10 -- # set +x 00:30:55.599 16:14:45 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:30:55.599 16:14:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:55.599 16:14:45 -- common/autotest_common.sh@10 -- # set +x 00:30:58.880 Nvme0n1 00:30:58.880 16:14:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:58.880 16:14:48 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:30:58.880 16:14:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:58.880 16:14:48 -- common/autotest_common.sh@10 -- # set +x 00:30:58.880 16:14:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:58.880 16:14:48 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:30:58.880 16:14:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:58.880 16:14:48 -- common/autotest_common.sh@10 -- # set +x 00:30:58.880 16:14:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:58.880 16:14:48 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:58.880 16:14:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:58.880 16:14:48 -- common/autotest_common.sh@10 -- # set +x 00:30:58.880 [2024-10-30 16:14:48.209183] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:58.880 16:14:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:58.880 16:14:48 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:30:58.880 16:14:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:58.880 16:14:48 -- common/autotest_common.sh@10 -- # set +x 00:30:58.880 [2024-10-30 16:14:48.216913] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:58.880 [ 00:30:58.880 { 00:30:58.880 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:30:58.880 "subtype": "Discovery", 00:30:58.880 "listen_addresses": [], 00:30:58.880 "allow_any_host": true, 00:30:58.880 "hosts": [] 00:30:58.880 }, 00:30:58.880 { 00:30:58.880 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:30:58.880 "subtype": "NVMe", 00:30:58.880 "listen_addresses": [ 00:30:58.880 { 00:30:58.880 "transport": "TCP", 00:30:58.880 "trtype": "TCP", 00:30:58.880 "adrfam": "IPv4", 00:30:58.880 "traddr": "10.0.0.2", 00:30:58.880 "trsvcid": "4420" 00:30:58.880 } 00:30:58.880 ], 00:30:58.880 "allow_any_host": true, 00:30:58.880 "hosts": [], 00:30:58.880 "serial_number": "SPDK00000000000001", 00:30:58.880 "model_number": "SPDK bdev Controller", 00:30:58.880 "max_namespaces": 1, 00:30:58.880 "min_cntlid": 1, 00:30:58.880 "max_cntlid": 65519, 00:30:58.880 "namespaces": [ 00:30:58.880 { 00:30:58.880 "nsid": 1, 00:30:58.880 "bdev_name": "Nvme0n1", 00:30:58.880 "name": "Nvme0n1", 00:30:58.880 "nguid": "506BFE77B908472DA275843ADDF8F327", 00:30:58.880 "uuid": "506bfe77-b908-472d-a275-843addf8f327" 00:30:58.880 } 00:30:58.880 ] 00:30:58.880 } 00:30:58.880 ] 00:30:58.880 16:14:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:58.880 16:14:48 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:30:58.880 16:14:48 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:30:58.880 16:14:48 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:30:58.880 EAL: No free 2048 kB hugepages reported on node 1 00:30:58.880 16:14:48 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:30:58.880 16:14:48 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:30:58.880 16:14:48 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:30:58.880 16:14:48 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:30:58.880 EAL: No free 2048 kB hugepages reported on node 1 00:30:58.880 16:14:48 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:30:58.880 16:14:48 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:30:58.880 16:14:48 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:30:58.880 16:14:48 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:58.880 16:14:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:30:58.880 16:14:48 -- common/autotest_common.sh@10 -- # set +x 00:30:58.880 16:14:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:30:58.880 16:14:48 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:30:58.880 16:14:48 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:30:58.880 16:14:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:58.880 16:14:48 -- nvmf/common.sh@116 -- # sync 00:30:58.880 16:14:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:58.880 16:14:48 -- nvmf/common.sh@119 -- # set +e 00:30:58.880 16:14:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:58.880 16:14:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:58.880 rmmod nvme_tcp 00:30:58.880 rmmod nvme_fabrics 00:30:58.880 rmmod nvme_keyring 00:30:58.880 16:14:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:58.880 16:14:48 -- nvmf/common.sh@123 -- # set -e 00:30:58.880 16:14:48 -- nvmf/common.sh@124 -- # return 0 00:30:58.880 16:14:48 -- nvmf/common.sh@477 -- # '[' -n 2555964 ']' 00:30:58.880 16:14:48 -- nvmf/common.sh@478 -- # killprocess 2555964 00:30:58.880 16:14:48 -- common/autotest_common.sh@926 -- # '[' -z 2555964 ']' 00:30:58.880 16:14:48 -- common/autotest_common.sh@930 -- # kill -0 2555964 00:30:58.880 16:14:48 -- common/autotest_common.sh@931 -- # uname 00:30:58.880 16:14:48 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:30:58.880 16:14:48 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2555964 00:30:58.880 16:14:48 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:30:58.881 16:14:48 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:30:58.881 16:14:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2555964' 00:30:58.881 killing process with pid 2555964 00:30:58.881 16:14:48 -- common/autotest_common.sh@945 -- # kill 2555964 00:30:58.881 [2024-10-30 16:14:48.640133] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:58.881 16:14:48 -- common/autotest_common.sh@950 -- # wait 2555964 00:31:00.780 16:14:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:00.780 16:14:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:00.780 16:14:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:00.780 16:14:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:00.780 16:14:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:00.780 16:14:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:00.780 16:14:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:00.780 16:14:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:02.686 16:14:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:02.686 00:31:02.686 real 0m17.908s 00:31:02.686 user 0m26.569s 00:31:02.686 sys 0m2.256s 00:31:02.686 16:14:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:02.686 16:14:52 -- common/autotest_common.sh@10 -- # set +x 00:31:02.686 ************************************ 00:31:02.686 END TEST nvmf_identify_passthru 00:31:02.686 ************************************ 00:31:02.686 16:14:52 -- spdk/autotest.sh@300 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:02.686 16:14:52 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:02.686 16:14:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:02.686 16:14:52 -- common/autotest_common.sh@10 -- # set +x 00:31:02.686 ************************************ 00:31:02.686 START TEST nvmf_dif 00:31:02.686 ************************************ 00:31:02.686 16:14:52 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:02.687 * Looking for test storage... 00:31:02.687 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:02.687 16:14:52 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:02.687 16:14:52 -- nvmf/common.sh@7 -- # uname -s 00:31:02.687 16:14:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:02.687 16:14:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:02.687 16:14:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:02.687 16:14:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:02.687 16:14:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:02.687 16:14:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:02.687 16:14:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:02.687 16:14:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:02.687 16:14:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:02.687 16:14:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:02.687 16:14:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:02.687 16:14:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:02.687 16:14:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:02.687 16:14:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:02.687 16:14:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:02.687 16:14:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:02.687 16:14:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:02.687 16:14:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:02.687 16:14:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:02.687 16:14:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:02.687 16:14:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:02.687 16:14:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:02.687 16:14:52 -- paths/export.sh@5 -- # export PATH 00:31:02.687 16:14:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:02.687 16:14:52 -- nvmf/common.sh@46 -- # : 0 00:31:02.687 16:14:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:02.687 16:14:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:02.687 16:14:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:02.687 16:14:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:02.687 16:14:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:02.687 16:14:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:02.687 16:14:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:02.687 16:14:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:02.687 16:14:52 -- target/dif.sh@15 -- # NULL_META=16 00:31:02.687 16:14:52 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:02.687 16:14:52 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:02.687 16:14:52 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:02.687 16:14:52 -- target/dif.sh@135 -- # nvmftestinit 00:31:02.687 16:14:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:02.687 16:14:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:02.687 16:14:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:02.687 16:14:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:02.687 16:14:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:02.687 16:14:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:02.687 16:14:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:02.687 16:14:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:02.687 16:14:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:02.687 16:14:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:02.687 16:14:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:02.687 16:14:52 -- common/autotest_common.sh@10 -- # set +x 00:31:04.596 16:14:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:04.596 16:14:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:04.596 16:14:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:04.596 16:14:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:04.596 16:14:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:04.596 16:14:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:04.596 16:14:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:04.596 16:14:54 -- nvmf/common.sh@294 -- # net_devs=() 00:31:04.596 16:14:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:04.596 16:14:54 -- nvmf/common.sh@295 -- # e810=() 00:31:04.596 16:14:54 -- nvmf/common.sh@295 -- # local -ga e810 00:31:04.596 16:14:54 -- nvmf/common.sh@296 -- # x722=() 00:31:04.596 16:14:54 -- nvmf/common.sh@296 -- # local -ga x722 00:31:04.596 16:14:54 -- nvmf/common.sh@297 -- # mlx=() 00:31:04.596 16:14:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:04.596 16:14:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:04.596 16:14:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:04.596 16:14:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:04.596 16:14:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:04.596 16:14:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:04.596 16:14:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:04.596 16:14:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:04.596 16:14:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:04.596 16:14:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:04.596 16:14:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:04.596 16:14:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:04.596 16:14:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:04.596 16:14:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:04.596 16:14:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:04.596 16:14:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:04.596 16:14:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:04.596 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:04.596 16:14:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:04.596 16:14:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:04.596 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:04.596 16:14:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:04.596 16:14:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:04.596 16:14:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:04.596 16:14:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:04.596 16:14:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:04.596 16:14:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:04.596 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:04.596 16:14:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:04.596 16:14:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:04.596 16:14:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:04.596 16:14:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:04.596 16:14:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:04.596 16:14:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:04.596 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:04.596 16:14:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:04.596 16:14:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:04.596 16:14:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:04.596 16:14:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:04.596 16:14:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:04.596 16:14:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:04.596 16:14:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:04.596 16:14:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:04.596 16:14:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:04.596 16:14:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:04.596 16:14:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:04.596 16:14:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:04.596 16:14:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:04.596 16:14:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:04.596 16:14:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:04.596 16:14:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:04.596 16:14:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:04.596 16:14:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:04.596 16:14:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:04.596 16:14:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:04.596 16:14:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:04.596 16:14:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:04.596 16:14:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:04.596 16:14:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:04.596 16:14:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:04.596 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:04.596 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:31:04.596 00:31:04.596 --- 10.0.0.2 ping statistics --- 00:31:04.596 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:04.596 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:31:04.596 16:14:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:04.596 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:04.596 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:31:04.596 00:31:04.596 --- 10.0.0.1 ping statistics --- 00:31:04.596 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:04.596 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:31:04.596 16:14:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:04.596 16:14:54 -- nvmf/common.sh@410 -- # return 0 00:31:04.596 16:14:54 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:04.596 16:14:54 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:05.979 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:05.979 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:05.979 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:05.979 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:05.979 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:05.979 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:05.979 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:05.979 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:05.979 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:05.979 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:05.979 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:05.979 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:05.979 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:05.979 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:05.979 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:05.979 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:05.979 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:05.979 16:14:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:05.979 16:14:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:05.979 16:14:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:05.979 16:14:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:05.979 16:14:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:05.979 16:14:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:05.979 16:14:55 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:05.979 16:14:55 -- target/dif.sh@137 -- # nvmfappstart 00:31:05.979 16:14:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:05.979 16:14:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:31:05.979 16:14:55 -- common/autotest_common.sh@10 -- # set +x 00:31:05.979 16:14:55 -- nvmf/common.sh@469 -- # nvmfpid=2559232 00:31:05.979 16:14:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:05.979 16:14:55 -- nvmf/common.sh@470 -- # waitforlisten 2559232 00:31:05.979 16:14:55 -- common/autotest_common.sh@819 -- # '[' -z 2559232 ']' 00:31:05.979 16:14:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:05.979 16:14:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:31:05.979 16:14:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:05.979 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:05.979 16:14:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:31:05.979 16:14:55 -- common/autotest_common.sh@10 -- # set +x 00:31:05.979 [2024-10-30 16:14:55.689921] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:31:05.979 [2024-10-30 16:14:55.690000] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:05.979 EAL: No free 2048 kB hugepages reported on node 1 00:31:05.979 [2024-10-30 16:14:55.757612] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:05.979 [2024-10-30 16:14:55.841221] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:05.979 [2024-10-30 16:14:55.841413] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:05.979 [2024-10-30 16:14:55.841431] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:05.979 [2024-10-30 16:14:55.841443] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:05.979 [2024-10-30 16:14:55.841476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:06.916 16:14:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:31:06.916 16:14:56 -- common/autotest_common.sh@852 -- # return 0 00:31:06.916 16:14:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:06.916 16:14:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:31:06.916 16:14:56 -- common/autotest_common.sh@10 -- # set +x 00:31:06.916 16:14:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:06.916 16:14:56 -- target/dif.sh@139 -- # create_transport 00:31:06.916 16:14:56 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:06.916 16:14:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:06.916 16:14:56 -- common/autotest_common.sh@10 -- # set +x 00:31:06.916 [2024-10-30 16:14:56.679166] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:06.916 16:14:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:06.916 16:14:56 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:06.916 16:14:56 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:06.916 16:14:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:06.916 16:14:56 -- common/autotest_common.sh@10 -- # set +x 00:31:06.916 ************************************ 00:31:06.916 START TEST fio_dif_1_default 00:31:06.916 ************************************ 00:31:06.916 16:14:56 -- common/autotest_common.sh@1104 -- # fio_dif_1 00:31:06.916 16:14:56 -- target/dif.sh@86 -- # create_subsystems 0 00:31:06.916 16:14:56 -- target/dif.sh@28 -- # local sub 00:31:06.916 16:14:56 -- target/dif.sh@30 -- # for sub in "$@" 00:31:06.916 16:14:56 -- target/dif.sh@31 -- # create_subsystem 0 00:31:06.916 16:14:56 -- target/dif.sh@18 -- # local sub_id=0 00:31:06.916 16:14:56 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:06.916 16:14:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:06.916 16:14:56 -- common/autotest_common.sh@10 -- # set +x 00:31:06.916 bdev_null0 00:31:06.916 16:14:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:06.916 16:14:56 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:06.916 16:14:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:06.916 16:14:56 -- common/autotest_common.sh@10 -- # set +x 00:31:06.916 16:14:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:06.916 16:14:56 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:06.916 16:14:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:06.916 16:14:56 -- common/autotest_common.sh@10 -- # set +x 00:31:06.916 16:14:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:06.916 16:14:56 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:06.916 16:14:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:06.916 16:14:56 -- common/autotest_common.sh@10 -- # set +x 00:31:06.916 [2024-10-30 16:14:56.715442] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:06.916 16:14:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:06.916 16:14:56 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:06.916 16:14:56 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:06.916 16:14:56 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:06.916 16:14:56 -- nvmf/common.sh@520 -- # config=() 00:31:06.916 16:14:56 -- nvmf/common.sh@520 -- # local subsystem config 00:31:06.916 16:14:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:06.916 16:14:56 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:06.916 16:14:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:06.916 { 00:31:06.916 "params": { 00:31:06.916 "name": "Nvme$subsystem", 00:31:06.916 "trtype": "$TEST_TRANSPORT", 00:31:06.916 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:06.916 "adrfam": "ipv4", 00:31:06.916 "trsvcid": "$NVMF_PORT", 00:31:06.916 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:06.916 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:06.916 "hdgst": ${hdgst:-false}, 00:31:06.916 "ddgst": ${ddgst:-false} 00:31:06.916 }, 00:31:06.916 "method": "bdev_nvme_attach_controller" 00:31:06.916 } 00:31:06.916 EOF 00:31:06.916 )") 00:31:06.916 16:14:56 -- target/dif.sh@82 -- # gen_fio_conf 00:31:06.916 16:14:56 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:06.916 16:14:56 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:06.916 16:14:56 -- target/dif.sh@54 -- # local file 00:31:06.916 16:14:56 -- target/dif.sh@56 -- # cat 00:31:06.916 16:14:56 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:06.916 16:14:56 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:06.916 16:14:56 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:06.916 16:14:56 -- common/autotest_common.sh@1320 -- # shift 00:31:06.916 16:14:56 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:06.916 16:14:56 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:06.916 16:14:56 -- nvmf/common.sh@542 -- # cat 00:31:06.916 16:14:56 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:06.916 16:14:56 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:06.916 16:14:56 -- target/dif.sh@72 -- # (( file <= files )) 00:31:06.916 16:14:56 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:06.916 16:14:56 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:06.916 16:14:56 -- nvmf/common.sh@544 -- # jq . 00:31:06.916 16:14:56 -- nvmf/common.sh@545 -- # IFS=, 00:31:06.916 16:14:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:06.916 "params": { 00:31:06.916 "name": "Nvme0", 00:31:06.916 "trtype": "tcp", 00:31:06.916 "traddr": "10.0.0.2", 00:31:06.916 "adrfam": "ipv4", 00:31:06.916 "trsvcid": "4420", 00:31:06.916 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:06.916 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:06.916 "hdgst": false, 00:31:06.916 "ddgst": false 00:31:06.916 }, 00:31:06.916 "method": "bdev_nvme_attach_controller" 00:31:06.916 }' 00:31:06.916 16:14:56 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:06.916 16:14:56 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:06.916 16:14:56 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:06.916 16:14:56 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:06.916 16:14:56 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:06.916 16:14:56 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:06.916 16:14:56 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:06.916 16:14:56 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:06.916 16:14:56 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:06.916 16:14:56 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:07.177 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:07.177 fio-3.35 00:31:07.177 Starting 1 thread 00:31:07.177 EAL: No free 2048 kB hugepages reported on node 1 00:31:07.747 [2024-10-30 16:14:57.474065] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:07.747 [2024-10-30 16:14:57.474148] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:19.948 00:31:19.948 filename0: (groupid=0, jobs=1): err= 0: pid=2559511: Wed Oct 30 16:15:07 2024 00:31:19.948 read: IOPS=190, BW=763KiB/s (781kB/s)(7648KiB/10026msec) 00:31:19.948 slat (nsec): min=6650, max=55787, avg=8445.33, stdev=2737.75 00:31:19.948 clat (usec): min=503, max=46538, avg=20947.99, stdev=20467.28 00:31:19.948 lat (usec): min=511, max=46572, avg=20956.43, stdev=20466.98 00:31:19.948 clat percentiles (usec): 00:31:19.948 | 1.00th=[ 537], 5.00th=[ 545], 10.00th=[ 553], 20.00th=[ 562], 00:31:19.948 | 30.00th=[ 570], 40.00th=[ 586], 50.00th=[ 701], 60.00th=[41157], 00:31:19.948 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:31:19.948 | 99.00th=[42206], 99.50th=[42206], 99.90th=[46400], 99.95th=[46400], 00:31:19.948 | 99.99th=[46400] 00:31:19.948 bw ( KiB/s): min= 672, max= 832, per=100.00%, avg=763.20, stdev=36.37, samples=20 00:31:19.948 iops : min= 168, max= 208, avg=190.80, stdev= 9.09, samples=20 00:31:19.948 lat (usec) : 750=50.21% 00:31:19.948 lat (msec) : 50=49.79% 00:31:19.948 cpu : usr=91.44%, sys=8.27%, ctx=18, majf=0, minf=264 00:31:19.948 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:19.948 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:19.948 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:19.948 issued rwts: total=1912,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:19.948 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:19.948 00:31:19.948 Run status group 0 (all jobs): 00:31:19.948 READ: bw=763KiB/s (781kB/s), 763KiB/s-763KiB/s (781kB/s-781kB/s), io=7648KiB (7832kB), run=10026-10026msec 00:31:19.948 16:15:07 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:19.948 16:15:07 -- target/dif.sh@43 -- # local sub 00:31:19.948 16:15:07 -- target/dif.sh@45 -- # for sub in "$@" 00:31:19.948 16:15:07 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:19.948 16:15:07 -- target/dif.sh@36 -- # local sub_id=0 00:31:19.948 16:15:07 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:19.948 16:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:19.948 16:15:07 -- common/autotest_common.sh@10 -- # set +x 00:31:19.948 16:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:19.948 16:15:07 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:19.948 16:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:19.948 16:15:07 -- common/autotest_common.sh@10 -- # set +x 00:31:19.948 16:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:19.948 00:31:19.948 real 0m11.161s 00:31:19.948 user 0m10.410s 00:31:19.948 sys 0m1.102s 00:31:19.948 16:15:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:19.948 16:15:07 -- common/autotest_common.sh@10 -- # set +x 00:31:19.948 ************************************ 00:31:19.948 END TEST fio_dif_1_default 00:31:19.948 ************************************ 00:31:19.948 16:15:07 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:19.948 16:15:07 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:19.948 16:15:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:19.948 16:15:07 -- common/autotest_common.sh@10 -- # set +x 00:31:19.948 ************************************ 00:31:19.948 START TEST fio_dif_1_multi_subsystems 00:31:19.948 ************************************ 00:31:19.948 16:15:07 -- common/autotest_common.sh@1104 -- # fio_dif_1_multi_subsystems 00:31:19.948 16:15:07 -- target/dif.sh@92 -- # local files=1 00:31:19.948 16:15:07 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:19.948 16:15:07 -- target/dif.sh@28 -- # local sub 00:31:19.948 16:15:07 -- target/dif.sh@30 -- # for sub in "$@" 00:31:19.948 16:15:07 -- target/dif.sh@31 -- # create_subsystem 0 00:31:19.948 16:15:07 -- target/dif.sh@18 -- # local sub_id=0 00:31:19.948 16:15:07 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:19.948 16:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:19.948 16:15:07 -- common/autotest_common.sh@10 -- # set +x 00:31:19.948 bdev_null0 00:31:19.948 16:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:19.948 16:15:07 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:19.948 16:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:19.948 16:15:07 -- common/autotest_common.sh@10 -- # set +x 00:31:19.948 16:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:19.948 16:15:07 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:19.948 16:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:19.948 16:15:07 -- common/autotest_common.sh@10 -- # set +x 00:31:19.948 16:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:19.948 16:15:07 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:19.948 16:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:19.948 16:15:07 -- common/autotest_common.sh@10 -- # set +x 00:31:19.948 [2024-10-30 16:15:07.904522] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:19.948 16:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:19.948 16:15:07 -- target/dif.sh@30 -- # for sub in "$@" 00:31:19.948 16:15:07 -- target/dif.sh@31 -- # create_subsystem 1 00:31:19.948 16:15:07 -- target/dif.sh@18 -- # local sub_id=1 00:31:19.948 16:15:07 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:19.948 16:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:19.948 16:15:07 -- common/autotest_common.sh@10 -- # set +x 00:31:19.948 bdev_null1 00:31:19.948 16:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:19.948 16:15:07 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:19.948 16:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:19.948 16:15:07 -- common/autotest_common.sh@10 -- # set +x 00:31:19.948 16:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:19.948 16:15:07 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:19.948 16:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:19.948 16:15:07 -- common/autotest_common.sh@10 -- # set +x 00:31:19.948 16:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:19.948 16:15:07 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:19.948 16:15:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:19.948 16:15:07 -- common/autotest_common.sh@10 -- # set +x 00:31:19.948 16:15:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:19.948 16:15:07 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:19.948 16:15:07 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:19.948 16:15:07 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:19.948 16:15:07 -- nvmf/common.sh@520 -- # config=() 00:31:19.948 16:15:07 -- nvmf/common.sh@520 -- # local subsystem config 00:31:19.948 16:15:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:19.948 16:15:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:19.948 { 00:31:19.948 "params": { 00:31:19.948 "name": "Nvme$subsystem", 00:31:19.948 "trtype": "$TEST_TRANSPORT", 00:31:19.948 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:19.948 "adrfam": "ipv4", 00:31:19.948 "trsvcid": "$NVMF_PORT", 00:31:19.948 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:19.948 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:19.948 "hdgst": ${hdgst:-false}, 00:31:19.948 "ddgst": ${ddgst:-false} 00:31:19.948 }, 00:31:19.948 "method": "bdev_nvme_attach_controller" 00:31:19.948 } 00:31:19.948 EOF 00:31:19.948 )") 00:31:19.948 16:15:07 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:19.948 16:15:07 -- target/dif.sh@82 -- # gen_fio_conf 00:31:19.948 16:15:07 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:19.948 16:15:07 -- target/dif.sh@54 -- # local file 00:31:19.948 16:15:07 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:19.948 16:15:07 -- target/dif.sh@56 -- # cat 00:31:19.948 16:15:07 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:19.948 16:15:07 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:19.948 16:15:07 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:19.948 16:15:07 -- common/autotest_common.sh@1320 -- # shift 00:31:19.948 16:15:07 -- nvmf/common.sh@542 -- # cat 00:31:19.948 16:15:07 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:19.948 16:15:07 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:19.948 16:15:07 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:19.948 16:15:07 -- target/dif.sh@72 -- # (( file <= files )) 00:31:19.948 16:15:07 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:19.948 16:15:07 -- target/dif.sh@73 -- # cat 00:31:19.948 16:15:07 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:19.948 16:15:07 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:19.948 16:15:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:19.948 16:15:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:19.948 { 00:31:19.948 "params": { 00:31:19.948 "name": "Nvme$subsystem", 00:31:19.948 "trtype": "$TEST_TRANSPORT", 00:31:19.948 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:19.948 "adrfam": "ipv4", 00:31:19.948 "trsvcid": "$NVMF_PORT", 00:31:19.948 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:19.948 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:19.948 "hdgst": ${hdgst:-false}, 00:31:19.948 "ddgst": ${ddgst:-false} 00:31:19.948 }, 00:31:19.948 "method": "bdev_nvme_attach_controller" 00:31:19.948 } 00:31:19.948 EOF 00:31:19.948 )") 00:31:19.948 16:15:07 -- nvmf/common.sh@542 -- # cat 00:31:19.948 16:15:07 -- target/dif.sh@72 -- # (( file++ )) 00:31:19.948 16:15:07 -- target/dif.sh@72 -- # (( file <= files )) 00:31:19.948 16:15:07 -- nvmf/common.sh@544 -- # jq . 00:31:19.948 16:15:07 -- nvmf/common.sh@545 -- # IFS=, 00:31:19.948 16:15:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:19.948 "params": { 00:31:19.948 "name": "Nvme0", 00:31:19.948 "trtype": "tcp", 00:31:19.948 "traddr": "10.0.0.2", 00:31:19.948 "adrfam": "ipv4", 00:31:19.948 "trsvcid": "4420", 00:31:19.948 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:19.948 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:19.948 "hdgst": false, 00:31:19.948 "ddgst": false 00:31:19.948 }, 00:31:19.948 "method": "bdev_nvme_attach_controller" 00:31:19.948 },{ 00:31:19.948 "params": { 00:31:19.948 "name": "Nvme1", 00:31:19.948 "trtype": "tcp", 00:31:19.948 "traddr": "10.0.0.2", 00:31:19.948 "adrfam": "ipv4", 00:31:19.948 "trsvcid": "4420", 00:31:19.948 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:19.948 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:19.948 "hdgst": false, 00:31:19.948 "ddgst": false 00:31:19.948 }, 00:31:19.948 "method": "bdev_nvme_attach_controller" 00:31:19.948 }' 00:31:19.948 16:15:07 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:19.948 16:15:07 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:19.948 16:15:07 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:19.948 16:15:07 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:19.948 16:15:07 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:19.948 16:15:07 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:19.948 16:15:07 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:19.948 16:15:07 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:19.948 16:15:07 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:19.948 16:15:07 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:19.948 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:19.948 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:19.948 fio-3.35 00:31:19.949 Starting 2 threads 00:31:19.949 EAL: No free 2048 kB hugepages reported on node 1 00:31:19.949 [2024-10-30 16:15:08.841658] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:19.949 [2024-10-30 16:15:08.841739] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:29.924 00:31:29.924 filename0: (groupid=0, jobs=1): err= 0: pid=2561527: Wed Oct 30 16:15:18 2024 00:31:29.924 read: IOPS=197, BW=789KiB/s (808kB/s)(7904KiB/10018msec) 00:31:29.924 slat (nsec): min=6853, max=57258, avg=8735.38, stdev=2748.13 00:31:29.924 clat (usec): min=510, max=42457, avg=20250.86, stdev=20405.57 00:31:29.924 lat (usec): min=518, max=42468, avg=20259.60, stdev=20405.31 00:31:29.924 clat percentiles (usec): 00:31:29.924 | 1.00th=[ 537], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 570], 00:31:29.924 | 30.00th=[ 578], 40.00th=[ 586], 50.00th=[ 644], 60.00th=[41157], 00:31:29.924 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41681], 00:31:29.924 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:31:29.924 | 99.99th=[42206] 00:31:29.924 bw ( KiB/s): min= 704, max= 832, per=66.85%, avg=788.80, stdev=39.23, samples=20 00:31:29.924 iops : min= 176, max= 208, avg=197.20, stdev= 9.81, samples=20 00:31:29.924 lat (usec) : 750=50.61%, 1000=1.21% 00:31:29.924 lat (msec) : 50=48.18% 00:31:29.924 cpu : usr=95.43%, sys=4.26%, ctx=13, majf=0, minf=160 00:31:29.924 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:29.924 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:29.924 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:29.924 issued rwts: total=1976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:29.924 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:29.924 filename1: (groupid=0, jobs=1): err= 0: pid=2561528: Wed Oct 30 16:15:18 2024 00:31:29.924 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10008msec) 00:31:29.924 slat (nsec): min=6957, max=33549, avg=8895.70, stdev=2615.76 00:31:29.924 clat (usec): min=40722, max=42410, avg=40986.15, stdev=138.40 00:31:29.924 lat (usec): min=40729, max=42444, avg=40995.04, stdev=139.15 00:31:29.924 clat percentiles (usec): 00:31:29.924 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:29.924 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:29.924 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:29.924 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:31:29.924 | 99.99th=[42206] 00:31:29.924 bw ( KiB/s): min= 384, max= 416, per=32.92%, avg=388.80, stdev=11.72, samples=20 00:31:29.924 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:31:29.924 lat (msec) : 50=100.00% 00:31:29.924 cpu : usr=95.52%, sys=4.18%, ctx=14, majf=0, minf=149 00:31:29.924 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:29.924 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:29.924 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:29.924 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:29.924 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:29.924 00:31:29.924 Run status group 0 (all jobs): 00:31:29.924 READ: bw=1179KiB/s (1207kB/s), 390KiB/s-789KiB/s (399kB/s-808kB/s), io=11.5MiB (12.1MB), run=10008-10018msec 00:31:29.924 16:15:19 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:29.924 16:15:19 -- target/dif.sh@43 -- # local sub 00:31:29.924 16:15:19 -- target/dif.sh@45 -- # for sub in "$@" 00:31:29.924 16:15:19 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:29.924 16:15:19 -- target/dif.sh@36 -- # local sub_id=0 00:31:29.924 16:15:19 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:29.924 16:15:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:29.924 16:15:19 -- common/autotest_common.sh@10 -- # set +x 00:31:29.924 16:15:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:29.924 16:15:19 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:29.924 16:15:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:29.924 16:15:19 -- common/autotest_common.sh@10 -- # set +x 00:31:29.924 16:15:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:29.924 16:15:19 -- target/dif.sh@45 -- # for sub in "$@" 00:31:29.924 16:15:19 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:29.924 16:15:19 -- target/dif.sh@36 -- # local sub_id=1 00:31:29.924 16:15:19 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:29.924 16:15:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:29.924 16:15:19 -- common/autotest_common.sh@10 -- # set +x 00:31:29.925 16:15:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:29.925 16:15:19 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:29.925 16:15:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:29.925 16:15:19 -- common/autotest_common.sh@10 -- # set +x 00:31:29.925 16:15:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:29.925 00:31:29.925 real 0m11.381s 00:31:29.925 user 0m20.468s 00:31:29.925 sys 0m1.164s 00:31:29.925 16:15:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:29.925 16:15:19 -- common/autotest_common.sh@10 -- # set +x 00:31:29.925 ************************************ 00:31:29.925 END TEST fio_dif_1_multi_subsystems 00:31:29.925 ************************************ 00:31:29.925 16:15:19 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:29.925 16:15:19 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:29.925 16:15:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:29.925 16:15:19 -- common/autotest_common.sh@10 -- # set +x 00:31:29.925 ************************************ 00:31:29.925 START TEST fio_dif_rand_params 00:31:29.925 ************************************ 00:31:29.925 16:15:19 -- common/autotest_common.sh@1104 -- # fio_dif_rand_params 00:31:29.925 16:15:19 -- target/dif.sh@100 -- # local NULL_DIF 00:31:29.925 16:15:19 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:29.925 16:15:19 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:29.925 16:15:19 -- target/dif.sh@103 -- # bs=128k 00:31:29.925 16:15:19 -- target/dif.sh@103 -- # numjobs=3 00:31:29.925 16:15:19 -- target/dif.sh@103 -- # iodepth=3 00:31:29.925 16:15:19 -- target/dif.sh@103 -- # runtime=5 00:31:29.925 16:15:19 -- target/dif.sh@105 -- # create_subsystems 0 00:31:29.925 16:15:19 -- target/dif.sh@28 -- # local sub 00:31:29.925 16:15:19 -- target/dif.sh@30 -- # for sub in "$@" 00:31:29.925 16:15:19 -- target/dif.sh@31 -- # create_subsystem 0 00:31:29.925 16:15:19 -- target/dif.sh@18 -- # local sub_id=0 00:31:29.925 16:15:19 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:29.925 16:15:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:29.925 16:15:19 -- common/autotest_common.sh@10 -- # set +x 00:31:29.925 bdev_null0 00:31:29.925 16:15:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:29.925 16:15:19 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:29.925 16:15:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:29.925 16:15:19 -- common/autotest_common.sh@10 -- # set +x 00:31:29.925 16:15:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:29.925 16:15:19 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:29.925 16:15:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:29.925 16:15:19 -- common/autotest_common.sh@10 -- # set +x 00:31:29.925 16:15:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:29.925 16:15:19 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:29.925 16:15:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:29.925 16:15:19 -- common/autotest_common.sh@10 -- # set +x 00:31:29.925 [2024-10-30 16:15:19.312298] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:29.925 16:15:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:29.925 16:15:19 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:29.925 16:15:19 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:29.925 16:15:19 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:29.925 16:15:19 -- nvmf/common.sh@520 -- # config=() 00:31:29.925 16:15:19 -- nvmf/common.sh@520 -- # local subsystem config 00:31:29.925 16:15:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:29.925 16:15:19 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:29.925 16:15:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:29.925 { 00:31:29.925 "params": { 00:31:29.925 "name": "Nvme$subsystem", 00:31:29.925 "trtype": "$TEST_TRANSPORT", 00:31:29.925 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:29.925 "adrfam": "ipv4", 00:31:29.925 "trsvcid": "$NVMF_PORT", 00:31:29.925 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:29.925 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:29.925 "hdgst": ${hdgst:-false}, 00:31:29.925 "ddgst": ${ddgst:-false} 00:31:29.925 }, 00:31:29.925 "method": "bdev_nvme_attach_controller" 00:31:29.925 } 00:31:29.925 EOF 00:31:29.925 )") 00:31:29.925 16:15:19 -- target/dif.sh@82 -- # gen_fio_conf 00:31:29.925 16:15:19 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:29.925 16:15:19 -- target/dif.sh@54 -- # local file 00:31:29.925 16:15:19 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:29.925 16:15:19 -- target/dif.sh@56 -- # cat 00:31:29.925 16:15:19 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:29.925 16:15:19 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:29.925 16:15:19 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:29.925 16:15:19 -- common/autotest_common.sh@1320 -- # shift 00:31:29.925 16:15:19 -- nvmf/common.sh@542 -- # cat 00:31:29.925 16:15:19 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:29.925 16:15:19 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:29.925 16:15:19 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:29.925 16:15:19 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:29.925 16:15:19 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:29.925 16:15:19 -- target/dif.sh@72 -- # (( file <= files )) 00:31:29.925 16:15:19 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:29.925 16:15:19 -- nvmf/common.sh@544 -- # jq . 00:31:29.925 16:15:19 -- nvmf/common.sh@545 -- # IFS=, 00:31:29.925 16:15:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:29.925 "params": { 00:31:29.925 "name": "Nvme0", 00:31:29.925 "trtype": "tcp", 00:31:29.925 "traddr": "10.0.0.2", 00:31:29.925 "adrfam": "ipv4", 00:31:29.925 "trsvcid": "4420", 00:31:29.925 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:29.925 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:29.925 "hdgst": false, 00:31:29.925 "ddgst": false 00:31:29.925 }, 00:31:29.925 "method": "bdev_nvme_attach_controller" 00:31:29.925 }' 00:31:29.925 16:15:19 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:29.925 16:15:19 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:29.925 16:15:19 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:29.925 16:15:19 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:29.925 16:15:19 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:29.925 16:15:19 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:29.925 16:15:19 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:29.925 16:15:19 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:29.925 16:15:19 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:29.925 16:15:19 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:29.925 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:29.925 ... 00:31:29.925 fio-3.35 00:31:29.925 Starting 3 threads 00:31:29.925 EAL: No free 2048 kB hugepages reported on node 1 00:31:30.184 [2024-10-30 16:15:19.984337] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:30.184 [2024-10-30 16:15:19.984418] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:35.540 00:31:35.541 filename0: (groupid=0, jobs=1): err= 0: pid=2563006: Wed Oct 30 16:15:25 2024 00:31:35.541 read: IOPS=216, BW=27.0MiB/s (28.3MB/s)(136MiB/5045msec) 00:31:35.541 slat (nsec): min=4456, max=43312, avg=16808.87, stdev=4585.52 00:31:35.541 clat (usec): min=4692, max=56554, avg=13810.88, stdev=4641.46 00:31:35.541 lat (usec): min=4703, max=56565, avg=13827.69, stdev=4641.22 00:31:35.541 clat percentiles (usec): 00:31:35.541 | 1.00th=[ 5276], 5.00th=[ 8586], 10.00th=[ 9503], 20.00th=[11207], 00:31:35.541 | 30.00th=[12256], 40.00th=[13173], 50.00th=[13829], 60.00th=[14615], 00:31:35.541 | 70.00th=[15270], 80.00th=[15795], 90.00th=[16581], 95.00th=[16909], 00:31:35.541 | 99.00th=[45876], 99.50th=[52167], 99.90th=[56361], 99.95th=[56361], 00:31:35.541 | 99.99th=[56361] 00:31:35.541 bw ( KiB/s): min=24320, max=32512, per=31.89%, avg=27878.40, stdev=2813.28, samples=10 00:31:35.541 iops : min= 190, max= 254, avg=217.80, stdev=21.98, samples=10 00:31:35.541 lat (msec) : 10=11.64%, 20=87.26%, 50=0.46%, 100=0.64% 00:31:35.541 cpu : usr=95.20%, sys=4.28%, ctx=12, majf=0, minf=123 00:31:35.541 IO depths : 1=0.6%, 2=99.4%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:35.541 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:35.541 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:35.541 issued rwts: total=1091,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:35.541 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:35.541 filename0: (groupid=0, jobs=1): err= 0: pid=2563007: Wed Oct 30 16:15:25 2024 00:31:35.541 read: IOPS=223, BW=27.9MiB/s (29.3MB/s)(140MiB/5005msec) 00:31:35.541 slat (nsec): min=4693, max=44003, avg=16482.26, stdev=4038.26 00:31:35.541 clat (usec): min=4821, max=56724, avg=13396.61, stdev=5766.88 00:31:35.541 lat (usec): min=4834, max=56744, avg=13413.09, stdev=5766.89 00:31:35.541 clat percentiles (usec): 00:31:35.541 | 1.00th=[ 7504], 5.00th=[ 9241], 10.00th=[10290], 20.00th=[11076], 00:31:35.541 | 30.00th=[11469], 40.00th=[11994], 50.00th=[12649], 60.00th=[13435], 00:31:35.541 | 70.00th=[13829], 80.00th=[14615], 90.00th=[15533], 95.00th=[16581], 00:31:35.541 | 99.00th=[51643], 99.50th=[53740], 99.90th=[55837], 99.95th=[56886], 00:31:35.541 | 99.99th=[56886] 00:31:35.541 bw ( KiB/s): min=24320, max=33536, per=32.68%, avg=28575.00, stdev=2873.69, samples=10 00:31:35.541 iops : min= 190, max= 262, avg=223.20, stdev=22.47, samples=10 00:31:35.541 lat (msec) : 10=8.22%, 20=89.90%, 50=0.27%, 100=1.61% 00:31:35.541 cpu : usr=95.50%, sys=4.00%, ctx=9, majf=0, minf=100 00:31:35.541 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:35.541 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:35.541 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:35.541 issued rwts: total=1119,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:35.541 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:35.541 filename0: (groupid=0, jobs=1): err= 0: pid=2563008: Wed Oct 30 16:15:25 2024 00:31:35.541 read: IOPS=244, BW=30.6MiB/s (32.1MB/s)(155MiB/5045msec) 00:31:35.541 slat (nsec): min=4863, max=62949, avg=16360.92, stdev=5044.73 00:31:35.541 clat (usec): min=4624, max=55974, avg=12188.31, stdev=5521.02 00:31:35.541 lat (usec): min=4636, max=55987, avg=12204.67, stdev=5520.75 00:31:35.541 clat percentiles (usec): 00:31:35.541 | 1.00th=[ 5342], 5.00th=[ 8586], 10.00th=[ 9765], 20.00th=[10421], 00:31:35.541 | 30.00th=[10814], 40.00th=[11076], 50.00th=[11338], 60.00th=[11731], 00:31:35.541 | 70.00th=[12125], 80.00th=[12780], 90.00th=[13960], 95.00th=[15008], 00:31:35.541 | 99.00th=[50594], 99.50th=[51119], 99.90th=[55837], 99.95th=[55837], 00:31:35.541 | 99.99th=[55837] 00:31:35.541 bw ( KiB/s): min=23808, max=34816, per=36.13%, avg=31590.40, stdev=3504.28, samples=10 00:31:35.541 iops : min= 186, max= 272, avg=246.80, stdev=27.38, samples=10 00:31:35.541 lat (msec) : 10=13.43%, 20=84.71%, 50=0.73%, 100=1.13% 00:31:35.541 cpu : usr=94.39%, sys=5.10%, ctx=9, majf=0, minf=165 00:31:35.541 IO depths : 1=1.0%, 2=99.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:35.541 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:35.541 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:35.541 issued rwts: total=1236,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:35.541 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:35.541 00:31:35.541 Run status group 0 (all jobs): 00:31:35.541 READ: bw=85.4MiB/s (89.5MB/s), 27.0MiB/s-30.6MiB/s (28.3MB/s-32.1MB/s), io=431MiB (452MB), run=5005-5045msec 00:31:35.800 16:15:25 -- target/dif.sh@107 -- # destroy_subsystems 0 00:31:35.800 16:15:25 -- target/dif.sh@43 -- # local sub 00:31:35.800 16:15:25 -- target/dif.sh@45 -- # for sub in "$@" 00:31:35.800 16:15:25 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:35.800 16:15:25 -- target/dif.sh@36 -- # local sub_id=0 00:31:35.800 16:15:25 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:35.800 16:15:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:35.800 16:15:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.800 16:15:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.800 16:15:25 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:35.800 16:15:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:35.800 16:15:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.800 16:15:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.800 16:15:25 -- target/dif.sh@109 -- # NULL_DIF=2 00:31:35.800 16:15:25 -- target/dif.sh@109 -- # bs=4k 00:31:35.800 16:15:25 -- target/dif.sh@109 -- # numjobs=8 00:31:35.800 16:15:25 -- target/dif.sh@109 -- # iodepth=16 00:31:35.800 16:15:25 -- target/dif.sh@109 -- # runtime= 00:31:35.800 16:15:25 -- target/dif.sh@109 -- # files=2 00:31:35.800 16:15:25 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:31:35.800 16:15:25 -- target/dif.sh@28 -- # local sub 00:31:35.800 16:15:25 -- target/dif.sh@30 -- # for sub in "$@" 00:31:35.800 16:15:25 -- target/dif.sh@31 -- # create_subsystem 0 00:31:35.800 16:15:25 -- target/dif.sh@18 -- # local sub_id=0 00:31:35.800 16:15:25 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:31:35.800 16:15:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:35.800 16:15:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.800 bdev_null0 00:31:35.800 16:15:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.800 16:15:25 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:35.800 16:15:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:35.800 16:15:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.800 16:15:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.800 16:15:25 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:35.800 16:15:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:35.800 16:15:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.800 16:15:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.800 16:15:25 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:35.800 16:15:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:35.800 16:15:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.800 [2024-10-30 16:15:25.467523] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:35.800 16:15:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.800 16:15:25 -- target/dif.sh@30 -- # for sub in "$@" 00:31:35.800 16:15:25 -- target/dif.sh@31 -- # create_subsystem 1 00:31:35.800 16:15:25 -- target/dif.sh@18 -- # local sub_id=1 00:31:35.800 16:15:25 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:31:35.800 16:15:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:35.800 16:15:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.800 bdev_null1 00:31:35.800 16:15:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.800 16:15:25 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:35.800 16:15:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:35.800 16:15:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.800 16:15:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.800 16:15:25 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:35.800 16:15:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:35.800 16:15:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.800 16:15:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.800 16:15:25 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:35.800 16:15:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:35.800 16:15:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.800 16:15:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.800 16:15:25 -- target/dif.sh@30 -- # for sub in "$@" 00:31:35.800 16:15:25 -- target/dif.sh@31 -- # create_subsystem 2 00:31:35.800 16:15:25 -- target/dif.sh@18 -- # local sub_id=2 00:31:35.800 16:15:25 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:31:35.800 16:15:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:35.800 16:15:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.800 bdev_null2 00:31:35.800 16:15:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.800 16:15:25 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:31:35.800 16:15:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:35.800 16:15:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.800 16:15:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.800 16:15:25 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:31:35.800 16:15:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:35.800 16:15:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.800 16:15:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.800 16:15:25 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:31:35.800 16:15:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:35.800 16:15:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.800 16:15:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:35.800 16:15:25 -- target/dif.sh@112 -- # fio /dev/fd/62 00:31:35.800 16:15:25 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:31:35.800 16:15:25 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:31:35.800 16:15:25 -- nvmf/common.sh@520 -- # config=() 00:31:35.800 16:15:25 -- nvmf/common.sh@520 -- # local subsystem config 00:31:35.800 16:15:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:35.800 16:15:25 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:35.800 16:15:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:35.800 { 00:31:35.800 "params": { 00:31:35.800 "name": "Nvme$subsystem", 00:31:35.800 "trtype": "$TEST_TRANSPORT", 00:31:35.800 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:35.800 "adrfam": "ipv4", 00:31:35.800 "trsvcid": "$NVMF_PORT", 00:31:35.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:35.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:35.800 "hdgst": ${hdgst:-false}, 00:31:35.800 "ddgst": ${ddgst:-false} 00:31:35.800 }, 00:31:35.800 "method": "bdev_nvme_attach_controller" 00:31:35.800 } 00:31:35.800 EOF 00:31:35.800 )") 00:31:35.800 16:15:25 -- target/dif.sh@82 -- # gen_fio_conf 00:31:35.801 16:15:25 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:35.801 16:15:25 -- target/dif.sh@54 -- # local file 00:31:35.801 16:15:25 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:35.801 16:15:25 -- target/dif.sh@56 -- # cat 00:31:35.801 16:15:25 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:35.801 16:15:25 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:35.801 16:15:25 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:35.801 16:15:25 -- common/autotest_common.sh@1320 -- # shift 00:31:35.801 16:15:25 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:35.801 16:15:25 -- nvmf/common.sh@542 -- # cat 00:31:35.801 16:15:25 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:35.801 16:15:25 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:35.801 16:15:25 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:35.801 16:15:25 -- target/dif.sh@72 -- # (( file <= files )) 00:31:35.801 16:15:25 -- target/dif.sh@73 -- # cat 00:31:35.801 16:15:25 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:35.801 16:15:25 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:35.801 16:15:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:35.801 16:15:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:35.801 { 00:31:35.801 "params": { 00:31:35.801 "name": "Nvme$subsystem", 00:31:35.801 "trtype": "$TEST_TRANSPORT", 00:31:35.801 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:35.801 "adrfam": "ipv4", 00:31:35.801 "trsvcid": "$NVMF_PORT", 00:31:35.801 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:35.801 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:35.801 "hdgst": ${hdgst:-false}, 00:31:35.801 "ddgst": ${ddgst:-false} 00:31:35.801 }, 00:31:35.801 "method": "bdev_nvme_attach_controller" 00:31:35.801 } 00:31:35.801 EOF 00:31:35.801 )") 00:31:35.801 16:15:25 -- nvmf/common.sh@542 -- # cat 00:31:35.801 16:15:25 -- target/dif.sh@72 -- # (( file++ )) 00:31:35.801 16:15:25 -- target/dif.sh@72 -- # (( file <= files )) 00:31:35.801 16:15:25 -- target/dif.sh@73 -- # cat 00:31:35.801 16:15:25 -- target/dif.sh@72 -- # (( file++ )) 00:31:35.801 16:15:25 -- target/dif.sh@72 -- # (( file <= files )) 00:31:35.801 16:15:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:35.801 16:15:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:35.801 { 00:31:35.801 "params": { 00:31:35.801 "name": "Nvme$subsystem", 00:31:35.801 "trtype": "$TEST_TRANSPORT", 00:31:35.801 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:35.801 "adrfam": "ipv4", 00:31:35.801 "trsvcid": "$NVMF_PORT", 00:31:35.801 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:35.801 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:35.801 "hdgst": ${hdgst:-false}, 00:31:35.801 "ddgst": ${ddgst:-false} 00:31:35.801 }, 00:31:35.801 "method": "bdev_nvme_attach_controller" 00:31:35.801 } 00:31:35.801 EOF 00:31:35.801 )") 00:31:35.801 16:15:25 -- nvmf/common.sh@542 -- # cat 00:31:35.801 16:15:25 -- nvmf/common.sh@544 -- # jq . 00:31:35.801 16:15:25 -- nvmf/common.sh@545 -- # IFS=, 00:31:35.801 16:15:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:35.801 "params": { 00:31:35.801 "name": "Nvme0", 00:31:35.801 "trtype": "tcp", 00:31:35.801 "traddr": "10.0.0.2", 00:31:35.801 "adrfam": "ipv4", 00:31:35.801 "trsvcid": "4420", 00:31:35.801 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:35.801 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:35.801 "hdgst": false, 00:31:35.801 "ddgst": false 00:31:35.801 }, 00:31:35.801 "method": "bdev_nvme_attach_controller" 00:31:35.801 },{ 00:31:35.801 "params": { 00:31:35.801 "name": "Nvme1", 00:31:35.801 "trtype": "tcp", 00:31:35.801 "traddr": "10.0.0.2", 00:31:35.801 "adrfam": "ipv4", 00:31:35.801 "trsvcid": "4420", 00:31:35.801 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:35.801 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:35.801 "hdgst": false, 00:31:35.801 "ddgst": false 00:31:35.801 }, 00:31:35.801 "method": "bdev_nvme_attach_controller" 00:31:35.801 },{ 00:31:35.801 "params": { 00:31:35.801 "name": "Nvme2", 00:31:35.801 "trtype": "tcp", 00:31:35.801 "traddr": "10.0.0.2", 00:31:35.801 "adrfam": "ipv4", 00:31:35.801 "trsvcid": "4420", 00:31:35.801 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:31:35.801 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:31:35.801 "hdgst": false, 00:31:35.801 "ddgst": false 00:31:35.801 }, 00:31:35.801 "method": "bdev_nvme_attach_controller" 00:31:35.801 }' 00:31:35.801 16:15:25 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:35.801 16:15:25 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:35.801 16:15:25 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:35.801 16:15:25 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:35.801 16:15:25 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:35.801 16:15:25 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:35.801 16:15:25 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:35.801 16:15:25 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:35.801 16:15:25 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:35.801 16:15:25 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:36.062 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:36.062 ... 00:31:36.062 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:36.062 ... 00:31:36.062 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:36.062 ... 00:31:36.062 fio-3.35 00:31:36.062 Starting 24 threads 00:31:36.062 EAL: No free 2048 kB hugepages reported on node 1 00:31:37.001 [2024-10-30 16:15:26.543107] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:37.001 [2024-10-30 16:15:26.543183] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:46.979 00:31:46.979 filename0: (groupid=0, jobs=1): err= 0: pid=2563915: Wed Oct 30 16:15:36 2024 00:31:46.979 read: IOPS=503, BW=2014KiB/s (2063kB/s)(19.7MiB/10008msec) 00:31:46.979 slat (usec): min=6, max=131, avg=38.35, stdev=14.89 00:31:46.979 clat (usec): min=10756, max=60921, avg=31404.56, stdev=2010.01 00:31:46.979 lat (usec): min=10778, max=60946, avg=31442.92, stdev=2010.72 00:31:46.979 clat percentiles (usec): 00:31:46.979 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:31:46.979 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:31:46.979 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[33162], 00:31:46.979 | 99.00th=[34341], 99.50th=[34866], 99.90th=[53216], 99.95th=[53216], 00:31:46.979 | 99.99th=[61080] 00:31:46.979 bw ( KiB/s): min= 1667, max= 2048, per=4.16%, avg=2007.74, stdev=95.31, samples=19 00:31:46.979 iops : min= 416, max= 512, avg=501.89, stdev=23.98, samples=19 00:31:46.979 lat (msec) : 20=0.63%, 50=99.05%, 100=0.32% 00:31:46.979 cpu : usr=97.87%, sys=1.28%, ctx=166, majf=0, minf=54 00:31:46.979 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:46.979 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.979 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.979 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.979 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.979 filename0: (groupid=0, jobs=1): err= 0: pid=2563916: Wed Oct 30 16:15:36 2024 00:31:46.979 read: IOPS=503, BW=2014KiB/s (2062kB/s)(19.7MiB/10012msec) 00:31:46.979 slat (nsec): min=8027, max=94768, avg=32379.99, stdev=15145.16 00:31:46.979 clat (usec): min=18335, max=37983, avg=31518.13, stdev=1095.67 00:31:46.979 lat (usec): min=18343, max=38054, avg=31550.51, stdev=1098.65 00:31:46.979 clat percentiles (usec): 00:31:46.979 | 1.00th=[29754], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:46.979 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:31:46.979 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33817], 00:31:46.979 | 99.00th=[34341], 99.50th=[34866], 99.90th=[34866], 99.95th=[35390], 00:31:46.979 | 99.99th=[38011] 00:31:46.979 bw ( KiB/s): min= 1920, max= 2048, per=4.16%, avg=2009.75, stdev=59.95, samples=20 00:31:46.979 iops : min= 480, max= 512, avg=502.40, stdev=15.05, samples=20 00:31:46.980 lat (msec) : 20=0.32%, 50=99.68% 00:31:46.980 cpu : usr=97.62%, sys=1.48%, ctx=239, majf=0, minf=50 00:31:46.980 IO depths : 1=5.5%, 2=11.8%, 4=25.0%, 8=50.7%, 16=7.0%, 32=0.0%, >=64=0.0% 00:31:46.980 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.980 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.980 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.980 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.980 filename0: (groupid=0, jobs=1): err= 0: pid=2563917: Wed Oct 30 16:15:36 2024 00:31:46.980 read: IOPS=503, BW=2014KiB/s (2063kB/s)(19.7MiB/10008msec) 00:31:46.980 slat (nsec): min=5213, max=77982, avg=31549.90, stdev=8763.96 00:31:46.980 clat (usec): min=16307, max=38243, avg=31518.84, stdev=1173.78 00:31:46.980 lat (usec): min=16315, max=38274, avg=31550.39, stdev=1174.38 00:31:46.980 clat percentiles (usec): 00:31:46.980 | 1.00th=[30278], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:46.980 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:31:46.980 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33817], 00:31:46.980 | 99.00th=[34866], 99.50th=[34866], 99.90th=[34866], 99.95th=[34866], 00:31:46.980 | 99.99th=[38011] 00:31:46.980 bw ( KiB/s): min= 1920, max= 2048, per=4.16%, avg=2009.60, stdev=58.59, samples=20 00:31:46.980 iops : min= 480, max= 512, avg=502.40, stdev=14.65, samples=20 00:31:46.980 lat (msec) : 20=0.32%, 50=99.68% 00:31:46.980 cpu : usr=98.52%, sys=1.06%, ctx=15, majf=0, minf=39 00:31:46.980 IO depths : 1=3.2%, 2=9.4%, 4=25.0%, 8=53.1%, 16=9.3%, 32=0.0%, >=64=0.0% 00:31:46.980 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.980 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.980 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.980 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.980 filename0: (groupid=0, jobs=1): err= 0: pid=2563918: Wed Oct 30 16:15:36 2024 00:31:46.980 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10002msec) 00:31:46.980 slat (usec): min=8, max=109, avg=39.59, stdev=12.18 00:31:46.980 clat (usec): min=20290, max=44274, avg=31505.76, stdev=1722.08 00:31:46.980 lat (usec): min=20371, max=44293, avg=31545.35, stdev=1722.21 00:31:46.980 clat percentiles (usec): 00:31:46.980 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30802], 20.00th=[31065], 00:31:46.980 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:31:46.980 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33817], 00:31:46.980 | 99.00th=[40633], 99.50th=[42206], 99.90th=[44303], 99.95th=[44303], 00:31:46.980 | 99.99th=[44303] 00:31:46.980 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2007.58, stdev=74.55, samples=19 00:31:46.980 iops : min= 448, max= 512, avg=501.89, stdev=18.64, samples=19 00:31:46.980 lat (msec) : 50=100.00% 00:31:46.980 cpu : usr=98.57%, sys=1.00%, ctx=16, majf=0, minf=48 00:31:46.980 IO depths : 1=5.6%, 2=11.8%, 4=25.0%, 8=50.7%, 16=6.9%, 32=0.0%, >=64=0.0% 00:31:46.980 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.980 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.980 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.980 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.980 filename0: (groupid=0, jobs=1): err= 0: pid=2563919: Wed Oct 30 16:15:36 2024 00:31:46.980 read: IOPS=504, BW=2019KiB/s (2068kB/s)(19.8MiB/10016msec) 00:31:46.980 slat (usec): min=7, max=131, avg=27.38, stdev=14.72 00:31:46.980 clat (usec): min=11114, max=39294, avg=31473.66, stdev=1764.95 00:31:46.980 lat (usec): min=11123, max=39303, avg=31501.04, stdev=1763.57 00:31:46.980 clat percentiles (usec): 00:31:46.980 | 1.00th=[29492], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:46.980 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:31:46.980 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33817], 00:31:46.980 | 99.00th=[34866], 99.50th=[34866], 99.90th=[35390], 99.95th=[35914], 00:31:46.980 | 99.99th=[39060] 00:31:46.980 bw ( KiB/s): min= 1920, max= 2048, per=4.18%, avg=2016.00, stdev=56.87, samples=20 00:31:46.980 iops : min= 480, max= 512, avg=504.00, stdev=14.22, samples=20 00:31:46.980 lat (msec) : 20=0.63%, 50=99.37% 00:31:46.980 cpu : usr=96.92%, sys=1.97%, ctx=236, majf=0, minf=69 00:31:46.980 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:31:46.980 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.980 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.980 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.980 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.980 filename0: (groupid=0, jobs=1): err= 0: pid=2563920: Wed Oct 30 16:15:36 2024 00:31:46.980 read: IOPS=501, BW=2007KiB/s (2055kB/s)(19.6MiB/10006msec) 00:31:46.980 slat (usec): min=8, max=147, avg=51.36, stdev=29.89 00:31:46.980 clat (usec): min=10711, max=60504, avg=31460.25, stdev=2795.64 00:31:46.980 lat (usec): min=10732, max=60539, avg=31511.60, stdev=2796.87 00:31:46.980 clat percentiles (usec): 00:31:46.980 | 1.00th=[25297], 5.00th=[30016], 10.00th=[30540], 20.00th=[30802], 00:31:46.980 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:46.980 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[33817], 00:31:46.980 | 99.00th=[38536], 99.50th=[52691], 99.90th=[60556], 99.95th=[60556], 00:31:46.980 | 99.99th=[60556] 00:31:46.980 bw ( KiB/s): min= 1648, max= 2048, per=4.14%, avg=1999.16, stdev=98.12, samples=19 00:31:46.980 iops : min= 412, max= 512, avg=499.79, stdev=24.53, samples=19 00:31:46.980 lat (msec) : 20=0.60%, 50=98.69%, 100=0.72% 00:31:46.980 cpu : usr=98.52%, sys=0.95%, ctx=41, majf=0, minf=57 00:31:46.980 IO depths : 1=2.7%, 2=8.9%, 4=24.9%, 8=53.8%, 16=9.8%, 32=0.0%, >=64=0.0% 00:31:46.980 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.980 complete : 0=0.0%, 4=94.3%, 8=0.1%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.980 issued rwts: total=5020,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.980 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.980 filename0: (groupid=0, jobs=1): err= 0: pid=2563921: Wed Oct 30 16:15:36 2024 00:31:46.980 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10003msec) 00:31:46.980 slat (usec): min=9, max=109, avg=37.54, stdev=11.70 00:31:46.980 clat (usec): min=18617, max=60340, avg=31520.72, stdev=2026.48 00:31:46.980 lat (usec): min=18652, max=60382, avg=31558.27, stdev=2026.75 00:31:46.980 clat percentiles (usec): 00:31:46.980 | 1.00th=[30278], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:46.980 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:31:46.980 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33424], 00:31:46.980 | 99.00th=[34866], 99.50th=[40633], 99.90th=[60031], 99.95th=[60031], 00:31:46.980 | 99.99th=[60556] 00:31:46.980 bw ( KiB/s): min= 1664, max= 2048, per=4.16%, avg=2007.58, stdev=95.91, samples=19 00:31:46.980 iops : min= 416, max= 512, avg=501.89, stdev=23.98, samples=19 00:31:46.980 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:31:46.980 cpu : usr=97.71%, sys=1.31%, ctx=169, majf=0, minf=61 00:31:46.980 IO depths : 1=6.1%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:46.980 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.980 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.980 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.980 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.980 filename0: (groupid=0, jobs=1): err= 0: pid=2563922: Wed Oct 30 16:15:36 2024 00:31:46.980 read: IOPS=503, BW=2012KiB/s (2060kB/s)(19.7MiB/10019msec) 00:31:46.980 slat (nsec): min=8226, max=89413, avg=30887.88, stdev=12031.78 00:31:46.980 clat (usec): min=19257, max=41753, avg=31575.76, stdev=1152.94 00:31:46.980 lat (usec): min=19271, max=41773, avg=31606.65, stdev=1154.43 00:31:46.980 clat percentiles (usec): 00:31:46.980 | 1.00th=[30278], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:31:46.980 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:31:46.980 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33424], 00:31:46.981 | 99.00th=[34341], 99.50th=[34866], 99.90th=[41681], 99.95th=[41681], 00:31:46.981 | 99.99th=[41681] 00:31:46.981 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2009.60, stdev=71.82, samples=20 00:31:46.981 iops : min= 448, max= 512, avg=502.40, stdev=17.95, samples=20 00:31:46.981 lat (msec) : 20=0.32%, 50=99.68% 00:31:46.981 cpu : usr=96.73%, sys=1.96%, ctx=317, majf=0, minf=48 00:31:46.981 IO depths : 1=1.2%, 2=7.4%, 4=25.0%, 8=55.1%, 16=11.3%, 32=0.0%, >=64=0.0% 00:31:46.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.981 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.981 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.981 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.981 filename1: (groupid=0, jobs=1): err= 0: pid=2563923: Wed Oct 30 16:15:36 2024 00:31:46.981 read: IOPS=503, BW=2014KiB/s (2062kB/s)(19.7MiB/10007msec) 00:31:46.981 slat (usec): min=8, max=171, avg=33.76, stdev=23.38 00:31:46.981 clat (usec): min=9271, max=83117, avg=31524.05, stdev=2940.77 00:31:46.981 lat (usec): min=9286, max=83154, avg=31557.81, stdev=2941.52 00:31:46.981 clat percentiles (usec): 00:31:46.981 | 1.00th=[21627], 5.00th=[30540], 10.00th=[31065], 20.00th=[31065], 00:31:46.981 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:31:46.981 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32375], 95.00th=[33817], 00:31:46.981 | 99.00th=[38536], 99.50th=[49021], 99.90th=[60556], 99.95th=[60556], 00:31:46.981 | 99.99th=[83362] 00:31:46.981 bw ( KiB/s): min= 1664, max= 2080, per=4.15%, avg=2003.37, stdev=95.79, samples=19 00:31:46.981 iops : min= 416, max= 520, avg=500.84, stdev=23.95, samples=19 00:31:46.981 lat (msec) : 10=0.02%, 20=0.89%, 50=98.77%, 100=0.32% 00:31:46.981 cpu : usr=97.57%, sys=1.45%, ctx=151, majf=0, minf=84 00:31:46.981 IO depths : 1=0.1%, 2=6.0%, 4=24.2%, 8=57.3%, 16=12.5%, 32=0.0%, >=64=0.0% 00:31:46.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.981 complete : 0=0.0%, 4=94.2%, 8=0.3%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.981 issued rwts: total=5038,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.981 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.981 filename1: (groupid=0, jobs=1): err= 0: pid=2563924: Wed Oct 30 16:15:36 2024 00:31:46.981 read: IOPS=502, BW=2009KiB/s (2058kB/s)(19.6MiB/10001msec) 00:31:46.981 slat (usec): min=9, max=102, avg=37.28, stdev=11.51 00:31:46.981 clat (usec): min=19447, max=44227, avg=31533.99, stdev=1219.53 00:31:46.981 lat (usec): min=19458, max=44245, avg=31571.26, stdev=1219.87 00:31:46.981 clat percentiles (usec): 00:31:46.981 | 1.00th=[30540], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:46.981 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:31:46.981 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33424], 00:31:46.981 | 99.00th=[34866], 99.50th=[41157], 99.90th=[44303], 99.95th=[44303], 00:31:46.981 | 99.99th=[44303] 00:31:46.981 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2007.58, stdev=73.20, samples=19 00:31:46.981 iops : min= 448, max= 512, avg=501.89, stdev=18.30, samples=19 00:31:46.981 lat (msec) : 20=0.04%, 50=99.96% 00:31:46.981 cpu : usr=98.20%, sys=1.20%, ctx=111, majf=0, minf=56 00:31:46.981 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:46.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.981 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.981 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.981 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.981 filename1: (groupid=0, jobs=1): err= 0: pid=2563925: Wed Oct 30 16:15:36 2024 00:31:46.981 read: IOPS=506, BW=2025KiB/s (2074kB/s)(19.8MiB/10019msec) 00:31:46.981 slat (usec): min=7, max=171, avg=39.02, stdev=24.24 00:31:46.981 clat (usec): min=4125, max=40912, avg=31297.40, stdev=2391.51 00:31:46.981 lat (usec): min=4141, max=41051, avg=31336.42, stdev=2393.80 00:31:46.981 clat percentiles (usec): 00:31:46.981 | 1.00th=[28967], 5.00th=[30540], 10.00th=[30802], 20.00th=[31065], 00:31:46.981 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:31:46.981 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33424], 00:31:46.981 | 99.00th=[34341], 99.50th=[34866], 99.90th=[35390], 99.95th=[35390], 00:31:46.981 | 99.99th=[41157] 00:31:46.981 bw ( KiB/s): min= 1920, max= 2048, per=4.19%, avg=2022.40, stdev=52.53, samples=20 00:31:46.981 iops : min= 480, max= 512, avg=505.60, stdev=13.13, samples=20 00:31:46.981 lat (msec) : 10=0.63%, 20=0.32%, 50=99.05% 00:31:46.981 cpu : usr=98.54%, sys=1.04%, ctx=21, majf=0, minf=55 00:31:46.981 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:46.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.981 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.981 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.981 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.981 filename1: (groupid=0, jobs=1): err= 0: pid=2563926: Wed Oct 30 16:15:36 2024 00:31:46.981 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10003msec) 00:31:46.981 slat (usec): min=11, max=130, avg=42.02, stdev=21.06 00:31:46.981 clat (usec): min=18634, max=60577, avg=31429.22, stdev=1959.26 00:31:46.981 lat (usec): min=18676, max=60609, avg=31471.24, stdev=1959.86 00:31:46.981 clat percentiles (usec): 00:31:46.981 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:31:46.981 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:46.981 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[33162], 00:31:46.981 | 99.00th=[34866], 99.50th=[34866], 99.90th=[60556], 99.95th=[60556], 00:31:46.981 | 99.99th=[60556] 00:31:46.981 bw ( KiB/s): min= 1664, max= 2048, per=4.16%, avg=2007.58, stdev=95.91, samples=19 00:31:46.981 iops : min= 416, max= 512, avg=501.89, stdev=23.98, samples=19 00:31:46.981 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:31:46.981 cpu : usr=98.63%, sys=0.91%, ctx=22, majf=0, minf=53 00:31:46.981 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:46.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.981 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.981 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.981 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.981 filename1: (groupid=0, jobs=1): err= 0: pid=2563927: Wed Oct 30 16:15:36 2024 00:31:46.981 read: IOPS=502, BW=2011KiB/s (2059kB/s)(19.6MiB/10006msec) 00:31:46.981 slat (usec): min=8, max=135, avg=35.76, stdev=15.90 00:31:46.981 clat (usec): min=11869, max=69164, avg=31494.98, stdev=2282.69 00:31:46.981 lat (usec): min=11883, max=69198, avg=31530.74, stdev=2284.79 00:31:46.981 clat percentiles (usec): 00:31:46.981 | 1.00th=[29230], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:46.981 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:31:46.981 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[33817], 00:31:46.981 | 99.00th=[34866], 99.50th=[48497], 99.90th=[52691], 99.95th=[52691], 00:31:46.981 | 99.99th=[68682] 00:31:46.981 bw ( KiB/s): min= 1776, max= 2048, per=4.15%, avg=2003.37, stdev=76.66, samples=19 00:31:46.981 iops : min= 444, max= 512, avg=500.84, stdev=19.16, samples=19 00:31:46.981 lat (msec) : 20=0.64%, 50=98.95%, 100=0.42% 00:31:46.981 cpu : usr=98.52%, sys=0.96%, ctx=58, majf=0, minf=54 00:31:46.981 IO depths : 1=5.4%, 2=11.6%, 4=24.9%, 8=51.0%, 16=7.1%, 32=0.0%, >=64=0.0% 00:31:46.981 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.981 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.981 issued rwts: total=5030,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.981 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.981 filename1: (groupid=0, jobs=1): err= 0: pid=2563928: Wed Oct 30 16:15:36 2024 00:31:46.981 read: IOPS=503, BW=2014KiB/s (2063kB/s)(19.7MiB/10008msec) 00:31:46.981 slat (nsec): min=7940, max=99830, avg=18006.72, stdev=17568.57 00:31:46.981 clat (usec): min=15793, max=43288, avg=31598.57, stdev=1047.59 00:31:46.981 lat (usec): min=15832, max=43321, avg=31616.58, stdev=1050.13 00:31:46.982 clat percentiles (usec): 00:31:46.982 | 1.00th=[30016], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:31:46.982 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:31:46.982 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32375], 95.00th=[33162], 00:31:46.982 | 99.00th=[34341], 99.50th=[34866], 99.90th=[34866], 99.95th=[35390], 00:31:46.982 | 99.99th=[43254] 00:31:46.982 bw ( KiB/s): min= 1792, max= 2048, per=4.17%, avg=2014.32, stdev=71.93, samples=19 00:31:46.982 iops : min= 448, max= 512, avg=503.58, stdev=17.98, samples=19 00:31:46.982 lat (msec) : 20=0.20%, 50=99.80% 00:31:46.982 cpu : usr=97.37%, sys=1.68%, ctx=170, majf=0, minf=65 00:31:46.982 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:46.982 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.982 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.982 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.982 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.982 filename1: (groupid=0, jobs=1): err= 0: pid=2563929: Wed Oct 30 16:15:36 2024 00:31:46.982 read: IOPS=503, BW=2015KiB/s (2063kB/s)(19.7MiB/10007msec) 00:31:46.982 slat (usec): min=8, max=116, avg=41.74, stdev=16.82 00:31:46.982 clat (usec): min=10716, max=53327, avg=31365.38, stdev=1966.89 00:31:46.982 lat (usec): min=10774, max=53343, avg=31407.12, stdev=1968.08 00:31:46.982 clat percentiles (usec): 00:31:46.982 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:31:46.982 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:46.982 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[33162], 00:31:46.982 | 99.00th=[34341], 99.50th=[34866], 99.90th=[53216], 99.95th=[53216], 00:31:46.982 | 99.99th=[53216] 00:31:46.982 bw ( KiB/s): min= 1667, max= 2048, per=4.16%, avg=2007.74, stdev=95.31, samples=19 00:31:46.982 iops : min= 416, max= 512, avg=501.89, stdev=23.98, samples=19 00:31:46.982 lat (msec) : 20=0.63%, 50=99.05%, 100=0.32% 00:31:46.982 cpu : usr=98.17%, sys=1.21%, ctx=129, majf=0, minf=56 00:31:46.982 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:46.982 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.982 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.982 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.982 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.982 filename1: (groupid=0, jobs=1): err= 0: pid=2563930: Wed Oct 30 16:15:36 2024 00:31:46.982 read: IOPS=503, BW=2012KiB/s (2060kB/s)(19.7MiB/10019msec) 00:31:46.982 slat (nsec): min=9687, max=73332, avg=31357.36, stdev=9149.97 00:31:46.982 clat (usec): min=19214, max=43481, avg=31540.17, stdev=1215.61 00:31:46.982 lat (usec): min=19232, max=43516, avg=31571.53, stdev=1214.61 00:31:46.982 clat percentiles (usec): 00:31:46.982 | 1.00th=[30016], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:46.982 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:31:46.982 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33817], 00:31:46.982 | 99.00th=[34866], 99.50th=[34866], 99.90th=[41157], 99.95th=[41157], 00:31:46.982 | 99.99th=[43254] 00:31:46.982 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2009.60, stdev=73.12, samples=20 00:31:46.982 iops : min= 448, max= 512, avg=502.40, stdev=18.28, samples=20 00:31:46.982 lat (msec) : 20=0.32%, 50=99.68% 00:31:46.982 cpu : usr=97.44%, sys=1.44%, ctx=158, majf=0, minf=76 00:31:46.982 IO depths : 1=5.2%, 2=11.4%, 4=25.0%, 8=51.1%, 16=7.3%, 32=0.0%, >=64=0.0% 00:31:46.982 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.982 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.982 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.982 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.982 filename2: (groupid=0, jobs=1): err= 0: pid=2563931: Wed Oct 30 16:15:36 2024 00:31:46.982 read: IOPS=503, BW=2013KiB/s (2061kB/s)(19.7MiB/10014msec) 00:31:46.982 slat (usec): min=5, max=172, avg=37.83, stdev=25.25 00:31:46.982 clat (usec): min=20759, max=42753, avg=31507.36, stdev=1187.75 00:31:46.982 lat (usec): min=20771, max=42798, avg=31545.19, stdev=1187.67 00:31:46.982 clat percentiles (usec): 00:31:46.982 | 1.00th=[29754], 5.00th=[30540], 10.00th=[30802], 20.00th=[31065], 00:31:46.982 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:31:46.982 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33424], 00:31:46.982 | 99.00th=[34341], 99.50th=[34866], 99.90th=[41681], 99.95th=[42206], 00:31:46.982 | 99.99th=[42730] 00:31:46.982 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2009.60, stdev=69.14, samples=20 00:31:46.982 iops : min= 448, max= 512, avg=502.40, stdev=17.29, samples=20 00:31:46.982 lat (msec) : 50=100.00% 00:31:46.982 cpu : usr=98.55%, sys=1.03%, ctx=17, majf=0, minf=47 00:31:46.982 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:31:46.982 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.982 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.982 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.982 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.982 filename2: (groupid=0, jobs=1): err= 0: pid=2563932: Wed Oct 30 16:15:36 2024 00:31:46.982 read: IOPS=501, BW=2007KiB/s (2056kB/s)(19.6MiB/10011msec) 00:31:46.982 slat (usec): min=10, max=123, avg=37.24, stdev=14.63 00:31:46.982 clat (usec): min=18637, max=68308, avg=31543.45, stdev=2300.85 00:31:46.982 lat (usec): min=18671, max=68339, avg=31580.69, stdev=2301.75 00:31:46.982 clat percentiles (usec): 00:31:46.982 | 1.00th=[30278], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:46.982 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:31:46.982 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33162], 00:31:46.982 | 99.00th=[34341], 99.50th=[34866], 99.90th=[68682], 99.95th=[68682], 00:31:46.982 | 99.99th=[68682] 00:31:46.982 bw ( KiB/s): min= 1664, max= 2048, per=4.14%, avg=2000.84, stdev=97.39, samples=19 00:31:46.982 iops : min= 416, max= 512, avg=500.21, stdev=24.35, samples=19 00:31:46.982 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:31:46.982 cpu : usr=97.69%, sys=1.41%, ctx=102, majf=0, minf=56 00:31:46.982 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:46.982 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.982 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.982 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.982 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.982 filename2: (groupid=0, jobs=1): err= 0: pid=2563933: Wed Oct 30 16:15:36 2024 00:31:46.982 read: IOPS=503, BW=2012KiB/s (2061kB/s)(19.7MiB/10008msec) 00:31:46.982 slat (usec): min=8, max=204, avg=37.96, stdev=18.80 00:31:46.982 clat (usec): min=11102, max=83919, avg=31453.60, stdev=2740.66 00:31:46.982 lat (usec): min=11112, max=83952, avg=31491.55, stdev=2740.90 00:31:46.982 clat percentiles (usec): 00:31:46.982 | 1.00th=[23200], 5.00th=[30540], 10.00th=[30802], 20.00th=[31065], 00:31:46.982 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:31:46.982 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33817], 00:31:46.982 | 99.00th=[34866], 99.50th=[48497], 99.90th=[60556], 99.95th=[60556], 00:31:46.982 | 99.99th=[84411] 00:31:46.982 bw ( KiB/s): min= 1664, max= 2048, per=4.15%, avg=2005.47, stdev=95.41, samples=19 00:31:46.982 iops : min= 416, max= 512, avg=501.37, stdev=23.85, samples=19 00:31:46.982 lat (msec) : 20=0.89%, 50=98.67%, 100=0.44% 00:31:46.982 cpu : usr=98.34%, sys=0.98%, ctx=100, majf=0, minf=51 00:31:46.982 IO depths : 1=5.6%, 2=11.7%, 4=24.5%, 8=51.2%, 16=6.9%, 32=0.0%, >=64=0.0% 00:31:46.982 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.982 complete : 0=0.0%, 4=94.0%, 8=0.2%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.982 issued rwts: total=5035,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.982 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.983 filename2: (groupid=0, jobs=1): err= 0: pid=2563934: Wed Oct 30 16:15:36 2024 00:31:46.983 read: IOPS=503, BW=2014KiB/s (2063kB/s)(19.7MiB/10009msec) 00:31:46.983 slat (usec): min=8, max=138, avg=39.14, stdev=16.52 00:31:46.983 clat (usec): min=10785, max=54806, avg=31447.36, stdev=2104.84 00:31:46.983 lat (usec): min=10818, max=54844, avg=31486.50, stdev=2106.25 00:31:46.983 clat percentiles (usec): 00:31:46.983 | 1.00th=[30278], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:46.983 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:31:46.983 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33424], 00:31:46.983 | 99.00th=[34341], 99.50th=[34866], 99.90th=[54789], 99.95th=[54789], 00:31:46.983 | 99.99th=[54789] 00:31:46.983 bw ( KiB/s): min= 1664, max= 2064, per=4.16%, avg=2007.58, stdev=92.89, samples=19 00:31:46.983 iops : min= 416, max= 516, avg=501.89, stdev=23.22, samples=19 00:31:46.983 lat (msec) : 20=0.63%, 50=99.05%, 100=0.32% 00:31:46.983 cpu : usr=98.23%, sys=1.17%, ctx=49, majf=0, minf=53 00:31:46.983 IO depths : 1=1.3%, 2=7.5%, 4=24.9%, 8=55.0%, 16=11.2%, 32=0.0%, >=64=0.0% 00:31:46.983 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.983 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.983 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.983 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.983 filename2: (groupid=0, jobs=1): err= 0: pid=2563935: Wed Oct 30 16:15:36 2024 00:31:46.983 read: IOPS=507, BW=2031KiB/s (2080kB/s)(19.9MiB/10021msec) 00:31:46.983 slat (usec): min=5, max=185, avg=36.94, stdev=29.57 00:31:46.983 clat (usec): min=3178, max=42564, avg=31210.04, stdev=2902.14 00:31:46.983 lat (usec): min=3189, max=42586, avg=31246.98, stdev=2902.82 00:31:46.983 clat percentiles (usec): 00:31:46.983 | 1.00th=[14746], 5.00th=[30016], 10.00th=[30540], 20.00th=[31065], 00:31:46.983 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:31:46.983 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33424], 00:31:46.983 | 99.00th=[34341], 99.50th=[34866], 99.90th=[35390], 99.95th=[35914], 00:31:46.983 | 99.99th=[42730] 00:31:46.983 bw ( KiB/s): min= 1920, max= 2176, per=4.20%, avg=2028.80, stdev=62.64, samples=20 00:31:46.983 iops : min= 480, max= 544, avg=507.20, stdev=15.66, samples=20 00:31:46.983 lat (msec) : 4=0.63%, 10=0.31%, 20=0.31%, 50=98.74% 00:31:46.983 cpu : usr=98.38%, sys=1.21%, ctx=20, majf=0, minf=49 00:31:46.983 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:46.983 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.983 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.983 issued rwts: total=5088,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.983 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.983 filename2: (groupid=0, jobs=1): err= 0: pid=2563936: Wed Oct 30 16:15:36 2024 00:31:46.983 read: IOPS=502, BW=2011KiB/s (2059kB/s)(19.7MiB/10020msec) 00:31:46.983 slat (nsec): min=8429, max=93952, avg=32866.82, stdev=8971.97 00:31:46.983 clat (usec): min=20883, max=43554, avg=31531.93, stdev=1165.05 00:31:46.983 lat (usec): min=20904, max=43589, avg=31564.79, stdev=1164.69 00:31:46.983 clat percentiles (usec): 00:31:46.983 | 1.00th=[30016], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:46.983 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:31:46.983 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33817], 00:31:46.983 | 99.00th=[34866], 99.50th=[35390], 99.90th=[41157], 99.95th=[41157], 00:31:46.983 | 99.99th=[43779] 00:31:46.983 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2009.60, stdev=73.12, samples=20 00:31:46.983 iops : min= 448, max= 512, avg=502.40, stdev=18.28, samples=20 00:31:46.983 lat (msec) : 50=100.00% 00:31:46.983 cpu : usr=98.58%, sys=0.98%, ctx=16, majf=0, minf=47 00:31:46.983 IO depths : 1=4.7%, 2=11.0%, 4=25.0%, 8=51.5%, 16=7.8%, 32=0.0%, >=64=0.0% 00:31:46.983 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.983 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.983 issued rwts: total=5038,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.983 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.983 filename2: (groupid=0, jobs=1): err= 0: pid=2563937: Wed Oct 30 16:15:36 2024 00:31:46.983 read: IOPS=502, BW=2009KiB/s (2057kB/s)(19.6MiB/10002msec) 00:31:46.983 slat (usec): min=9, max=115, avg=40.42, stdev=13.20 00:31:46.983 clat (usec): min=18658, max=59749, avg=31476.85, stdev=1889.15 00:31:46.983 lat (usec): min=18695, max=59779, avg=31517.27, stdev=1889.74 00:31:46.983 clat percentiles (usec): 00:31:46.983 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30802], 20.00th=[31065], 00:31:46.983 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:31:46.983 | 70.00th=[31589], 80.00th=[31589], 90.00th=[32113], 95.00th=[33162], 00:31:46.983 | 99.00th=[34866], 99.50th=[34866], 99.90th=[59507], 99.95th=[59507], 00:31:46.983 | 99.99th=[59507] 00:31:46.983 bw ( KiB/s): min= 1667, max= 2048, per=4.16%, avg=2007.74, stdev=95.31, samples=19 00:31:46.983 iops : min= 416, max= 512, avg=501.89, stdev=23.98, samples=19 00:31:46.983 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:31:46.983 cpu : usr=98.45%, sys=1.15%, ctx=18, majf=0, minf=55 00:31:46.983 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:46.983 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.983 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.983 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.983 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.983 filename2: (groupid=0, jobs=1): err= 0: pid=2563938: Wed Oct 30 16:15:36 2024 00:31:46.983 read: IOPS=503, BW=2013KiB/s (2062kB/s)(19.7MiB/10013msec) 00:31:46.983 slat (usec): min=5, max=193, avg=37.71, stdev=16.75 00:31:46.983 clat (usec): min=18630, max=36698, avg=31474.70, stdev=1001.99 00:31:46.983 lat (usec): min=18636, max=36892, avg=31512.41, stdev=1005.18 00:31:46.983 clat percentiles (usec): 00:31:46.983 | 1.00th=[30278], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:31:46.983 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:31:46.983 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[33424], 00:31:46.983 | 99.00th=[34341], 99.50th=[34866], 99.90th=[35914], 99.95th=[36439], 00:31:46.983 | 99.99th=[36439] 00:31:46.983 bw ( KiB/s): min= 1795, max= 2048, per=4.16%, avg=2009.75, stdev=72.65, samples=20 00:31:46.983 iops : min= 448, max= 512, avg=502.40, stdev=18.28, samples=20 00:31:46.983 lat (msec) : 20=0.14%, 50=99.86% 00:31:46.983 cpu : usr=98.69%, sys=0.91%, ctx=17, majf=0, minf=52 00:31:46.983 IO depths : 1=6.2%, 2=12.5%, 4=24.9%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:46.983 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.983 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.983 issued rwts: total=5040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.983 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:46.983 00:31:46.983 Run status group 0 (all jobs): 00:31:46.983 READ: bw=47.1MiB/s (49.4MB/s), 2007KiB/s-2031KiB/s (2055kB/s-2080kB/s), io=472MiB (495MB), run=10001-10021msec 00:31:47.242 16:15:36 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:31:47.242 16:15:36 -- target/dif.sh@43 -- # local sub 00:31:47.242 16:15:36 -- target/dif.sh@45 -- # for sub in "$@" 00:31:47.242 16:15:36 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:47.242 16:15:36 -- target/dif.sh@36 -- # local sub_id=0 00:31:47.242 16:15:36 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:47.242 16:15:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:47.242 16:15:36 -- common/autotest_common.sh@10 -- # set +x 00:31:47.242 16:15:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:47.242 16:15:36 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:47.242 16:15:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:47.242 16:15:36 -- common/autotest_common.sh@10 -- # set +x 00:31:47.242 16:15:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:47.242 16:15:36 -- target/dif.sh@45 -- # for sub in "$@" 00:31:47.242 16:15:36 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:47.242 16:15:36 -- target/dif.sh@36 -- # local sub_id=1 00:31:47.242 16:15:36 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:47.242 16:15:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:47.242 16:15:36 -- common/autotest_common.sh@10 -- # set +x 00:31:47.242 16:15:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:47.242 16:15:36 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:47.242 16:15:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:47.242 16:15:36 -- common/autotest_common.sh@10 -- # set +x 00:31:47.242 16:15:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:47.242 16:15:37 -- target/dif.sh@45 -- # for sub in "$@" 00:31:47.242 16:15:37 -- target/dif.sh@46 -- # destroy_subsystem 2 00:31:47.242 16:15:37 -- target/dif.sh@36 -- # local sub_id=2 00:31:47.242 16:15:37 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:31:47.242 16:15:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:47.242 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:31:47.242 16:15:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:47.242 16:15:37 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:31:47.242 16:15:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:47.242 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:31:47.242 16:15:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:47.242 16:15:37 -- target/dif.sh@115 -- # NULL_DIF=1 00:31:47.242 16:15:37 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:31:47.242 16:15:37 -- target/dif.sh@115 -- # numjobs=2 00:31:47.242 16:15:37 -- target/dif.sh@115 -- # iodepth=8 00:31:47.242 16:15:37 -- target/dif.sh@115 -- # runtime=5 00:31:47.242 16:15:37 -- target/dif.sh@115 -- # files=1 00:31:47.242 16:15:37 -- target/dif.sh@117 -- # create_subsystems 0 1 00:31:47.242 16:15:37 -- target/dif.sh@28 -- # local sub 00:31:47.242 16:15:37 -- target/dif.sh@30 -- # for sub in "$@" 00:31:47.242 16:15:37 -- target/dif.sh@31 -- # create_subsystem 0 00:31:47.242 16:15:37 -- target/dif.sh@18 -- # local sub_id=0 00:31:47.243 16:15:37 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:47.243 16:15:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:47.243 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:31:47.243 bdev_null0 00:31:47.243 16:15:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:47.243 16:15:37 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:47.243 16:15:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:47.243 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:31:47.243 16:15:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:47.243 16:15:37 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:47.243 16:15:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:47.243 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:31:47.243 16:15:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:47.243 16:15:37 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:47.243 16:15:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:47.243 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:31:47.243 [2024-10-30 16:15:37.047554] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:47.243 16:15:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:47.243 16:15:37 -- target/dif.sh@30 -- # for sub in "$@" 00:31:47.243 16:15:37 -- target/dif.sh@31 -- # create_subsystem 1 00:31:47.243 16:15:37 -- target/dif.sh@18 -- # local sub_id=1 00:31:47.243 16:15:37 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:47.243 16:15:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:47.243 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:31:47.243 bdev_null1 00:31:47.243 16:15:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:47.243 16:15:37 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:47.243 16:15:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:47.243 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:31:47.243 16:15:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:47.243 16:15:37 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:47.243 16:15:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:47.243 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:31:47.243 16:15:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:47.243 16:15:37 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:47.243 16:15:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:47.243 16:15:37 -- common/autotest_common.sh@10 -- # set +x 00:31:47.243 16:15:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:47.243 16:15:37 -- target/dif.sh@118 -- # fio /dev/fd/62 00:31:47.243 16:15:37 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:31:47.243 16:15:37 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:47.243 16:15:37 -- nvmf/common.sh@520 -- # config=() 00:31:47.243 16:15:37 -- nvmf/common.sh@520 -- # local subsystem config 00:31:47.243 16:15:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:47.243 16:15:37 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:47.243 16:15:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:47.243 { 00:31:47.243 "params": { 00:31:47.243 "name": "Nvme$subsystem", 00:31:47.243 "trtype": "$TEST_TRANSPORT", 00:31:47.243 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:47.243 "adrfam": "ipv4", 00:31:47.243 "trsvcid": "$NVMF_PORT", 00:31:47.243 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:47.243 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:47.243 "hdgst": ${hdgst:-false}, 00:31:47.243 "ddgst": ${ddgst:-false} 00:31:47.243 }, 00:31:47.243 "method": "bdev_nvme_attach_controller" 00:31:47.243 } 00:31:47.243 EOF 00:31:47.243 )") 00:31:47.243 16:15:37 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:47.243 16:15:37 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:47.243 16:15:37 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:47.243 16:15:37 -- target/dif.sh@82 -- # gen_fio_conf 00:31:47.243 16:15:37 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:47.243 16:15:37 -- target/dif.sh@54 -- # local file 00:31:47.243 16:15:37 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:47.243 16:15:37 -- common/autotest_common.sh@1320 -- # shift 00:31:47.243 16:15:37 -- target/dif.sh@56 -- # cat 00:31:47.243 16:15:37 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:47.243 16:15:37 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:47.243 16:15:37 -- nvmf/common.sh@542 -- # cat 00:31:47.243 16:15:37 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:47.243 16:15:37 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:47.243 16:15:37 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:47.243 16:15:37 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:47.243 16:15:37 -- target/dif.sh@72 -- # (( file <= files )) 00:31:47.243 16:15:37 -- target/dif.sh@73 -- # cat 00:31:47.243 16:15:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:47.243 16:15:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:47.243 { 00:31:47.243 "params": { 00:31:47.243 "name": "Nvme$subsystem", 00:31:47.243 "trtype": "$TEST_TRANSPORT", 00:31:47.243 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:47.243 "adrfam": "ipv4", 00:31:47.243 "trsvcid": "$NVMF_PORT", 00:31:47.243 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:47.243 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:47.243 "hdgst": ${hdgst:-false}, 00:31:47.243 "ddgst": ${ddgst:-false} 00:31:47.243 }, 00:31:47.243 "method": "bdev_nvme_attach_controller" 00:31:47.243 } 00:31:47.243 EOF 00:31:47.243 )") 00:31:47.243 16:15:37 -- nvmf/common.sh@542 -- # cat 00:31:47.243 16:15:37 -- target/dif.sh@72 -- # (( file++ )) 00:31:47.243 16:15:37 -- target/dif.sh@72 -- # (( file <= files )) 00:31:47.243 16:15:37 -- nvmf/common.sh@544 -- # jq . 00:31:47.243 16:15:37 -- nvmf/common.sh@545 -- # IFS=, 00:31:47.243 16:15:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:47.243 "params": { 00:31:47.243 "name": "Nvme0", 00:31:47.243 "trtype": "tcp", 00:31:47.243 "traddr": "10.0.0.2", 00:31:47.243 "adrfam": "ipv4", 00:31:47.243 "trsvcid": "4420", 00:31:47.243 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:47.243 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:47.243 "hdgst": false, 00:31:47.243 "ddgst": false 00:31:47.243 }, 00:31:47.243 "method": "bdev_nvme_attach_controller" 00:31:47.243 },{ 00:31:47.243 "params": { 00:31:47.243 "name": "Nvme1", 00:31:47.243 "trtype": "tcp", 00:31:47.243 "traddr": "10.0.0.2", 00:31:47.243 "adrfam": "ipv4", 00:31:47.243 "trsvcid": "4420", 00:31:47.243 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:47.243 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:47.243 "hdgst": false, 00:31:47.243 "ddgst": false 00:31:47.243 }, 00:31:47.243 "method": "bdev_nvme_attach_controller" 00:31:47.243 }' 00:31:47.243 16:15:37 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:47.243 16:15:37 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:47.243 16:15:37 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:47.243 16:15:37 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:47.243 16:15:37 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:47.243 16:15:37 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:47.502 16:15:37 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:47.502 16:15:37 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:47.502 16:15:37 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:47.502 16:15:37 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:47.502 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:47.502 ... 00:31:47.502 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:47.502 ... 00:31:47.502 fio-3.35 00:31:47.502 Starting 4 threads 00:31:47.762 EAL: No free 2048 kB hugepages reported on node 1 00:31:48.328 [2024-10-30 16:15:38.023217] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:48.328 [2024-10-30 16:15:38.023311] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:53.582 00:31:53.582 filename0: (groupid=0, jobs=1): err= 0: pid=2565235: Wed Oct 30 16:15:43 2024 00:31:53.582 read: IOPS=2018, BW=15.8MiB/s (16.5MB/s)(78.9MiB/5002msec) 00:31:53.582 slat (nsec): min=4026, max=43270, avg=13210.97, stdev=4505.23 00:31:53.582 clat (usec): min=767, max=7183, avg=3918.49, stdev=596.50 00:31:53.582 lat (usec): min=780, max=7198, avg=3931.70, stdev=596.37 00:31:53.582 clat percentiles (usec): 00:31:53.582 | 1.00th=[ 2376], 5.00th=[ 3163], 10.00th=[ 3359], 20.00th=[ 3589], 00:31:53.582 | 30.00th=[ 3785], 40.00th=[ 3851], 50.00th=[ 3884], 60.00th=[ 3949], 00:31:53.582 | 70.00th=[ 3982], 80.00th=[ 4080], 90.00th=[ 4490], 95.00th=[ 5014], 00:31:53.582 | 99.00th=[ 6325], 99.50th=[ 6587], 99.90th=[ 6915], 99.95th=[ 6980], 00:31:53.582 | 99.99th=[ 7046] 00:31:53.582 bw ( KiB/s): min=15568, max=16544, per=24.84%, avg=16078.22, stdev=285.82, samples=9 00:31:53.582 iops : min= 1946, max= 2068, avg=2009.78, stdev=35.73, samples=9 00:31:53.582 lat (usec) : 1000=0.06% 00:31:53.582 lat (msec) : 2=0.55%, 4=71.17%, 10=28.22% 00:31:53.582 cpu : usr=95.22%, sys=4.30%, ctx=10, majf=0, minf=0 00:31:53.582 IO depths : 1=0.1%, 2=12.4%, 4=58.9%, 8=28.6%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:53.582 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.582 complete : 0=0.0%, 4=93.0%, 8=7.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.582 issued rwts: total=10096,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.582 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:53.582 filename0: (groupid=0, jobs=1): err= 0: pid=2565236: Wed Oct 30 16:15:43 2024 00:31:53.582 read: IOPS=2033, BW=15.9MiB/s (16.7MB/s)(79.5MiB/5004msec) 00:31:53.582 slat (nsec): min=3965, max=70708, avg=14183.19, stdev=5069.52 00:31:53.582 clat (usec): min=650, max=7324, avg=3882.69, stdev=564.52 00:31:53.582 lat (usec): min=664, max=7333, avg=3896.87, stdev=564.48 00:31:53.582 clat percentiles (usec): 00:31:53.582 | 1.00th=[ 2212], 5.00th=[ 3097], 10.00th=[ 3359], 20.00th=[ 3556], 00:31:53.582 | 30.00th=[ 3752], 40.00th=[ 3851], 50.00th=[ 3884], 60.00th=[ 3916], 00:31:53.582 | 70.00th=[ 3982], 80.00th=[ 4047], 90.00th=[ 4359], 95.00th=[ 4883], 00:31:53.582 | 99.00th=[ 5866], 99.50th=[ 6390], 99.90th=[ 6915], 99.95th=[ 6980], 00:31:53.582 | 99.99th=[ 7177] 00:31:53.582 bw ( KiB/s): min=15632, max=16784, per=25.14%, avg=16272.00, stdev=324.76, samples=10 00:31:53.582 iops : min= 1954, max= 2098, avg=2034.00, stdev=40.60, samples=10 00:31:53.582 lat (usec) : 750=0.01%, 1000=0.05% 00:31:53.582 lat (msec) : 2=0.54%, 4=73.34%, 10=26.06% 00:31:53.582 cpu : usr=88.81%, sys=7.74%, ctx=157, majf=0, minf=0 00:31:53.582 IO depths : 1=0.4%, 2=13.0%, 4=59.3%, 8=27.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:53.582 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.582 complete : 0=0.0%, 4=92.2%, 8=7.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.582 issued rwts: total=10178,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.582 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:53.582 filename1: (groupid=0, jobs=1): err= 0: pid=2565237: Wed Oct 30 16:15:43 2024 00:31:53.582 read: IOPS=2044, BW=16.0MiB/s (16.7MB/s)(79.9MiB/5004msec) 00:31:53.582 slat (nsec): min=3687, max=41784, avg=13618.57, stdev=4720.61 00:31:53.582 clat (usec): min=616, max=7112, avg=3865.93, stdev=563.29 00:31:53.582 lat (usec): min=629, max=7127, avg=3879.54, stdev=563.28 00:31:53.582 clat percentiles (usec): 00:31:53.582 | 1.00th=[ 2278], 5.00th=[ 3097], 10.00th=[ 3294], 20.00th=[ 3556], 00:31:53.582 | 30.00th=[ 3720], 40.00th=[ 3818], 50.00th=[ 3884], 60.00th=[ 3916], 00:31:53.582 | 70.00th=[ 3982], 80.00th=[ 4047], 90.00th=[ 4293], 95.00th=[ 4752], 00:31:53.582 | 99.00th=[ 6128], 99.50th=[ 6587], 99.90th=[ 7046], 99.95th=[ 7046], 00:31:53.582 | 99.99th=[ 7111] 00:31:53.582 bw ( KiB/s): min=15488, max=17168, per=25.27%, avg=16355.20, stdev=525.26, samples=10 00:31:53.582 iops : min= 1936, max= 2146, avg=2044.40, stdev=65.66, samples=10 00:31:53.582 lat (usec) : 750=0.01%, 1000=0.06% 00:31:53.582 lat (msec) : 2=0.57%, 4=73.84%, 10=25.52% 00:31:53.582 cpu : usr=90.09%, sys=7.36%, ctx=332, majf=0, minf=0 00:31:53.582 IO depths : 1=0.3%, 2=13.7%, 4=58.0%, 8=28.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:53.582 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.582 complete : 0=0.0%, 4=92.7%, 8=7.3%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.582 issued rwts: total=10230,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.582 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:53.582 filename1: (groupid=0, jobs=1): err= 0: pid=2565238: Wed Oct 30 16:15:43 2024 00:31:53.582 read: IOPS=1996, BW=15.6MiB/s (16.4MB/s)(78.0MiB/5001msec) 00:31:53.582 slat (nsec): min=3722, max=68357, avg=14479.12, stdev=5703.54 00:31:53.582 clat (usec): min=637, max=7317, avg=3958.17, stdev=641.45 00:31:53.582 lat (usec): min=650, max=7335, avg=3972.65, stdev=641.34 00:31:53.582 clat percentiles (usec): 00:31:53.582 | 1.00th=[ 2507], 5.00th=[ 3163], 10.00th=[ 3425], 20.00th=[ 3621], 00:31:53.582 | 30.00th=[ 3785], 40.00th=[ 3851], 50.00th=[ 3884], 60.00th=[ 3949], 00:31:53.582 | 70.00th=[ 4015], 80.00th=[ 4113], 90.00th=[ 4686], 95.00th=[ 5211], 00:31:53.582 | 99.00th=[ 6390], 99.50th=[ 6652], 99.90th=[ 7111], 99.95th=[ 7177], 00:31:53.582 | 99.99th=[ 7308] 00:31:53.582 bw ( KiB/s): min=15600, max=16336, per=24.74%, avg=16014.22, stdev=235.35, samples=9 00:31:53.582 iops : min= 1950, max= 2042, avg=2001.78, stdev=29.42, samples=9 00:31:53.582 lat (usec) : 750=0.11%, 1000=0.14% 00:31:53.582 lat (msec) : 2=0.43%, 4=69.45%, 10=29.87% 00:31:53.582 cpu : usr=89.76%, sys=6.64%, ctx=170, majf=0, minf=9 00:31:53.582 IO depths : 1=0.2%, 2=12.1%, 4=58.8%, 8=28.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:53.582 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.582 complete : 0=0.0%, 4=93.4%, 8=6.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:53.582 issued rwts: total=9982,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:53.582 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:53.582 00:31:53.582 Run status group 0 (all jobs): 00:31:53.582 READ: bw=63.2MiB/s (66.3MB/s), 15.6MiB/s-16.0MiB/s (16.4MB/s-16.7MB/s), io=316MiB (332MB), run=5001-5004msec 00:31:53.582 16:15:43 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:31:53.582 16:15:43 -- target/dif.sh@43 -- # local sub 00:31:53.582 16:15:43 -- target/dif.sh@45 -- # for sub in "$@" 00:31:53.582 16:15:43 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:53.582 16:15:43 -- target/dif.sh@36 -- # local sub_id=0 00:31:53.582 16:15:43 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:53.582 16:15:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:53.582 16:15:43 -- common/autotest_common.sh@10 -- # set +x 00:31:53.582 16:15:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:53.582 16:15:43 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:53.582 16:15:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:53.582 16:15:43 -- common/autotest_common.sh@10 -- # set +x 00:31:53.582 16:15:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:53.582 16:15:43 -- target/dif.sh@45 -- # for sub in "$@" 00:31:53.582 16:15:43 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:53.582 16:15:43 -- target/dif.sh@36 -- # local sub_id=1 00:31:53.582 16:15:43 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:53.582 16:15:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:53.582 16:15:43 -- common/autotest_common.sh@10 -- # set +x 00:31:53.582 16:15:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:53.582 16:15:43 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:53.582 16:15:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:53.582 16:15:43 -- common/autotest_common.sh@10 -- # set +x 00:31:53.582 16:15:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:53.582 00:31:53.582 real 0m24.082s 00:31:53.582 user 4m32.777s 00:31:53.582 sys 0m5.891s 00:31:53.582 16:15:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:31:53.582 16:15:43 -- common/autotest_common.sh@10 -- # set +x 00:31:53.582 ************************************ 00:31:53.582 END TEST fio_dif_rand_params 00:31:53.582 ************************************ 00:31:53.582 16:15:43 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:31:53.582 16:15:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:31:53.582 16:15:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:31:53.582 16:15:43 -- common/autotest_common.sh@10 -- # set +x 00:31:53.582 ************************************ 00:31:53.582 START TEST fio_dif_digest 00:31:53.582 ************************************ 00:31:53.582 16:15:43 -- common/autotest_common.sh@1104 -- # fio_dif_digest 00:31:53.582 16:15:43 -- target/dif.sh@123 -- # local NULL_DIF 00:31:53.582 16:15:43 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:31:53.582 16:15:43 -- target/dif.sh@125 -- # local hdgst ddgst 00:31:53.582 16:15:43 -- target/dif.sh@127 -- # NULL_DIF=3 00:31:53.582 16:15:43 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:31:53.582 16:15:43 -- target/dif.sh@127 -- # numjobs=3 00:31:53.582 16:15:43 -- target/dif.sh@127 -- # iodepth=3 00:31:53.582 16:15:43 -- target/dif.sh@127 -- # runtime=10 00:31:53.582 16:15:43 -- target/dif.sh@128 -- # hdgst=true 00:31:53.582 16:15:43 -- target/dif.sh@128 -- # ddgst=true 00:31:53.582 16:15:43 -- target/dif.sh@130 -- # create_subsystems 0 00:31:53.583 16:15:43 -- target/dif.sh@28 -- # local sub 00:31:53.583 16:15:43 -- target/dif.sh@30 -- # for sub in "$@" 00:31:53.583 16:15:43 -- target/dif.sh@31 -- # create_subsystem 0 00:31:53.583 16:15:43 -- target/dif.sh@18 -- # local sub_id=0 00:31:53.583 16:15:43 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:53.583 16:15:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:53.583 16:15:43 -- common/autotest_common.sh@10 -- # set +x 00:31:53.583 bdev_null0 00:31:53.583 16:15:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:53.583 16:15:43 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:53.583 16:15:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:53.583 16:15:43 -- common/autotest_common.sh@10 -- # set +x 00:31:53.583 16:15:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:53.583 16:15:43 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:53.583 16:15:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:53.583 16:15:43 -- common/autotest_common.sh@10 -- # set +x 00:31:53.583 16:15:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:53.583 16:15:43 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:53.583 16:15:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:31:53.583 16:15:43 -- common/autotest_common.sh@10 -- # set +x 00:31:53.583 [2024-10-30 16:15:43.416827] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:53.583 16:15:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:31:53.583 16:15:43 -- target/dif.sh@131 -- # fio /dev/fd/62 00:31:53.583 16:15:43 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:53.583 16:15:43 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:31:53.583 16:15:43 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:53.583 16:15:43 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:53.583 16:15:43 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:31:53.583 16:15:43 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:53.583 16:15:43 -- nvmf/common.sh@520 -- # config=() 00:31:53.583 16:15:43 -- target/dif.sh@82 -- # gen_fio_conf 00:31:53.583 16:15:43 -- common/autotest_common.sh@1318 -- # local sanitizers 00:31:53.583 16:15:43 -- nvmf/common.sh@520 -- # local subsystem config 00:31:53.583 16:15:43 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:53.583 16:15:43 -- target/dif.sh@54 -- # local file 00:31:53.583 16:15:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:53.583 16:15:43 -- common/autotest_common.sh@1320 -- # shift 00:31:53.583 16:15:43 -- target/dif.sh@56 -- # cat 00:31:53.583 16:15:43 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:31:53.583 16:15:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:53.583 { 00:31:53.583 "params": { 00:31:53.583 "name": "Nvme$subsystem", 00:31:53.583 "trtype": "$TEST_TRANSPORT", 00:31:53.583 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:53.583 "adrfam": "ipv4", 00:31:53.583 "trsvcid": "$NVMF_PORT", 00:31:53.583 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:53.583 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:53.583 "hdgst": ${hdgst:-false}, 00:31:53.583 "ddgst": ${ddgst:-false} 00:31:53.583 }, 00:31:53.583 "method": "bdev_nvme_attach_controller" 00:31:53.583 } 00:31:53.583 EOF 00:31:53.583 )") 00:31:53.583 16:15:43 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:53.583 16:15:43 -- nvmf/common.sh@542 -- # cat 00:31:53.583 16:15:43 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:53.583 16:15:43 -- common/autotest_common.sh@1324 -- # grep libasan 00:31:53.583 16:15:43 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:53.583 16:15:43 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:53.583 16:15:43 -- target/dif.sh@72 -- # (( file <= files )) 00:31:53.583 16:15:43 -- nvmf/common.sh@544 -- # jq . 00:31:53.583 16:15:43 -- nvmf/common.sh@545 -- # IFS=, 00:31:53.583 16:15:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:53.583 "params": { 00:31:53.583 "name": "Nvme0", 00:31:53.583 "trtype": "tcp", 00:31:53.583 "traddr": "10.0.0.2", 00:31:53.583 "adrfam": "ipv4", 00:31:53.583 "trsvcid": "4420", 00:31:53.583 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:53.583 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:53.583 "hdgst": true, 00:31:53.583 "ddgst": true 00:31:53.583 }, 00:31:53.583 "method": "bdev_nvme_attach_controller" 00:31:53.583 }' 00:31:53.583 16:15:43 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:53.583 16:15:43 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:53.583 16:15:43 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:31:53.583 16:15:43 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:53.583 16:15:43 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:31:53.583 16:15:43 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:31:53.842 16:15:43 -- common/autotest_common.sh@1324 -- # asan_lib= 00:31:53.842 16:15:43 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:31:53.842 16:15:43 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:53.842 16:15:43 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:53.842 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:53.842 ... 00:31:53.842 fio-3.35 00:31:53.842 Starting 3 threads 00:31:53.842 EAL: No free 2048 kB hugepages reported on node 1 00:31:54.408 [2024-10-30 16:15:44.004666] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:54.408 [2024-10-30 16:15:44.004741] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:04.379 00:32:04.379 filename0: (groupid=0, jobs=1): err= 0: pid=2566007: Wed Oct 30 16:15:54 2024 00:32:04.379 read: IOPS=211, BW=26.4MiB/s (27.7MB/s)(264MiB/10005msec) 00:32:04.379 slat (nsec): min=4421, max=45861, avg=16077.54, stdev=4718.50 00:32:04.379 clat (usec): min=7367, max=19381, avg=14183.42, stdev=1035.22 00:32:04.379 lat (usec): min=7381, max=19408, avg=14199.49, stdev=1035.32 00:32:04.379 clat percentiles (usec): 00:32:04.379 | 1.00th=[11600], 5.00th=[12518], 10.00th=[12911], 20.00th=[13435], 00:32:04.379 | 30.00th=[13698], 40.00th=[13960], 50.00th=[14222], 60.00th=[14353], 00:32:04.379 | 70.00th=[14615], 80.00th=[15008], 90.00th=[15401], 95.00th=[15795], 00:32:04.379 | 99.00th=[16581], 99.50th=[16909], 99.90th=[19268], 99.95th=[19268], 00:32:04.379 | 99.99th=[19268] 00:32:04.379 bw ( KiB/s): min=26368, max=27648, per=33.55%, avg=27020.80, stdev=326.73, samples=20 00:32:04.379 iops : min= 206, max= 216, avg=211.10, stdev= 2.55, samples=20 00:32:04.379 lat (msec) : 10=0.28%, 20=99.72% 00:32:04.379 cpu : usr=94.85%, sys=4.64%, ctx=22, majf=0, minf=139 00:32:04.379 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:04.379 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:04.379 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:04.379 issued rwts: total=2113,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:04.379 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:04.379 filename0: (groupid=0, jobs=1): err= 0: pid=2566008: Wed Oct 30 16:15:54 2024 00:32:04.379 read: IOPS=204, BW=25.6MiB/s (26.8MB/s)(257MiB/10044msec) 00:32:04.379 slat (nsec): min=5241, max=78008, avg=16146.91, stdev=4882.92 00:32:04.379 clat (usec): min=11358, max=57194, avg=14629.65, stdev=2160.13 00:32:04.379 lat (usec): min=11375, max=57206, avg=14645.79, stdev=2159.79 00:32:04.379 clat percentiles (usec): 00:32:04.379 | 1.00th=[12387], 5.00th=[13042], 10.00th=[13435], 20.00th=[13829], 00:32:04.379 | 30.00th=[14091], 40.00th=[14222], 50.00th=[14484], 60.00th=[14746], 00:32:04.379 | 70.00th=[15008], 80.00th=[15270], 90.00th=[15664], 95.00th=[16057], 00:32:04.379 | 99.00th=[16909], 99.50th=[17171], 99.90th=[57410], 99.95th=[57410], 00:32:04.379 | 99.99th=[57410] 00:32:04.379 bw ( KiB/s): min=23552, max=26880, per=32.62%, avg=26265.60, stdev=706.72, samples=20 00:32:04.379 iops : min= 184, max= 210, avg=205.20, stdev= 5.52, samples=20 00:32:04.379 lat (msec) : 20=99.76%, 50=0.05%, 100=0.19% 00:32:04.379 cpu : usr=95.21%, sys=4.29%, ctx=19, majf=0, minf=202 00:32:04.379 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:04.379 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:04.379 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:04.379 issued rwts: total=2054,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:04.379 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:04.379 filename0: (groupid=0, jobs=1): err= 0: pid=2566009: Wed Oct 30 16:15:54 2024 00:32:04.379 read: IOPS=215, BW=26.9MiB/s (28.2MB/s)(269MiB/10004msec) 00:32:04.379 slat (nsec): min=3675, max=74764, avg=20423.10, stdev=5399.42 00:32:04.379 clat (usec): min=9138, max=20129, avg=13921.33, stdev=954.64 00:32:04.379 lat (usec): min=9153, max=20159, avg=13941.75, stdev=954.54 00:32:04.379 clat percentiles (usec): 00:32:04.379 | 1.00th=[11469], 5.00th=[12387], 10.00th=[12780], 20.00th=[13173], 00:32:04.379 | 30.00th=[13566], 40.00th=[13698], 50.00th=[13960], 60.00th=[14222], 00:32:04.379 | 70.00th=[14353], 80.00th=[14615], 90.00th=[15008], 95.00th=[15401], 00:32:04.379 | 99.00th=[16057], 99.50th=[16319], 99.90th=[18482], 99.95th=[18744], 00:32:04.379 | 99.99th=[20055] 00:32:04.379 bw ( KiB/s): min=26880, max=28160, per=34.17%, avg=27520.00, stdev=316.27, samples=20 00:32:04.379 iops : min= 210, max= 220, avg=215.00, stdev= 2.47, samples=20 00:32:04.379 lat (msec) : 10=0.19%, 20=99.77%, 50=0.05% 00:32:04.379 cpu : usr=92.36%, sys=5.83%, ctx=228, majf=0, minf=137 00:32:04.379 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:04.379 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:04.379 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:04.379 issued rwts: total=2152,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:04.379 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:04.379 00:32:04.379 Run status group 0 (all jobs): 00:32:04.379 READ: bw=78.6MiB/s (82.5MB/s), 25.6MiB/s-26.9MiB/s (26.8MB/s-28.2MB/s), io=790MiB (828MB), run=10004-10044msec 00:32:04.638 16:15:54 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:04.638 16:15:54 -- target/dif.sh@43 -- # local sub 00:32:04.638 16:15:54 -- target/dif.sh@45 -- # for sub in "$@" 00:32:04.638 16:15:54 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:04.638 16:15:54 -- target/dif.sh@36 -- # local sub_id=0 00:32:04.638 16:15:54 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:04.638 16:15:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:04.638 16:15:54 -- common/autotest_common.sh@10 -- # set +x 00:32:04.638 16:15:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:04.638 16:15:54 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:04.638 16:15:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:04.638 16:15:54 -- common/autotest_common.sh@10 -- # set +x 00:32:04.638 16:15:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:04.638 00:32:04.638 real 0m11.017s 00:32:04.638 user 0m29.247s 00:32:04.638 sys 0m1.755s 00:32:04.638 16:15:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:04.638 16:15:54 -- common/autotest_common.sh@10 -- # set +x 00:32:04.638 ************************************ 00:32:04.638 END TEST fio_dif_digest 00:32:04.638 ************************************ 00:32:04.638 16:15:54 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:04.638 16:15:54 -- target/dif.sh@147 -- # nvmftestfini 00:32:04.638 16:15:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:04.638 16:15:54 -- nvmf/common.sh@116 -- # sync 00:32:04.638 16:15:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:04.638 16:15:54 -- nvmf/common.sh@119 -- # set +e 00:32:04.638 16:15:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:04.638 16:15:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:04.638 rmmod nvme_tcp 00:32:04.638 rmmod nvme_fabrics 00:32:04.638 rmmod nvme_keyring 00:32:04.638 16:15:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:04.638 16:15:54 -- nvmf/common.sh@123 -- # set -e 00:32:04.638 16:15:54 -- nvmf/common.sh@124 -- # return 0 00:32:04.638 16:15:54 -- nvmf/common.sh@477 -- # '[' -n 2559232 ']' 00:32:04.638 16:15:54 -- nvmf/common.sh@478 -- # killprocess 2559232 00:32:04.638 16:15:54 -- common/autotest_common.sh@926 -- # '[' -z 2559232 ']' 00:32:04.638 16:15:54 -- common/autotest_common.sh@930 -- # kill -0 2559232 00:32:04.638 16:15:54 -- common/autotest_common.sh@931 -- # uname 00:32:04.638 16:15:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:32:04.638 16:15:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2559232 00:32:04.897 16:15:54 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:32:04.897 16:15:54 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:32:04.897 16:15:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2559232' 00:32:04.897 killing process with pid 2559232 00:32:04.897 16:15:54 -- common/autotest_common.sh@945 -- # kill 2559232 00:32:04.897 16:15:54 -- common/autotest_common.sh@950 -- # wait 2559232 00:32:04.897 16:15:54 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:04.897 16:15:54 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:06.272 Waiting for block devices as requested 00:32:06.272 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:06.272 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:06.272 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:06.531 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:06.531 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:06.531 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:06.789 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:06.789 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:06.789 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:06.789 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:07.048 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:07.048 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:07.048 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:07.048 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:07.306 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:07.306 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:07.306 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:07.564 16:15:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:07.564 16:15:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:07.564 16:15:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:07.564 16:15:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:07.564 16:15:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:07.564 16:15:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:07.564 16:15:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:09.464 16:15:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:09.464 00:32:09.464 real 1m7.001s 00:32:09.464 user 6m30.162s 00:32:09.464 sys 0m16.705s 00:32:09.464 16:15:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:09.464 16:15:59 -- common/autotest_common.sh@10 -- # set +x 00:32:09.464 ************************************ 00:32:09.464 END TEST nvmf_dif 00:32:09.464 ************************************ 00:32:09.464 16:15:59 -- spdk/autotest.sh@301 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:09.464 16:15:59 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:09.464 16:15:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:09.464 16:15:59 -- common/autotest_common.sh@10 -- # set +x 00:32:09.464 ************************************ 00:32:09.464 START TEST nvmf_abort_qd_sizes 00:32:09.464 ************************************ 00:32:09.464 16:15:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:09.464 * Looking for test storage... 00:32:09.464 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:09.464 16:15:59 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:09.464 16:15:59 -- nvmf/common.sh@7 -- # uname -s 00:32:09.464 16:15:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:09.464 16:15:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:09.464 16:15:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:09.464 16:15:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:09.464 16:15:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:09.464 16:15:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:09.464 16:15:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:09.464 16:15:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:09.464 16:15:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:09.464 16:15:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:09.464 16:15:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:09.464 16:15:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:09.464 16:15:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:09.464 16:15:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:09.464 16:15:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:09.464 16:15:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:09.464 16:15:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:09.464 16:15:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:09.464 16:15:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:09.464 16:15:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:09.464 16:15:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:09.465 16:15:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:09.465 16:15:59 -- paths/export.sh@5 -- # export PATH 00:32:09.465 16:15:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:09.465 16:15:59 -- nvmf/common.sh@46 -- # : 0 00:32:09.465 16:15:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:09.465 16:15:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:09.465 16:15:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:09.465 16:15:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:09.465 16:15:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:09.465 16:15:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:09.465 16:15:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:09.465 16:15:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:09.465 16:15:59 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:09.465 16:15:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:09.465 16:15:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:09.465 16:15:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:09.465 16:15:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:09.465 16:15:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:09.465 16:15:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:09.465 16:15:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:09.465 16:15:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:09.723 16:15:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:09.723 16:15:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:09.723 16:15:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:09.723 16:15:59 -- common/autotest_common.sh@10 -- # set +x 00:32:11.628 16:16:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:11.628 16:16:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:11.628 16:16:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:11.628 16:16:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:11.628 16:16:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:11.628 16:16:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:11.628 16:16:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:11.628 16:16:01 -- nvmf/common.sh@294 -- # net_devs=() 00:32:11.628 16:16:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:11.628 16:16:01 -- nvmf/common.sh@295 -- # e810=() 00:32:11.628 16:16:01 -- nvmf/common.sh@295 -- # local -ga e810 00:32:11.628 16:16:01 -- nvmf/common.sh@296 -- # x722=() 00:32:11.628 16:16:01 -- nvmf/common.sh@296 -- # local -ga x722 00:32:11.628 16:16:01 -- nvmf/common.sh@297 -- # mlx=() 00:32:11.628 16:16:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:11.628 16:16:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:11.628 16:16:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:11.628 16:16:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:11.628 16:16:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:11.628 16:16:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:11.628 16:16:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:11.628 16:16:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:11.628 16:16:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:11.628 16:16:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:11.628 16:16:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:11.628 16:16:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:11.628 16:16:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:11.628 16:16:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:11.628 16:16:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:11.628 16:16:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:11.628 16:16:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:11.628 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:11.628 16:16:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:11.628 16:16:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:11.628 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:11.628 16:16:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:11.628 16:16:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:11.628 16:16:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:11.628 16:16:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:11.628 16:16:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:11.628 16:16:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:11.628 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:11.628 16:16:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:11.628 16:16:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:11.628 16:16:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:11.628 16:16:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:11.628 16:16:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:11.628 16:16:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:11.628 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:11.628 16:16:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:11.628 16:16:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:11.628 16:16:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:11.628 16:16:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:11.628 16:16:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:11.628 16:16:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:11.628 16:16:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:11.628 16:16:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:11.628 16:16:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:11.628 16:16:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:11.628 16:16:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:11.628 16:16:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:11.628 16:16:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:11.628 16:16:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:11.628 16:16:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:11.628 16:16:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:11.628 16:16:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:11.628 16:16:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:11.628 16:16:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:11.628 16:16:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:11.628 16:16:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:11.628 16:16:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:11.628 16:16:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:11.628 16:16:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:11.628 16:16:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:11.628 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:11.628 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.174 ms 00:32:11.628 00:32:11.628 --- 10.0.0.2 ping statistics --- 00:32:11.628 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:11.628 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:32:11.628 16:16:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:11.628 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:11.628 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.063 ms 00:32:11.628 00:32:11.628 --- 10.0.0.1 ping statistics --- 00:32:11.628 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:11.628 rtt min/avg/max/mdev = 0.063/0.063/0.063/0.000 ms 00:32:11.628 16:16:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:11.628 16:16:01 -- nvmf/common.sh@410 -- # return 0 00:32:11.628 16:16:01 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:11.628 16:16:01 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:12.562 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:12.562 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:12.562 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:12.562 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:12.562 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:12.562 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:12.821 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:12.821 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:12.821 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:12.821 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:12.821 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:12.821 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:12.821 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:12.821 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:12.821 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:12.821 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:13.755 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:13.755 16:16:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:13.755 16:16:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:13.755 16:16:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:13.755 16:16:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:13.755 16:16:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:13.755 16:16:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:13.755 16:16:03 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:13.755 16:16:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:13.755 16:16:03 -- common/autotest_common.sh@712 -- # xtrace_disable 00:32:13.755 16:16:03 -- common/autotest_common.sh@10 -- # set +x 00:32:13.755 16:16:03 -- nvmf/common.sh@469 -- # nvmfpid=2570948 00:32:13.755 16:16:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:13.755 16:16:03 -- nvmf/common.sh@470 -- # waitforlisten 2570948 00:32:13.755 16:16:03 -- common/autotest_common.sh@819 -- # '[' -z 2570948 ']' 00:32:13.755 16:16:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:13.755 16:16:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:32:13.755 16:16:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:13.755 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:13.755 16:16:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:32:13.755 16:16:03 -- common/autotest_common.sh@10 -- # set +x 00:32:13.755 [2024-10-30 16:16:03.609760] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... 00:32:13.755 [2024-10-30 16:16:03.609845] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:14.015 EAL: No free 2048 kB hugepages reported on node 1 00:32:14.015 [2024-10-30 16:16:03.685066] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:14.015 [2024-10-30 16:16:03.778382] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:14.015 [2024-10-30 16:16:03.778550] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:14.015 [2024-10-30 16:16:03.778571] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:14.015 [2024-10-30 16:16:03.778585] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:14.015 [2024-10-30 16:16:03.778653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:14.015 [2024-10-30 16:16:03.778722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:14.015 [2024-10-30 16:16:03.778885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:14.015 [2024-10-30 16:16:03.778887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:14.947 16:16:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:32:14.948 16:16:04 -- common/autotest_common.sh@852 -- # return 0 00:32:14.948 16:16:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:14.948 16:16:04 -- common/autotest_common.sh@718 -- # xtrace_disable 00:32:14.948 16:16:04 -- common/autotest_common.sh@10 -- # set +x 00:32:14.948 16:16:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:14.948 16:16:04 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:14.948 16:16:04 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:14.948 16:16:04 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:14.948 16:16:04 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:14.948 16:16:04 -- scripts/common.sh@312 -- # local nvmes 00:32:14.948 16:16:04 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:14.948 16:16:04 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:14.948 16:16:04 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:14.948 16:16:04 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:14.948 16:16:04 -- scripts/common.sh@322 -- # uname -s 00:32:14.948 16:16:04 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:14.948 16:16:04 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:14.948 16:16:04 -- scripts/common.sh@327 -- # (( 1 )) 00:32:14.948 16:16:04 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:14.948 16:16:04 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:14.948 16:16:04 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:14.948 16:16:04 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:14.948 16:16:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:14.948 16:16:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:14.948 16:16:04 -- common/autotest_common.sh@10 -- # set +x 00:32:14.948 ************************************ 00:32:14.948 START TEST spdk_target_abort 00:32:14.948 ************************************ 00:32:14.948 16:16:04 -- common/autotest_common.sh@1104 -- # spdk_target 00:32:14.948 16:16:04 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:14.948 16:16:04 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:14.948 16:16:04 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:14.948 16:16:04 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:14.948 16:16:04 -- common/autotest_common.sh@10 -- # set +x 00:32:18.261 spdk_targetn1 00:32:18.261 16:16:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:18.261 16:16:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:18.261 16:16:07 -- common/autotest_common.sh@10 -- # set +x 00:32:18.261 [2024-10-30 16:16:07.429201] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:18.261 16:16:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:18.261 16:16:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:18.261 16:16:07 -- common/autotest_common.sh@10 -- # set +x 00:32:18.261 16:16:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:18.261 16:16:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:18.261 16:16:07 -- common/autotest_common.sh@10 -- # set +x 00:32:18.261 16:16:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:18.261 16:16:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:18.261 16:16:07 -- common/autotest_common.sh@10 -- # set +x 00:32:18.261 [2024-10-30 16:16:07.461505] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:18.261 16:16:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:18.261 16:16:07 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:18.261 EAL: No free 2048 kB hugepages reported on node 1 00:32:20.807 Initializing NVMe Controllers 00:32:20.807 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:20.807 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:20.807 Initialization complete. Launching workers. 00:32:20.807 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12797, failed: 0 00:32:20.807 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1246, failed to submit 11551 00:32:20.807 success 749, unsuccess 497, failed 0 00:32:20.807 16:16:10 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:20.807 16:16:10 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:20.807 EAL: No free 2048 kB hugepages reported on node 1 00:32:24.088 Initializing NVMe Controllers 00:32:24.088 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:24.088 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:24.088 Initialization complete. Launching workers. 00:32:24.088 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8698, failed: 0 00:32:24.088 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1239, failed to submit 7459 00:32:24.088 success 363, unsuccess 876, failed 0 00:32:24.088 16:16:13 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:24.088 16:16:13 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:24.088 EAL: No free 2048 kB hugepages reported on node 1 00:32:27.366 Initializing NVMe Controllers 00:32:27.367 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:27.367 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:27.367 Initialization complete. Launching workers. 00:32:27.367 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32092, failed: 0 00:32:27.367 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2777, failed to submit 29315 00:32:27.367 success 540, unsuccess 2237, failed 0 00:32:27.367 16:16:17 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:27.367 16:16:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:27.367 16:16:17 -- common/autotest_common.sh@10 -- # set +x 00:32:27.367 16:16:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:27.367 16:16:17 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:27.367 16:16:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:32:27.367 16:16:17 -- common/autotest_common.sh@10 -- # set +x 00:32:28.739 16:16:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:32:28.739 16:16:18 -- target/abort_qd_sizes.sh@62 -- # killprocess 2570948 00:32:28.739 16:16:18 -- common/autotest_common.sh@926 -- # '[' -z 2570948 ']' 00:32:28.739 16:16:18 -- common/autotest_common.sh@930 -- # kill -0 2570948 00:32:28.739 16:16:18 -- common/autotest_common.sh@931 -- # uname 00:32:28.739 16:16:18 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:32:28.739 16:16:18 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 2570948 00:32:28.739 16:16:18 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:32:28.739 16:16:18 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:32:28.739 16:16:18 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 2570948' 00:32:28.739 killing process with pid 2570948 00:32:28.739 16:16:18 -- common/autotest_common.sh@945 -- # kill 2570948 00:32:28.739 16:16:18 -- common/autotest_common.sh@950 -- # wait 2570948 00:32:28.997 00:32:28.997 real 0m14.124s 00:32:28.997 user 0m55.985s 00:32:28.997 sys 0m2.511s 00:32:28.997 16:16:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:28.997 16:16:18 -- common/autotest_common.sh@10 -- # set +x 00:32:28.997 ************************************ 00:32:28.997 END TEST spdk_target_abort 00:32:28.997 ************************************ 00:32:28.997 16:16:18 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:28.997 16:16:18 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:32:28.997 16:16:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:32:28.997 16:16:18 -- common/autotest_common.sh@10 -- # set +x 00:32:28.997 ************************************ 00:32:28.997 START TEST kernel_target_abort 00:32:28.997 ************************************ 00:32:28.997 16:16:18 -- common/autotest_common.sh@1104 -- # kernel_target 00:32:28.997 16:16:18 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:28.997 16:16:18 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:28.997 16:16:18 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:28.997 16:16:18 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:28.997 16:16:18 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:28.997 16:16:18 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:28.997 16:16:18 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:28.997 16:16:18 -- nvmf/common.sh@627 -- # local block nvme 00:32:28.997 16:16:18 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:28.997 16:16:18 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:28.997 16:16:18 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:28.997 16:16:18 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:29.930 Waiting for block devices as requested 00:32:30.189 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:30.189 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:30.448 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:30.448 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:30.448 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:30.448 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:30.706 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:30.706 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:30.706 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:30.706 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:30.963 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:30.963 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:30.963 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:30.963 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:31.220 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:31.220 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:31.220 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:31.220 16:16:21 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:31.220 16:16:21 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:31.220 16:16:21 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:31.220 16:16:21 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:31.220 16:16:21 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:31.477 No valid GPT data, bailing 00:32:31.477 16:16:21 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:31.477 16:16:21 -- scripts/common.sh@393 -- # pt= 00:32:31.477 16:16:21 -- scripts/common.sh@394 -- # return 1 00:32:31.477 16:16:21 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:31.477 16:16:21 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:31.477 16:16:21 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:31.478 16:16:21 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:31.478 16:16:21 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:31.478 16:16:21 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:31.478 16:16:21 -- nvmf/common.sh@654 -- # echo 1 00:32:31.478 16:16:21 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:31.478 16:16:21 -- nvmf/common.sh@656 -- # echo 1 00:32:31.478 16:16:21 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:31.478 16:16:21 -- nvmf/common.sh@663 -- # echo tcp 00:32:31.478 16:16:21 -- nvmf/common.sh@664 -- # echo 4420 00:32:31.478 16:16:21 -- nvmf/common.sh@665 -- # echo ipv4 00:32:31.478 16:16:21 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:31.478 16:16:21 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:32:31.478 00:32:31.478 Discovery Log Number of Records 2, Generation counter 2 00:32:31.478 =====Discovery Log Entry 0====== 00:32:31.478 trtype: tcp 00:32:31.478 adrfam: ipv4 00:32:31.478 subtype: current discovery subsystem 00:32:31.478 treq: not specified, sq flow control disable supported 00:32:31.478 portid: 1 00:32:31.478 trsvcid: 4420 00:32:31.478 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:31.478 traddr: 10.0.0.1 00:32:31.478 eflags: none 00:32:31.478 sectype: none 00:32:31.478 =====Discovery Log Entry 1====== 00:32:31.478 trtype: tcp 00:32:31.478 adrfam: ipv4 00:32:31.478 subtype: nvme subsystem 00:32:31.478 treq: not specified, sq flow control disable supported 00:32:31.478 portid: 1 00:32:31.478 trsvcid: 4420 00:32:31.478 subnqn: kernel_target 00:32:31.478 traddr: 10.0.0.1 00:32:31.478 eflags: none 00:32:31.478 sectype: none 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:31.478 16:16:21 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:31.478 EAL: No free 2048 kB hugepages reported on node 1 00:32:34.757 Initializing NVMe Controllers 00:32:34.757 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:34.757 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:34.757 Initialization complete. Launching workers. 00:32:34.757 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 47101, failed: 0 00:32:34.757 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 47101, failed to submit 0 00:32:34.757 success 0, unsuccess 47101, failed 0 00:32:34.757 16:16:24 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:34.757 16:16:24 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:34.757 EAL: No free 2048 kB hugepages reported on node 1 00:32:38.039 Initializing NVMe Controllers 00:32:38.039 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:38.039 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:38.039 Initialization complete. Launching workers. 00:32:38.039 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 83610, failed: 0 00:32:38.039 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 21062, failed to submit 62548 00:32:38.039 success 0, unsuccess 21062, failed 0 00:32:38.039 16:16:27 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:38.039 16:16:27 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:38.039 EAL: No free 2048 kB hugepages reported on node 1 00:32:41.331 Initializing NVMe Controllers 00:32:41.331 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:41.331 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:41.331 Initialization complete. Launching workers. 00:32:41.331 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 81115, failed: 0 00:32:41.331 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20210, failed to submit 60905 00:32:41.332 success 0, unsuccess 20210, failed 0 00:32:41.332 16:16:30 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:32:41.332 16:16:30 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:32:41.332 16:16:30 -- nvmf/common.sh@677 -- # echo 0 00:32:41.332 16:16:30 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:32:41.332 16:16:30 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:41.332 16:16:30 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:32:41.332 16:16:30 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:41.332 16:16:30 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:32:41.332 16:16:30 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:32:41.332 00:32:41.332 real 0m11.912s 00:32:41.332 user 0m5.953s 00:32:41.332 sys 0m2.325s 00:32:41.332 16:16:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:41.332 16:16:30 -- common/autotest_common.sh@10 -- # set +x 00:32:41.332 ************************************ 00:32:41.332 END TEST kernel_target_abort 00:32:41.332 ************************************ 00:32:41.332 16:16:30 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:32:41.332 16:16:30 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:32:41.332 16:16:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:41.332 16:16:30 -- nvmf/common.sh@116 -- # sync 00:32:41.332 16:16:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:41.332 16:16:30 -- nvmf/common.sh@119 -- # set +e 00:32:41.332 16:16:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:41.332 16:16:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:41.332 rmmod nvme_tcp 00:32:41.332 rmmod nvme_fabrics 00:32:41.332 rmmod nvme_keyring 00:32:41.332 16:16:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:41.332 16:16:30 -- nvmf/common.sh@123 -- # set -e 00:32:41.332 16:16:30 -- nvmf/common.sh@124 -- # return 0 00:32:41.332 16:16:30 -- nvmf/common.sh@477 -- # '[' -n 2570948 ']' 00:32:41.332 16:16:30 -- nvmf/common.sh@478 -- # killprocess 2570948 00:32:41.332 16:16:30 -- common/autotest_common.sh@926 -- # '[' -z 2570948 ']' 00:32:41.332 16:16:30 -- common/autotest_common.sh@930 -- # kill -0 2570948 00:32:41.332 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (2570948) - No such process 00:32:41.332 16:16:30 -- common/autotest_common.sh@953 -- # echo 'Process with pid 2570948 is not found' 00:32:41.332 Process with pid 2570948 is not found 00:32:41.332 16:16:30 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:41.332 16:16:30 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:42.269 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:32:42.269 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:32:42.269 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:32:42.269 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:32:42.269 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:32:42.269 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:32:42.269 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:32:42.269 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:32:42.269 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:32:42.269 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:32:42.269 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:32:42.269 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:32:42.269 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:32:42.269 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:32:42.269 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:32:42.269 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:32:42.269 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:32:42.528 16:16:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:42.528 16:16:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:42.528 16:16:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:42.528 16:16:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:42.528 16:16:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:42.528 16:16:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:42.528 16:16:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:44.435 16:16:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:44.435 00:32:44.435 real 0m34.943s 00:32:44.435 user 1m4.173s 00:32:44.435 sys 0m8.115s 00:32:44.435 16:16:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:32:44.435 16:16:34 -- common/autotest_common.sh@10 -- # set +x 00:32:44.435 ************************************ 00:32:44.435 END TEST nvmf_abort_qd_sizes 00:32:44.435 ************************************ 00:32:44.435 16:16:34 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:32:44.435 16:16:34 -- spdk/autotest.sh@315 -- # '[' 0 -eq 1 ']' 00:32:44.435 16:16:34 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:32:44.435 16:16:34 -- spdk/autotest.sh@324 -- # '[' 0 -eq 1 ']' 00:32:44.435 16:16:34 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:32:44.435 16:16:34 -- spdk/autotest.sh@338 -- # '[' 0 -eq 1 ']' 00:32:44.435 16:16:34 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:32:44.435 16:16:34 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:32:44.435 16:16:34 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:32:44.435 16:16:34 -- spdk/autotest.sh@355 -- # '[' 0 -eq 1 ']' 00:32:44.435 16:16:34 -- spdk/autotest.sh@359 -- # '[' 0 -eq 1 ']' 00:32:44.435 16:16:34 -- spdk/autotest.sh@366 -- # [[ 0 -eq 1 ]] 00:32:44.435 16:16:34 -- spdk/autotest.sh@370 -- # [[ 0 -eq 1 ]] 00:32:44.435 16:16:34 -- spdk/autotest.sh@374 -- # [[ 0 -eq 1 ]] 00:32:44.435 16:16:34 -- spdk/autotest.sh@378 -- # [[ 0 -eq 1 ]] 00:32:44.435 16:16:34 -- spdk/autotest.sh@383 -- # trap - SIGINT SIGTERM EXIT 00:32:44.435 16:16:34 -- spdk/autotest.sh@385 -- # timing_enter post_cleanup 00:32:44.435 16:16:34 -- common/autotest_common.sh@712 -- # xtrace_disable 00:32:44.435 16:16:34 -- common/autotest_common.sh@10 -- # set +x 00:32:44.435 16:16:34 -- spdk/autotest.sh@386 -- # autotest_cleanup 00:32:44.436 16:16:34 -- common/autotest_common.sh@1371 -- # local autotest_es=0 00:32:44.436 16:16:34 -- common/autotest_common.sh@1372 -- # xtrace_disable 00:32:44.436 16:16:34 -- common/autotest_common.sh@10 -- # set +x 00:32:46.337 INFO: APP EXITING 00:32:46.337 INFO: killing all VMs 00:32:46.337 INFO: killing vhost app 00:32:46.337 INFO: EXIT DONE 00:32:47.273 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:32:47.273 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:32:47.273 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:32:47.531 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:32:47.531 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:32:47.531 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:32:47.531 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:32:47.531 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:32:47.531 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:32:47.531 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:32:47.531 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:32:47.531 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:32:47.531 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:32:47.531 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:32:47.531 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:32:47.531 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:32:47.531 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:32:48.906 Cleaning 00:32:48.906 Removing: /var/run/dpdk/spdk0/config 00:32:48.906 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:32:48.906 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:32:48.906 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:32:48.906 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:32:48.906 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:32:48.906 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:32:48.906 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:32:48.906 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:32:48.906 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:32:48.906 Removing: /var/run/dpdk/spdk0/hugepage_info 00:32:48.906 Removing: /var/run/dpdk/spdk1/config 00:32:48.906 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:32:48.906 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:32:48.906 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:32:48.906 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:32:48.906 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:32:48.906 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:32:48.906 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:32:48.906 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:32:48.906 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:32:48.906 Removing: /var/run/dpdk/spdk1/hugepage_info 00:32:48.906 Removing: /var/run/dpdk/spdk1/mp_socket 00:32:48.906 Removing: /var/run/dpdk/spdk2/config 00:32:48.906 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:32:48.906 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:32:48.906 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:32:48.906 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:32:48.906 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:32:48.906 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:32:48.906 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:32:48.906 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:32:48.906 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:32:48.906 Removing: /var/run/dpdk/spdk2/hugepage_info 00:32:48.906 Removing: /var/run/dpdk/spdk3/config 00:32:48.906 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:32:48.906 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:32:48.906 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:32:48.906 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:32:48.906 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:32:48.906 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:32:48.906 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:32:48.906 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:32:48.906 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:32:48.906 Removing: /var/run/dpdk/spdk3/hugepage_info 00:32:48.906 Removing: /var/run/dpdk/spdk4/config 00:32:48.906 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:32:48.906 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:32:48.906 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:32:48.906 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:32:48.906 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:32:48.906 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:32:48.906 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:32:48.906 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:32:48.906 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:32:48.906 Removing: /var/run/dpdk/spdk4/hugepage_info 00:32:48.906 Removing: /dev/shm/bdev_svc_trace.1 00:32:48.906 Removing: /dev/shm/nvmf_trace.0 00:32:48.906 Removing: /dev/shm/spdk_tgt_trace.pid2293217 00:32:49.163 Removing: /var/run/dpdk/spdk0 00:32:49.163 Removing: /var/run/dpdk/spdk1 00:32:49.163 Removing: /var/run/dpdk/spdk2 00:32:49.163 Removing: /var/run/dpdk/spdk3 00:32:49.163 Removing: /var/run/dpdk/spdk4 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2291525 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2292269 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2293217 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2293706 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2294931 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2295873 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2296174 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2296380 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2296712 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2296915 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2297072 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2297261 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2297529 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2298000 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2300545 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2300845 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2301017 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2301157 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2301598 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2301739 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2302048 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2302190 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2302360 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2302504 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2302682 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2302825 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2303191 00:32:49.163 Removing: /var/run/dpdk/spdk_pid2303347 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2303636 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2303846 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2303871 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2304051 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2304198 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2304354 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2304492 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2304780 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2304920 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2305081 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2305219 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2305497 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2305647 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2305802 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2305946 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2306218 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2306368 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2306530 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2306671 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2306911 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2307098 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2307252 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2307398 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2307588 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2307813 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2307979 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2308185 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2308391 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2308650 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2308807 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2308959 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2309429 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2309879 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2310036 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2310183 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2310345 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2310605 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2310769 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2310919 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2311084 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2311341 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2311496 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2311653 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2311848 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2311994 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2312197 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2314267 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2371382 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2374033 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2381070 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2384386 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2386867 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2387285 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2391154 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2391162 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2391795 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2392394 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2393069 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2393480 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2393489 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2393627 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2393766 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2393772 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2394449 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2395121 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2395680 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2396088 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2396215 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2396360 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2397409 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2398377 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2404521 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2404803 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2407379 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2411243 00:32:49.164 Removing: /var/run/dpdk/spdk_pid2413487 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2420109 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2425504 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2426852 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2427537 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2438648 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2440891 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2443717 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2444939 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2446379 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2446576 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2446729 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2446972 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2447571 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2448962 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2449858 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2450345 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2453919 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2457493 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2461034 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2485410 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2488252 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2492220 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2493196 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2494427 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2497628 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2500061 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2504400 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2504492 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2507338 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2507605 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2507742 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2508017 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2508029 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2509138 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2510351 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2511581 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2512798 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2514007 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2515225 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2519230 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2519573 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2520901 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2521769 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2525555 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2528222 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2531828 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2535572 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2539111 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2539527 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2540068 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2540495 00:32:49.421 Removing: /var/run/dpdk/spdk_pid2541082 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2541516 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2542066 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2542623 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2545288 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2545432 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2549288 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2549473 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2551230 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2556388 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2556393 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2559398 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2561262 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2562945 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2563730 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2565049 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2565948 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2571449 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2571852 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2572253 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2573738 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2574147 00:32:49.422 Removing: /var/run/dpdk/spdk_pid2574541 00:32:49.422 Clean 00:32:49.422 killing process with pid 2262885 00:32:59.386 killing process with pid 2262882 00:32:59.386 killing process with pid 2262884 00:32:59.386 killing process with pid 2262883 00:32:59.386 16:16:47 -- common/autotest_common.sh@1436 -- # return 0 00:32:59.386 16:16:47 -- spdk/autotest.sh@387 -- # timing_exit post_cleanup 00:32:59.386 16:16:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:32:59.386 16:16:47 -- common/autotest_common.sh@10 -- # set +x 00:32:59.386 16:16:47 -- spdk/autotest.sh@389 -- # timing_exit autotest 00:32:59.386 16:16:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:32:59.386 16:16:47 -- common/autotest_common.sh@10 -- # set +x 00:32:59.386 16:16:47 -- spdk/autotest.sh@390 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:32:59.386 16:16:47 -- spdk/autotest.sh@392 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:32:59.386 16:16:47 -- spdk/autotest.sh@392 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:32:59.386 16:16:47 -- spdk/autotest.sh@394 -- # hash lcov 00:32:59.386 16:16:47 -- spdk/autotest.sh@394 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:32:59.386 16:16:47 -- spdk/autotest.sh@396 -- # hostname 00:32:59.386 16:16:47 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:32:59.386 geninfo: WARNING: invalid characters removed from testname! 00:33:31.459 16:17:15 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:31.459 16:17:19 -- spdk/autotest.sh@398 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:32.868 16:17:22 -- spdk/autotest.sh@399 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:35.439 16:17:25 -- spdk/autotest.sh@400 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:37.981 16:17:27 -- spdk/autotest.sh@401 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:41.280 16:17:30 -- spdk/autotest.sh@402 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:43.826 16:17:33 -- spdk/autotest.sh@403 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:33:43.826 16:17:33 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:33:43.826 16:17:33 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:33:43.826 16:17:33 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:43.826 16:17:33 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:43.826 16:17:33 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:43.826 16:17:33 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:43.826 16:17:33 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:43.826 16:17:33 -- paths/export.sh@5 -- $ export PATH 00:33:43.826 16:17:33 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:43.826 16:17:33 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:33:43.826 16:17:33 -- common/autobuild_common.sh@440 -- $ date +%s 00:33:43.826 16:17:33 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1730301453.XXXXXX 00:33:43.826 16:17:33 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1730301453.BpMLgl 00:33:43.826 16:17:33 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:33:43.826 16:17:33 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:33:43.826 16:17:33 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:33:43.826 16:17:33 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:33:43.826 16:17:33 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:33:43.826 16:17:33 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:33:43.826 16:17:33 -- common/autobuild_common.sh@456 -- $ get_config_params 00:33:43.826 16:17:33 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:33:43.826 16:17:33 -- common/autotest_common.sh@10 -- $ set +x 00:33:43.826 16:17:33 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:33:43.826 16:17:33 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:33:43.826 16:17:33 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:43.826 16:17:33 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:33:43.826 16:17:33 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:33:43.826 16:17:33 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:33:43.826 16:17:33 -- spdk/autopackage.sh@19 -- $ timing_finish 00:33:43.826 16:17:33 -- common/autotest_common.sh@724 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:33:43.826 16:17:33 -- common/autotest_common.sh@725 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:33:43.826 16:17:33 -- common/autotest_common.sh@727 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:43.826 16:17:33 -- spdk/autopackage.sh@20 -- $ exit 0 00:33:43.826 + [[ -n 2207895 ]] 00:33:43.826 + sudo kill 2207895 00:33:43.838 [Pipeline] } 00:33:43.855 [Pipeline] // stage 00:33:43.860 [Pipeline] } 00:33:43.875 [Pipeline] // timeout 00:33:43.880 [Pipeline] } 00:33:43.895 [Pipeline] // catchError 00:33:43.900 [Pipeline] } 00:33:43.915 [Pipeline] // wrap 00:33:43.921 [Pipeline] } 00:33:43.935 [Pipeline] // catchError 00:33:43.945 [Pipeline] stage 00:33:43.947 [Pipeline] { (Epilogue) 00:33:43.960 [Pipeline] catchError 00:33:43.962 [Pipeline] { 00:33:43.975 [Pipeline] echo 00:33:43.977 Cleanup processes 00:33:43.983 [Pipeline] sh 00:33:44.274 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:44.274 2586834 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:44.289 [Pipeline] sh 00:33:44.577 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:44.577 ++ grep -v 'sudo pgrep' 00:33:44.577 ++ awk '{print $1}' 00:33:44.577 + sudo kill -9 00:33:44.577 + true 00:33:44.590 [Pipeline] sh 00:33:44.876 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:33:54.853 [Pipeline] sh 00:33:55.137 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:33:55.137 Artifacts sizes are good 00:33:55.153 [Pipeline] archiveArtifacts 00:33:55.160 Archiving artifacts 00:33:55.364 [Pipeline] sh 00:33:55.681 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:33:55.697 [Pipeline] cleanWs 00:33:55.707 [WS-CLEANUP] Deleting project workspace... 00:33:55.707 [WS-CLEANUP] Deferred wipeout is used... 00:33:55.714 [WS-CLEANUP] done 00:33:55.716 [Pipeline] } 00:33:55.733 [Pipeline] // catchError 00:33:55.746 [Pipeline] sh 00:33:56.025 + logger -p user.info -t JENKINS-CI 00:33:56.034 [Pipeline] } 00:33:56.048 [Pipeline] // stage 00:33:56.053 [Pipeline] } 00:33:56.067 [Pipeline] // node 00:33:56.073 [Pipeline] End of Pipeline 00:33:56.111 Finished: SUCCESS